Aug 15 00:27:39 user nova-compute[73010]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 15 00:27:42 user nova-compute[73010]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73010) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73010) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73010) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 00:27:42 user nova-compute[73010]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:27:42 user nova-compute[73010]: INFO nova.virt.driver [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 15 00:27:42 user nova-compute[73010]: INFO nova.compute.provider_config [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] Acquiring lock "singleton_lock" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] Acquired lock "singleton_lock" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] Releasing lock "singleton_lock" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] Full set of CONF: {{(pid=73010) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ******************************************************************************** {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] Configuration options gathered from: {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ================================================================================ {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] allow_resize_to_same_host      = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] arq_binding_timeout            = 300 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] backdoor_port                  = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] backdoor_socket                = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] block_device_allocate_retries  = 300 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] block_device_allocate_retries_interval = 5 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cert                           = self.pem {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] compute_monitors               = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] config_dir                     = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] config_drive_format            = iso9660 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] config_source                  = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] console_host                   = user {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] control_exchange               = nova {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cpu_allocation_ratio           = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] daemon                         = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] debug                          = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] default_access_ip_network_name = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] default_availability_zone      = nova {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] default_ephemeral_format       = ext4 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] default_schedule_zone          = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] disk_allocation_ratio          = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] enable_new_services            = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] enabled_ssl_apis               = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] flat_injected                  = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] force_config_drive             = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] force_raw_images               = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] graceful_shutdown_timeout      = 5 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] heal_instance_info_cache_interval = 60 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] host                           = user {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] instance_build_timeout         = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] instance_delete_interval       = 300 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] instance_name_template         = instance-%08x {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] instance_usage_audit           = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] instance_usage_audit_period    = month {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] internal_service_availability_zone = internal {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] key                            = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] live_migration_retry_count     = 30 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] log_config_append              = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] log_dir                        = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] log_file                       = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] log_options                    = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] log_rotate_interval            = 1 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] log_rotate_interval_type       = days {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] log_rotation_type              = none {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] long_rpc_timeout               = 1800 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] max_concurrent_builds          = 10 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] max_concurrent_live_migrations = 1 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] max_concurrent_snapshots       = 5 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] max_local_block_devices        = 3 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] max_logfile_count              = 30 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] max_logfile_size_mb            = 200 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] maximum_instance_delete_attempts = 5 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] metadata_listen                = 0.0.0.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] metadata_listen_port           = 8775 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] metadata_workers               = 3 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] migrate_max_retries            = -1 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] mkisofs_cmd                    = genisoimage {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] my_ip                          = 10.0.0.210 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] network_allocate_retries       = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] osapi_compute_listen_port      = 8774 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] osapi_compute_unique_server_name_scope =  {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] osapi_compute_workers          = 3 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] password_length                = 12 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] periodic_enable                = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] periodic_fuzzy_delay           = 60 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] pointer_model                  = ps2mouse {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] preallocate_images             = none {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] publish_errors                 = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] pybasedir                      = /opt/stack/nova {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ram_allocation_ratio           = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] rate_limit_burst               = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] rate_limit_except_level        = CRITICAL {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] rate_limit_interval            = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] reboot_timeout                 = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] reclaim_instance_interval      = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] record                         = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] reimage_timeout_per_gb         = 60 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] report_interval                = 120 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] rescue_timeout                 = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] reserved_host_cpus             = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] reserved_host_disk_mb          = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] reserved_host_memory_mb        = 512 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] reserved_huge_pages            = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] resize_confirm_window          = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] resize_fs_using_block_device   = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] resume_guests_state_on_host_boot = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] rpc_response_timeout           = 60 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] run_external_periodic_tasks    = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] running_deleted_instance_action = reap {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] running_deleted_instance_timeout = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] scheduler_instance_sync_interval = 120 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] service_down_time              = 720 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] servicegroup_driver            = db {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] shelved_offload_time           = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] shelved_poll_interval          = 3600 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] shutdown_timeout               = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] source_is_ipv6                 = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ssl_only                       = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] state_path                     = /opt/stack/data/nova {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] sync_power_state_interval      = 600 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] sync_power_state_pool_size     = 1000 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] syslog_log_facility            = LOG_USER {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] tempdir                        = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] timeout_nbd                    = 10 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] transport_url                  = **** {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] update_resources_interval      = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] use_cow_images                 = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] use_eventlog                   = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] use_journal                    = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] use_json                       = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] use_rootwrap_daemon            = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] use_stderr                     = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] use_syslog                     = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vcpu_pin_set                   = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vif_plugging_is_fatal          = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vif_plugging_timeout           = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] virt_mkfs                      = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] volume_usage_poll_interval     = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] watch_log_file                 = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] web                            = /usr/share/spice-html5 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_concurrency.disable_process_locking = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api.auth_strategy              = keystone {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api.compute_link_prefix        = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api.dhcp_domain                = novalocal {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api.enable_instance_password   = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api.glance_link_prefix         = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api.instance_list_per_project_cells = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api.list_records_by_skipping_down_cells = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api.local_metadata_per_cell    = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api.max_limit                  = 1000 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api.metadata_cache_expiration  = 15 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api.neutron_default_tenant_id  = default {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api.use_forwarded_for          = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api.use_neutron_default_nets   = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api.vendordata_dynamic_targets = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api.vendordata_jsonfile_path   = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.backend_argument         = **** {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.config_prefix            = cache.oslo {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.dead_timeout             = 60.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.debug_cache_backend      = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.enable_retry_client      = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.enable_socket_keepalive  = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.enabled                  = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.expiration_time          = 600 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.hashclient_retry_attempts = 2 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.memcache_dead_retry      = 300 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.memcache_password        =  {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.memcache_sasl_enabled    = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.memcache_username        =  {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.proxies                  = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.retry_attempts           = 2 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.retry_delay              = 0.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.socket_keepalive_count   = 1 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.socket_keepalive_idle    = 1 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.socket_keepalive_interval = 1 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.tls_allowed_ciphers      = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.tls_cafile               = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.tls_certfile             = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.tls_enabled              = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cache.tls_keyfile              = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cinder.auth_section            = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cinder.auth_type               = password {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cinder.cafile                  = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cinder.certfile                = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cinder.collect_timing          = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cinder.cross_az_attach         = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cinder.debug                   = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cinder.endpoint_template       = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cinder.http_retries            = 3 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cinder.insecure                = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cinder.keyfile                 = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cinder.os_region_name          = RegionOne {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cinder.split_loggers           = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cinder.timeout                 = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] compute.cpu_dedicated_set      = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] compute.cpu_shared_set         = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] compute.image_type_exclude_list = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] compute.resource_provider_association_refresh = 300 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] compute.shutdown_retry_interval = 10 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] conductor.workers              = 3 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] console.allowed_origins        = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] console.ssl_ciphers            = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] console.ssl_minimum_version    = default {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] consoleauth.token_ttl          = 600 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cyborg.cafile                  = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cyborg.certfile                = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cyborg.collect_timing          = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cyborg.connect_retries         = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cyborg.connect_retry_delay     = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cyborg.endpoint_override       = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cyborg.insecure                = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cyborg.keyfile                 = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cyborg.max_version             = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cyborg.min_version             = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cyborg.region_name             = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cyborg.service_name            = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cyborg.service_type            = accelerator {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cyborg.split_loggers           = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cyborg.status_code_retries     = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cyborg.status_code_retry_delay = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cyborg.timeout                 = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] cyborg.version                 = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] database.backend               = sqlalchemy {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] database.connection            = **** {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] database.connection_debug      = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] database.connection_parameters =  {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] database.connection_recycle_time = 3600 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] database.connection_trace      = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] database.db_inc_retry_interval = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] database.db_max_retries        = 20 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] database.db_max_retry_interval = 10 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] database.db_retry_interval     = 1 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] database.max_overflow          = 50 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] database.max_pool_size         = 5 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] database.max_retries           = 10 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] database.mysql_enable_ndb      = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] database.mysql_wsrep_sync_wait = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] database.pool_timeout          = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] database.retry_interval        = 10 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] database.slave_connection      = **** {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] database.sqlite_synchronous    = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api_database.backend           = sqlalchemy {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api_database.connection        = **** {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api_database.connection_debug  = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api_database.connection_parameters =  {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api_database.connection_recycle_time = 3600 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api_database.connection_trace  = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api_database.db_inc_retry_interval = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api_database.db_max_retries    = 20 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api_database.db_max_retry_interval = 10 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api_database.db_retry_interval = 1 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api_database.max_overflow      = 50 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api_database.max_pool_size     = 5 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api_database.max_retries       = 10 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api_database.mysql_enable_ndb  = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api_database.pool_timeout      = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api_database.retry_interval    = 10 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api_database.slave_connection  = **** {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] api_database.sqlite_synchronous = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] devices.enabled_mdev_types     = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ephemeral_storage_encryption.enabled = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.api_servers             = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.cafile                  = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.certfile                = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.collect_timing          = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.connect_retries         = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.connect_retry_delay     = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.debug                   = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.default_trusted_certificate_ids = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.enable_certificate_validation = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.enable_rbd_download     = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.endpoint_override       = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.insecure                = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.keyfile                 = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.max_version             = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.min_version             = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.num_retries             = 3 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.rbd_ceph_conf           =  {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.rbd_connect_timeout     = 5 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.rbd_pool                =  {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.rbd_user                =  {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.region_name             = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.service_name            = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.service_type            = image {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.split_loggers           = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.status_code_retries     = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.status_code_retry_delay = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.timeout                 = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.verify_glance_signatures = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] glance.version                 = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] guestfs.debug                  = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] hyperv.config_drive_cdrom      = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] hyperv.config_drive_inject_password = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] hyperv.enable_remotefx         = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] hyperv.instances_path_share    =  {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] hyperv.limit_cpu_features      = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] hyperv.use_multipath_io        = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] hyperv.vswitch_name            = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] mks.enabled                    = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] image_cache.manager_interval   = 2400 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] image_cache.precache_concurrency = 1 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] image_cache.remove_unused_base_images = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] image_cache.subdirectory_name  = _base {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.api_max_retries         = 60 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.api_retry_interval      = 2 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.auth_section            = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.auth_type               = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.cafile                  = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.certfile                = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.collect_timing          = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.connect_retries         = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.connect_retry_delay     = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.endpoint_override       = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.insecure                = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.keyfile                 = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.max_version             = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.min_version             = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.partition_key           = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.peer_list               = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.region_name             = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.serial_console_state_timeout = 10 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.service_name            = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.service_type            = baremetal {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.split_loggers           = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.status_code_retries     = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.status_code_retry_delay = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.timeout                 = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ironic.version                 = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] key_manager.fixed_key          = **** {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican.barbican_api_version  = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican.barbican_endpoint     = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican.barbican_endpoint_type = public {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican.barbican_region_name  = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican.cafile                = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican.certfile              = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican.collect_timing        = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican.insecure              = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican.keyfile               = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican.number_of_retries     = 60 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican.retry_delay           = 1 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican.send_service_user_token = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican.split_loggers         = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican.timeout               = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican.verify_ssl            = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican.verify_ssl_path       = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican_service_user.auth_section = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican_service_user.auth_type = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican_service_user.cafile   = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican_service_user.certfile = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican_service_user.collect_timing = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican_service_user.insecure = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican_service_user.keyfile  = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican_service_user.split_loggers = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] barbican_service_user.timeout  = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vault.approle_role_id          = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vault.approle_secret_id        = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vault.cafile                   = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vault.certfile                 = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vault.collect_timing           = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vault.insecure                 = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vault.keyfile                  = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vault.kv_mountpoint            = secret {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vault.kv_version               = 2 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vault.namespace                = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vault.root_token_id            = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vault.split_loggers            = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vault.ssl_ca_crt_file          = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vault.timeout                  = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vault.use_ssl                  = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] keystone.cafile                = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] keystone.certfile              = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] keystone.collect_timing        = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] keystone.connect_retries       = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] keystone.connect_retry_delay   = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] keystone.endpoint_override     = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] keystone.insecure              = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] keystone.keyfile               = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] keystone.max_version           = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] keystone.min_version           = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] keystone.region_name           = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] keystone.service_name          = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] keystone.service_type          = identity {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] keystone.split_loggers         = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] keystone.status_code_retries   = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] keystone.status_code_retry_delay = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] keystone.timeout               = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] keystone.version               = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.connection_uri         =  {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.cpu_mode               = custom {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: WARNING oslo_config.cfg [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.cpu_power_governor_high = performance {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.cpu_power_management   = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.device_detach_attempts = 8 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.device_detach_timeout  = 20 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.disk_cachemodes        = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.disk_prefix            = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.enabled_perf_events    = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.file_backed_memory     = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.gid_maps               = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.hw_disk_discard        = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.hw_machine_type        = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.images_rbd_pool        = rbd {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.images_type            = default {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.images_volume_group    = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.inject_key             = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.inject_partition       = -2 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.inject_password        = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.iscsi_iface            = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.iser_use_multipath     = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.live_migration_downtime = 500 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.live_migration_inbound_addr = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.live_migration_scheme  = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.live_migration_timeout_action = abort {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.live_migration_tunnelled = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: WARNING oslo_config.cfg [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 15 00:27:42 user nova-compute[73010]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 15 00:27:42 user nova-compute[73010]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 15 00:27:42 user nova-compute[73010]: and ``live_migration_inbound_addr`` respectively.
Aug 15 00:27:42 user nova-compute[73010]: ).  Its value may be silently ignored in the future.
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.live_migration_with_native_tls = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.max_queues             = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.nfs_mount_options      = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.num_pcie_ports         = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.pmem_namespaces        = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.quobyte_client_cfg     = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.rbd_secret_uuid        = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.rbd_user               = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.rescue_image_id        = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.rescue_kernel_id       = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.rx_queue_size          = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.smbfs_mount_options    =  {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.snapshot_compression   = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.snapshot_image_format  = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.sparse_logical_volumes = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.swtpm_enabled          = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.swtpm_group            = tss {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.swtpm_user             = tss {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.sysinfo_serial         = unique {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.tb_cache_size          = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.tx_queue_size          = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.uid_maps               = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.use_virtio_for_bridges = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.virt_type              = kvm {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.volume_clear           = zero {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.volume_clear_size      = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.volume_use_multipath   = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.vzstorage_cache_path   = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.auth_section           = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.auth_type              = password {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.cafile                 = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.certfile               = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.collect_timing         = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.connect_retries        = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.connect_retry_delay    = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.default_floating_pool  = public {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.endpoint_override      = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.extension_sync_interval = 600 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.http_retries           = 3 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.insecure               = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.keyfile                = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.max_version            = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.min_version            = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.ovs_bridge             = br-int {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.physnets               = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.region_name            = RegionOne {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.service_metadata_proxy = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.service_name           = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.service_type           = network {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.split_loggers          = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.status_code_retries    = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.status_code_retry_delay = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.timeout                = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] neutron.version                = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] notifications.bdms_in_notifications = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] notifications.default_level    = INFO {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] notifications.notification_format = unversioned {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] notifications.notify_on_state_change = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] pci.alias                      = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] pci.device_spec                = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] pci.report_in_placement        = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.auth_section         = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.auth_type            = password {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.cafile               = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.certfile             = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.collect_timing       = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.connect_retries      = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.connect_retry_delay  = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.default_domain_id    = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.default_domain_name  = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.domain_id            = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.domain_name          = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.endpoint_override    = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.insecure             = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.keyfile              = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.max_version          = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.min_version          = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.password             = **** {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.project_domain_id    = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.project_domain_name  = Default {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.project_id           = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.project_name         = service {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.region_name          = RegionOne {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.service_name         = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.service_type         = placement {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.split_loggers        = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.status_code_retries  = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.status_code_retry_delay = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.system_scope         = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.timeout              = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.trust_id             = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.user_domain_id       = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.user_domain_name     = Default {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.user_id              = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.username             = placement {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] placement.version              = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] quota.cores                    = 20 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] quota.count_usage_from_placement = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] quota.injected_file_content_bytes = 10240 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] quota.injected_file_path_length = 255 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] quota.injected_files           = 5 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] quota.instances                = 10 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] quota.key_pairs                = 100 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] quota.metadata_items           = 128 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] quota.ram                      = 51200 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] quota.recheck_quota            = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] quota.server_group_members     = 10 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] quota.server_groups            = 10 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] rdp.enabled                    = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] scheduler.image_metadata_prefilter = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] scheduler.max_attempts         = 3 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] scheduler.max_placement_results = 1000 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] scheduler.workers              = 3 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.host_subset_size = 1 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.isolated_hosts = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.isolated_images = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.pci_in_placement = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.track_instance_changes = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] metrics.required               = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] metrics.weight_multiplier      = 1.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] metrics.weight_setting         = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] serial_console.enabled         = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] serial_console.port_range      = 10000:20000 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] serial_console.serialproxy_port = 6083 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] service_user.auth_section      = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] service_user.auth_type         = password {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] service_user.cafile            = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] service_user.certfile          = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] service_user.collect_timing    = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] service_user.insecure          = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] service_user.keyfile           = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] service_user.send_service_user_token = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] service_user.split_loggers     = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] service_user.timeout           = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] spice.agent_enabled            = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] spice.enabled                  = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] spice.html5proxy_port          = 6082 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] spice.image_compression        = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] spice.jpeg_compression         = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] spice.playback_compression     = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] spice.server_listen            = 127.0.0.1 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] spice.streaming_mode           = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] spice.zlib_compression         = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] upgrade_levels.baseapi         = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] upgrade_levels.cert            = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] upgrade_levels.compute         = auto {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] upgrade_levels.conductor       = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] upgrade_levels.scheduler       = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vendordata_dynamic_auth.cafile = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vendordata_dynamic_auth.certfile = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vendordata_dynamic_auth.insecure = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vendordata_dynamic_auth.timeout = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.api_retry_count         = 10 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.ca_file                 = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.cache_prefix            = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.cluster_name            = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.connection_pool_size    = 10 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.console_delay_seconds   = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.datastore_regex         = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.host_ip                 = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.host_password           = **** {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.host_port               = 443 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.host_username           = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.insecure                = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.integration_bridge      = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.maximum_objects         = 100 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.pbm_default_policy      = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.pbm_enabled             = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.pbm_wsdl_location       = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.serial_port_proxy_uri   = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.serial_port_service_uri = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.task_poll_interval      = 0.5 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.use_linked_clone        = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.vnc_keymap              = en-us {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.vnc_port                = 5900 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vmware.vnc_port_total          = 10000 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vnc.auth_schemes               = ['none'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vnc.enabled                    = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vnc.novncproxy_port            = 6080 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:42 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vnc.vencrypt_ca_certs          = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vnc.vencrypt_client_cert       = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vnc.vencrypt_client_key        = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] workarounds.disable_rootwrap   = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] workarounds.enable_numa_live_migration = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] workarounds.libvirt_disable_apic = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] wsgi.client_socket_timeout     = 900 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] wsgi.default_pool_size         = 1000 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] wsgi.keep_alive                = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] wsgi.max_header_line           = 16384 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] wsgi.ssl_ca_file               = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] wsgi.ssl_cert_file             = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] wsgi.ssl_key_file              = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] wsgi.tcp_keepidle              = 600 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] zvm.ca_file                    = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] zvm.cloud_connector_url        = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] zvm.reachable_timeout          = 300 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_policy.enforce_new_defaults = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_policy.enforce_scope      = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_policy.policy_default_rule = default {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] profiler.connection_string     = messaging:// {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] profiler.enabled               = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] profiler.es_doc_type           = notification {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] profiler.es_scroll_size        = 10000 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] profiler.es_scroll_time        = 2m {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] profiler.filter_error_trace    = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] profiler.hmac_keys             = **** {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] profiler.sentinel_service_name = mymaster {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] profiler.socket_timeout        = 0.1 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] profiler.trace_requests        = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] profiler.trace_sqlalchemy      = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] profiler_jaeger.process_tags   = {} {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] profiler_jaeger.service_name_prefix = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] profiler_otlp.service_name_prefix = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] remote_debug.host              = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] remote_debug.port              = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_notifications.retry = -1 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_limit.auth_section        = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_limit.auth_type           = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_limit.cafile              = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_limit.certfile            = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_limit.collect_timing      = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_limit.connect_retries     = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_limit.connect_retry_delay = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_limit.endpoint_id         = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_limit.endpoint_override   = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_limit.insecure            = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_limit.keyfile             = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_limit.max_version         = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_limit.min_version         = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_limit.region_name         = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_limit.service_name        = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_limit.service_type        = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_limit.split_loggers       = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_limit.status_code_retries = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_limit.status_code_retry_delay = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_limit.timeout             = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_limit.valid_interfaces    = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_limit.version             = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_reports.file_event_handler = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] oslo_reports.log_dir           = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vif_plug_ovs_privileged.group  = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] vif_plug_ovs_privileged.user   = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] os_vif_ovs.isolate_vif         = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] os_brick.lock_path             = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] privsep_osbrick.capabilities   = [21] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] privsep_osbrick.group          = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] privsep_osbrick.helper_command = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] privsep_osbrick.user           = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] nova_sys_admin.group           = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] nova_sys_admin.helper_command  = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] nova_sys_admin.user            = None {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG oslo_service.service [None req-09c01cdb-8e11-4e84-8bde-90b29c55ead4 None None] ******************************************************************************** {{(pid=73010) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 15 00:27:43 user nova-compute[73010]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 15 00:27:43 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Starting native event thread {{(pid=73010) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Starting green dispatch thread {{(pid=73010) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Starting connection event dispatch thread {{(pid=73010) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Connecting to libvirt: qemu:///system {{(pid=73010) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fec73e20bb0> {{(pid=73010) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 15 00:27:43 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fec73e20bb0> {{(pid=73010) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 15 00:27:43 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Connection event '1' reason 'None'
Aug 15 00:27:43 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 15 00:27:43 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.mount [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Initialising _HostMountState generation 0 {{(pid=73010) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 15 00:27:50 user nova-compute[73010]: INFO nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Libvirt host capabilities <capabilities>
Aug 15 00:27:50 user nova-compute[73010]:   <host>
Aug 15 00:27:50 user nova-compute[73010]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 15 00:27:50 user nova-compute[73010]:     <cpu>
Aug 15 00:27:50 user nova-compute[73010]:       <arch>x86_64</arch>
Aug 15 00:27:50 user nova-compute[73010]:       <model>IvyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <vendor>Intel</vendor>
Aug 15 00:27:50 user nova-compute[73010]:       <microcode version='1070'/>
Aug 15 00:27:50 user nova-compute[73010]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 15 00:27:50 user nova-compute[73010]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature name='ss'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature name='vmx'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature name='pcid'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature name='osxsave'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature name='hypervisor'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature name='arat'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature name='tsc_adjust'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature name='md-clear'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature name='stibp'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature name='arch-capabilities'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature name='ssbd'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature name='invtsc'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature name='rsba'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature name='skip-l1dfl-vmentry'/>
Aug 15 00:27:50 user nova-compute[73010]:       <pages unit='KiB' size='4'/>
Aug 15 00:27:50 user nova-compute[73010]:       <pages unit='KiB' size='2048'/>
Aug 15 00:27:50 user nova-compute[73010]:     </cpu>
Aug 15 00:27:50 user nova-compute[73010]:     <power_management>
Aug 15 00:27:50 user nova-compute[73010]:       <suspend_mem/>
Aug 15 00:27:50 user nova-compute[73010]:       <suspend_disk/>
Aug 15 00:27:50 user nova-compute[73010]:       <suspend_hybrid/>
Aug 15 00:27:50 user nova-compute[73010]:     </power_management>
Aug 15 00:27:50 user nova-compute[73010]:     <iommu support='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     <migration_features>
Aug 15 00:27:50 user nova-compute[73010]:       <live/>
Aug 15 00:27:50 user nova-compute[73010]:       <uri_transports>
Aug 15 00:27:50 user nova-compute[73010]:         <uri_transport>tcp</uri_transport>
Aug 15 00:27:50 user nova-compute[73010]:         <uri_transport>rdma</uri_transport>
Aug 15 00:27:50 user nova-compute[73010]:       </uri_transports>
Aug 15 00:27:50 user nova-compute[73010]:     </migration_features>
Aug 15 00:27:50 user nova-compute[73010]:     <topology>
Aug 15 00:27:50 user nova-compute[73010]:       <cells num='2'>
Aug 15 00:27:50 user nova-compute[73010]:         <cell id='0'>
Aug 15 00:27:50 user nova-compute[73010]:           <memory unit='KiB'>8189224</memory>
Aug 15 00:27:50 user nova-compute[73010]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 15 00:27:50 user nova-compute[73010]:           <pages unit='KiB' size='2048'>0</pages>
Aug 15 00:27:50 user nova-compute[73010]:           <distances>
Aug 15 00:27:50 user nova-compute[73010]:             <sibling id='0' value='10'/>
Aug 15 00:27:50 user nova-compute[73010]:             <sibling id='1' value='20'/>
Aug 15 00:27:50 user nova-compute[73010]:           </distances>
Aug 15 00:27:50 user nova-compute[73010]:           <cpus num='6'>
Aug 15 00:27:50 user nova-compute[73010]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 15 00:27:50 user nova-compute[73010]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 15 00:27:50 user nova-compute[73010]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 15 00:27:50 user nova-compute[73010]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 15 00:27:50 user nova-compute[73010]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 15 00:27:50 user nova-compute[73010]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 15 00:27:50 user nova-compute[73010]:           </cpus>
Aug 15 00:27:50 user nova-compute[73010]:         </cell>
Aug 15 00:27:50 user nova-compute[73010]:         <cell id='1'>
Aug 15 00:27:50 user nova-compute[73010]:           <memory unit='KiB'>8206460</memory>
Aug 15 00:27:50 user nova-compute[73010]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 15 00:27:50 user nova-compute[73010]:           <pages unit='KiB' size='2048'>0</pages>
Aug 15 00:27:50 user nova-compute[73010]:           <distances>
Aug 15 00:27:50 user nova-compute[73010]:             <sibling id='0' value='20'/>
Aug 15 00:27:50 user nova-compute[73010]:             <sibling id='1' value='10'/>
Aug 15 00:27:50 user nova-compute[73010]:           </distances>
Aug 15 00:27:50 user nova-compute[73010]:           <cpus num='6'>
Aug 15 00:27:50 user nova-compute[73010]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 15 00:27:50 user nova-compute[73010]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 15 00:27:50 user nova-compute[73010]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 15 00:27:50 user nova-compute[73010]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 15 00:27:50 user nova-compute[73010]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 15 00:27:50 user nova-compute[73010]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 15 00:27:50 user nova-compute[73010]:           </cpus>
Aug 15 00:27:50 user nova-compute[73010]:         </cell>
Aug 15 00:27:50 user nova-compute[73010]:       </cells>
Aug 15 00:27:50 user nova-compute[73010]:     </topology>
Aug 15 00:27:50 user nova-compute[73010]:     <cache>
Aug 15 00:27:50 user nova-compute[73010]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 15 00:27:50 user nova-compute[73010]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 15 00:27:50 user nova-compute[73010]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 15 00:27:50 user nova-compute[73010]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 15 00:27:50 user nova-compute[73010]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 15 00:27:50 user nova-compute[73010]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 15 00:27:50 user nova-compute[73010]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 15 00:27:50 user nova-compute[73010]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 15 00:27:50 user nova-compute[73010]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 15 00:27:50 user nova-compute[73010]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 15 00:27:50 user nova-compute[73010]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 15 00:27:50 user nova-compute[73010]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 15 00:27:50 user nova-compute[73010]:     </cache>
Aug 15 00:27:50 user nova-compute[73010]:     <secmodel>
Aug 15 00:27:50 user nova-compute[73010]:       <model>apparmor</model>
Aug 15 00:27:50 user nova-compute[73010]:       <doi>0</doi>
Aug 15 00:27:50 user nova-compute[73010]:     </secmodel>
Aug 15 00:27:50 user nova-compute[73010]:     <secmodel>
Aug 15 00:27:50 user nova-compute[73010]:       <model>dac</model>
Aug 15 00:27:50 user nova-compute[73010]:       <doi>0</doi>
Aug 15 00:27:50 user nova-compute[73010]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 15 00:27:50 user nova-compute[73010]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 15 00:27:50 user nova-compute[73010]:     </secmodel>
Aug 15 00:27:50 user nova-compute[73010]:   </host>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='alpha'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>64</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>clipper</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='armv6l'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>32</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>spitz</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>nuri</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>kzm</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>sx1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>z2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>tosa</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>n810</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>n800</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>terrier</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>midway</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>microbit</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>verdex</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>highbank</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>akita</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>connex</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>collie</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='armv7l'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>32</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>spitz</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>nuri</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>kzm</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>sx1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>z2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>tosa</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>n810</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>n800</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>terrier</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>midway</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>microbit</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>verdex</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>highbank</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>akita</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>connex</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>collie</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='aarch64'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>64</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>spitz</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>nuri</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>kzm</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>sx1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>z2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>tosa</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>n810</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>n800</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>terrier</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>midway</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>microbit</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>verdex</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>raspi3b</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>highbank</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>akita</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>connex</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>collie</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <acpi default='on' toggle='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='cris'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>32</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='i686'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>32</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>x-remote</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>isapc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>microvm</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='kvm'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <pae/>
Aug 15 00:27:50 user nova-compute[73010]:       <nonpae/>
Aug 15 00:27:50 user nova-compute[73010]:       <acpi default='on' toggle='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:       <apic default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='m68k'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>32</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>an5206</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>q800</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>next-cube</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='microblaze'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>32</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='microblazeel'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>32</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='mips'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>32</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='16'>malta</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='mipsel'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>32</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='16'>malta</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='mips64'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>64</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='16'>malta</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>pica61</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>magnum</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='mips64el'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>64</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='16'>malta</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>pica61</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>magnum</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='16'>boston</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='ppc'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>32</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mac99</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>40p</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>taihu</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='ppc64'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>64</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2048'>powernv9</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>taihu</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2048'>powernv10</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>40p</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mac99</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2048'>powernv8</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='ppc64le'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>64</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2048'>powernv9</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>taihu</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2048'>powernv10</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>40p</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>mac99</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2048'>powernv8</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='riscv32'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>32</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='8'>spike</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>opentitan</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='5'>sifive_u</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>sifive_e</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='8'>virt</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='riscv64'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>64</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='8'>spike</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='5'>sifive_u</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>shakti_c</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>sifive_e</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='8'>virt</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='s390x'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>64</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='sh4'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>32</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>shix</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>r2d</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='sh4eb'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>64</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>shix</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>r2d</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='sparc'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>32</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>SS-5</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>SS-20</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>LX</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>SS-4</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>SS-10</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>Voyager</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='sparc64'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>64</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>sun4u</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>niagara</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>sun4v</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='x86_64'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>64</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>x-remote</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='1'>isapc</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>microvm</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='kvm'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <acpi default='on' toggle='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:       <apic default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='xtensa'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>32</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>sim</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='32'>kc705</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='32'>ml605</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='32'>virt</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='32'>lx200</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='32'>lx60</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]:   <guest>
Aug 15 00:27:50 user nova-compute[73010]:     <os_type>hvm</os_type>
Aug 15 00:27:50 user nova-compute[73010]:     <arch name='xtensaeb'>
Aug 15 00:27:50 user nova-compute[73010]:       <wordsize>32</wordsize>
Aug 15 00:27:50 user nova-compute[73010]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='4'>sim</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='32'>kc705</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='32'>ml605</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='32'>virt</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='32'>lx200</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='32'>lx60</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 15 00:27:50 user nova-compute[73010]:       <domain type='qemu'/>
Aug 15 00:27:50 user nova-compute[73010]:     </arch>
Aug 15 00:27:50 user nova-compute[73010]:     <features>
Aug 15 00:27:50 user nova-compute[73010]:       <cpuselection/>
Aug 15 00:27:50 user nova-compute[73010]:       <deviceboot/>
Aug 15 00:27:50 user nova-compute[73010]:       <disksnapshot default='on' toggle='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     </features>
Aug 15 00:27:50 user nova-compute[73010]:   </guest>
Aug 15 00:27:50 user nova-compute[73010]: </capabilities>
Aug 15 00:27:50 user nova-compute[73010]: 
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 15 00:27:50 user nova-compute[73010]: <domainCapabilities>
Aug 15 00:27:50 user nova-compute[73010]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 00:27:50 user nova-compute[73010]:   <domain>kvm</domain>
Aug 15 00:27:50 user nova-compute[73010]:   <machine>pc-q35-jammy</machine>
Aug 15 00:27:50 user nova-compute[73010]:   <arch>i686</arch>
Aug 15 00:27:50 user nova-compute[73010]:   <vcpu max='288'/>
Aug 15 00:27:50 user nova-compute[73010]:   <iothreads supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:   <os supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:     <enum name='firmware'/>
Aug 15 00:27:50 user nova-compute[73010]:     <loader supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='type'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>rom</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>pflash</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='readonly'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>yes</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>no</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='secure'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>no</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </loader>
Aug 15 00:27:50 user nova-compute[73010]:   </os>
Aug 15 00:27:50 user nova-compute[73010]:   <cpu>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='host-passthrough' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='hostPassthroughMigratable'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>off</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='maximum' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='maximumMigratable'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>on</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>off</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='host-model' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <vendor>Intel</vendor>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ss'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='vmx'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='pcid'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='hypervisor'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='arat'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='umip'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='md-clear'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='stibp'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ssbd'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ibpb'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ibrs'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='amd-stibp'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='disable' name='erms'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='disable' name='lm'/>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='custom' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>qemu64</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>qemu32</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>phenom</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>pentium3</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>pentium2</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>pentium</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>n270</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>kvm64</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>kvm32</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>coreduo</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>core2duo</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>athlon</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Westmere</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Snowridge</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Server</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Client</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>SandyBridge</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Penryn</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G5</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G4</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G3</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G2</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G1</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Nehalem</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>IvyBridge</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Icelake-Server</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC-Rome</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC-Milan</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Dhyana</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Cooperlake</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Conroe</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>486</model>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:   </cpu>
Aug 15 00:27:50 user nova-compute[73010]:   <memoryBacking supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:     <enum name='sourceType'>
Aug 15 00:27:50 user nova-compute[73010]:       <value>file</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>anonymous</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>memfd</value>
Aug 15 00:27:50 user nova-compute[73010]:     </enum>
Aug 15 00:27:50 user nova-compute[73010]:   </memoryBacking>
Aug 15 00:27:50 user nova-compute[73010]:   <devices>
Aug 15 00:27:50 user nova-compute[73010]:     <disk supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='diskDevice'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>disk</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>cdrom</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>floppy</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>lun</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='bus'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>fdc</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>scsi</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>usb</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>sata</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='model'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-non-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </disk>
Aug 15 00:27:50 user nova-compute[73010]:     <graphics supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='type'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>sdl</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>vnc</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>spice</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>egl-headless</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </graphics>
Aug 15 00:27:50 user nova-compute[73010]:     <video supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='modelType'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>vga</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>cirrus</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>vmvga</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>qxl</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>none</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>bochs</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>ramfb</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </video>
Aug 15 00:27:50 user nova-compute[73010]:     <hostdev supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='mode'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>subsystem</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='startupPolicy'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>default</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>mandatory</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>requisite</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>optional</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='subsysType'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>usb</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>pci</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>scsi</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='capsType'/>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='pciBackend'/>
Aug 15 00:27:50 user nova-compute[73010]:     </hostdev>
Aug 15 00:27:50 user nova-compute[73010]:     <rng supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='model'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-non-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='backendModel'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>random</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>egd</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>builtin</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </rng>
Aug 15 00:27:50 user nova-compute[73010]:     <filesystem supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='driverType'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>path</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>handle</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtiofs</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </filesystem>
Aug 15 00:27:50 user nova-compute[73010]:     <tpm supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='model'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>tpm-tis</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>tpm-crb</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='backendModel'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>passthrough</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>emulator</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </tpm>
Aug 15 00:27:50 user nova-compute[73010]:   </devices>
Aug 15 00:27:50 user nova-compute[73010]:   <features>
Aug 15 00:27:50 user nova-compute[73010]:     <gic supported='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     <vmcoreinfo supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <genid supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <backingStoreInput supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <backup supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <sev supported='no'/>
Aug 15 00:27:50 user nova-compute[73010]:   </features>
Aug 15 00:27:50 user nova-compute[73010]: </domainCapabilities>
Aug 15 00:27:50 user nova-compute[73010]:  {{(pid=73010) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 15 00:27:50 user nova-compute[73010]: <domainCapabilities>
Aug 15 00:27:50 user nova-compute[73010]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 00:27:50 user nova-compute[73010]:   <domain>kvm</domain>
Aug 15 00:27:50 user nova-compute[73010]:   <machine>pc-i440fx-jammy</machine>
Aug 15 00:27:50 user nova-compute[73010]:   <arch>i686</arch>
Aug 15 00:27:50 user nova-compute[73010]:   <vcpu max='255'/>
Aug 15 00:27:50 user nova-compute[73010]:   <iothreads supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:   <os supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:     <enum name='firmware'/>
Aug 15 00:27:50 user nova-compute[73010]:     <loader supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='type'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>rom</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>pflash</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='readonly'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>yes</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>no</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='secure'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>no</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </loader>
Aug 15 00:27:50 user nova-compute[73010]:   </os>
Aug 15 00:27:50 user nova-compute[73010]:   <cpu>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='host-passthrough' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='hostPassthroughMigratable'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>off</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='maximum' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='maximumMigratable'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>on</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>off</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='host-model' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <vendor>Intel</vendor>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ss'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='vmx'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='pcid'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='hypervisor'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='arat'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='umip'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='md-clear'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='stibp'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ssbd'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ibpb'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ibrs'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='amd-stibp'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='disable' name='erms'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='disable' name='lm'/>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='custom' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>qemu64</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>qemu32</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>phenom</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>pentium3</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>pentium2</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>pentium</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>n270</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>kvm64</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>kvm32</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>coreduo</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>core2duo</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>athlon</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Westmere</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Snowridge</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Server</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Client</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>SandyBridge</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Penryn</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G5</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G4</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G3</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G2</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G1</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Nehalem</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>IvyBridge</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Icelake-Server</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC-Rome</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC-Milan</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Dhyana</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Cooperlake</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Conroe</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>486</model>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:   </cpu>
Aug 15 00:27:50 user nova-compute[73010]:   <memoryBacking supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:     <enum name='sourceType'>
Aug 15 00:27:50 user nova-compute[73010]:       <value>file</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>anonymous</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>memfd</value>
Aug 15 00:27:50 user nova-compute[73010]:     </enum>
Aug 15 00:27:50 user nova-compute[73010]:   </memoryBacking>
Aug 15 00:27:50 user nova-compute[73010]:   <devices>
Aug 15 00:27:50 user nova-compute[73010]:     <disk supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='diskDevice'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>disk</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>cdrom</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>floppy</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>lun</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='bus'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>ide</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>fdc</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>scsi</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>usb</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>sata</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='model'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-non-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </disk>
Aug 15 00:27:50 user nova-compute[73010]:     <graphics supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='type'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>sdl</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>vnc</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>spice</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>egl-headless</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </graphics>
Aug 15 00:27:50 user nova-compute[73010]:     <video supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='modelType'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>vga</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>cirrus</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>vmvga</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>qxl</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>none</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>bochs</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>ramfb</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </video>
Aug 15 00:27:50 user nova-compute[73010]:     <hostdev supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='mode'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>subsystem</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='startupPolicy'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>default</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>mandatory</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>requisite</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>optional</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='subsysType'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>usb</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>pci</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>scsi</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='capsType'/>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='pciBackend'/>
Aug 15 00:27:50 user nova-compute[73010]:     </hostdev>
Aug 15 00:27:50 user nova-compute[73010]:     <rng supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='model'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-non-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='backendModel'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>random</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>egd</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>builtin</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </rng>
Aug 15 00:27:50 user nova-compute[73010]:     <filesystem supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='driverType'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>path</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>handle</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtiofs</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </filesystem>
Aug 15 00:27:50 user nova-compute[73010]:     <tpm supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='model'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>tpm-tis</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>tpm-crb</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='backendModel'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>passthrough</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>emulator</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </tpm>
Aug 15 00:27:50 user nova-compute[73010]:   </devices>
Aug 15 00:27:50 user nova-compute[73010]:   <features>
Aug 15 00:27:50 user nova-compute[73010]:     <gic supported='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     <vmcoreinfo supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <genid supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <backingStoreInput supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <backup supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <sev supported='no'/>
Aug 15 00:27:50 user nova-compute[73010]:   </features>
Aug 15 00:27:50 user nova-compute[73010]: </domainCapabilities>
Aug 15 00:27:50 user nova-compute[73010]:  {{(pid=73010) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 15 00:27:50 user nova-compute[73010]: <domainCapabilities>
Aug 15 00:27:50 user nova-compute[73010]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 00:27:50 user nova-compute[73010]:   <domain>kvm</domain>
Aug 15 00:27:50 user nova-compute[73010]:   <machine>pc-i440fx-6.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:   <arch>i686</arch>
Aug 15 00:27:50 user nova-compute[73010]:   <vcpu max='255'/>
Aug 15 00:27:50 user nova-compute[73010]:   <iothreads supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:   <os supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:     <enum name='firmware'/>
Aug 15 00:27:50 user nova-compute[73010]:     <loader supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='type'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>rom</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>pflash</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='readonly'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>yes</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>no</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='secure'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>no</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </loader>
Aug 15 00:27:50 user nova-compute[73010]:   </os>
Aug 15 00:27:50 user nova-compute[73010]:   <cpu>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='host-passthrough' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='hostPassthroughMigratable'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>off</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='maximum' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='maximumMigratable'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>on</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>off</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='host-model' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <vendor>Intel</vendor>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ss'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='vmx'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='pcid'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='hypervisor'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='arat'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='umip'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='md-clear'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='stibp'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ssbd'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ibpb'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ibrs'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='amd-stibp'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='disable' name='erms'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='disable' name='lm'/>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='custom' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>qemu64</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>qemu32</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>phenom</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>pentium3</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>pentium2</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>pentium</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>n270</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>kvm64</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>kvm32</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>coreduo</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>core2duo</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>athlon</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Westmere</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Snowridge</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Server</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Client</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>SandyBridge</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Penryn</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G5</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G4</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G3</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G2</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G1</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Nehalem</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>IvyBridge</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Icelake-Server</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC-Rome</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC-Milan</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Dhyana</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Cooperlake</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Conroe</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>486</model>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:   </cpu>
Aug 15 00:27:50 user nova-compute[73010]:   <memoryBacking supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:     <enum name='sourceType'>
Aug 15 00:27:50 user nova-compute[73010]:       <value>file</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>anonymous</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>memfd</value>
Aug 15 00:27:50 user nova-compute[73010]:     </enum>
Aug 15 00:27:50 user nova-compute[73010]:   </memoryBacking>
Aug 15 00:27:50 user nova-compute[73010]:   <devices>
Aug 15 00:27:50 user nova-compute[73010]:     <disk supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='diskDevice'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>disk</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>cdrom</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>floppy</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>lun</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='bus'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>ide</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>fdc</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>scsi</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>usb</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>sata</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='model'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-non-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </disk>
Aug 15 00:27:50 user nova-compute[73010]:     <graphics supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='type'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>sdl</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>vnc</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>spice</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>egl-headless</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </graphics>
Aug 15 00:27:50 user nova-compute[73010]:     <video supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='modelType'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>vga</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>cirrus</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>vmvga</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>qxl</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>none</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>bochs</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>ramfb</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </video>
Aug 15 00:27:50 user nova-compute[73010]:     <hostdev supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='mode'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>subsystem</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='startupPolicy'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>default</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>mandatory</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>requisite</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>optional</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='subsysType'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>usb</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>pci</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>scsi</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='capsType'/>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='pciBackend'/>
Aug 15 00:27:50 user nova-compute[73010]:     </hostdev>
Aug 15 00:27:50 user nova-compute[73010]:     <rng supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='model'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-non-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='backendModel'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>random</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>egd</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>builtin</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </rng>
Aug 15 00:27:50 user nova-compute[73010]:     <filesystem supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='driverType'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>path</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>handle</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtiofs</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </filesystem>
Aug 15 00:27:50 user nova-compute[73010]:     <tpm supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='model'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>tpm-tis</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>tpm-crb</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='backendModel'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>passthrough</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>emulator</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </tpm>
Aug 15 00:27:50 user nova-compute[73010]:   </devices>
Aug 15 00:27:50 user nova-compute[73010]:   <features>
Aug 15 00:27:50 user nova-compute[73010]:     <gic supported='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     <vmcoreinfo supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <genid supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <backingStoreInput supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <backup supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <sev supported='no'/>
Aug 15 00:27:50 user nova-compute[73010]:   </features>
Aug 15 00:27:50 user nova-compute[73010]: </domainCapabilities>
Aug 15 00:27:50 user nova-compute[73010]:  {{(pid=73010) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 15 00:27:50 user nova-compute[73010]: <domainCapabilities>
Aug 15 00:27:50 user nova-compute[73010]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 00:27:50 user nova-compute[73010]:   <domain>kvm</domain>
Aug 15 00:27:50 user nova-compute[73010]:   <machine>pc-q35-6.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:   <arch>i686</arch>
Aug 15 00:27:50 user nova-compute[73010]:   <vcpu max='288'/>
Aug 15 00:27:50 user nova-compute[73010]:   <iothreads supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:   <os supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:     <enum name='firmware'/>
Aug 15 00:27:50 user nova-compute[73010]:     <loader supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='type'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>rom</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>pflash</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='readonly'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>yes</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>no</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='secure'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>no</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </loader>
Aug 15 00:27:50 user nova-compute[73010]:   </os>
Aug 15 00:27:50 user nova-compute[73010]:   <cpu>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='host-passthrough' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='hostPassthroughMigratable'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>off</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='maximum' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='maximumMigratable'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>on</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>off</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='host-model' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <vendor>Intel</vendor>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ss'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='vmx'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='pcid'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='hypervisor'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='arat'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='umip'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='md-clear'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='stibp'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ssbd'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ibpb'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ibrs'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='amd-stibp'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='disable' name='erms'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='disable' name='lm'/>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='custom' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>qemu64</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>qemu32</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>phenom</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>pentium3</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>pentium2</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>pentium</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>n270</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>kvm64</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>kvm32</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>coreduo</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>core2duo</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>athlon</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Westmere</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Snowridge</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Server</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Client</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>SandyBridge</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Penryn</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G5</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G4</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G3</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G2</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G1</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Nehalem</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>IvyBridge</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Icelake-Server</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC-Rome</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC-Milan</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Dhyana</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Cooperlake</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Conroe</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>486</model>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:   </cpu>
Aug 15 00:27:50 user nova-compute[73010]:   <memoryBacking supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:     <enum name='sourceType'>
Aug 15 00:27:50 user nova-compute[73010]:       <value>file</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>anonymous</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>memfd</value>
Aug 15 00:27:50 user nova-compute[73010]:     </enum>
Aug 15 00:27:50 user nova-compute[73010]:   </memoryBacking>
Aug 15 00:27:50 user nova-compute[73010]:   <devices>
Aug 15 00:27:50 user nova-compute[73010]:     <disk supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='diskDevice'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>disk</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>cdrom</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>floppy</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>lun</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='bus'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>fdc</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>scsi</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>usb</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>sata</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='model'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-non-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </disk>
Aug 15 00:27:50 user nova-compute[73010]:     <graphics supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='type'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>sdl</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>vnc</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>spice</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>egl-headless</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </graphics>
Aug 15 00:27:50 user nova-compute[73010]:     <video supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='modelType'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>vga</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>cirrus</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>vmvga</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>qxl</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>none</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>bochs</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>ramfb</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </video>
Aug 15 00:27:50 user nova-compute[73010]:     <hostdev supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='mode'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>subsystem</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='startupPolicy'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>default</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>mandatory</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>requisite</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>optional</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='subsysType'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>usb</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>pci</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>scsi</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='capsType'/>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='pciBackend'/>
Aug 15 00:27:50 user nova-compute[73010]:     </hostdev>
Aug 15 00:27:50 user nova-compute[73010]:     <rng supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='model'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-non-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='backendModel'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>random</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>egd</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>builtin</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </rng>
Aug 15 00:27:50 user nova-compute[73010]:     <filesystem supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='driverType'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>path</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>handle</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtiofs</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </filesystem>
Aug 15 00:27:50 user nova-compute[73010]:     <tpm supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='model'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>tpm-tis</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>tpm-crb</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='backendModel'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>passthrough</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>emulator</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </tpm>
Aug 15 00:27:50 user nova-compute[73010]:   </devices>
Aug 15 00:27:50 user nova-compute[73010]:   <features>
Aug 15 00:27:50 user nova-compute[73010]:     <gic supported='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     <vmcoreinfo supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <genid supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <backingStoreInput supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <backup supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <sev supported='no'/>
Aug 15 00:27:50 user nova-compute[73010]:   </features>
Aug 15 00:27:50 user nova-compute[73010]: </domainCapabilities>
Aug 15 00:27:50 user nova-compute[73010]:  {{(pid=73010) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 15 00:27:50 user nova-compute[73010]: <domainCapabilities>
Aug 15 00:27:50 user nova-compute[73010]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 00:27:50 user nova-compute[73010]:   <domain>kvm</domain>
Aug 15 00:27:50 user nova-compute[73010]:   <machine>pc-q35-jammy</machine>
Aug 15 00:27:50 user nova-compute[73010]:   <arch>x86_64</arch>
Aug 15 00:27:50 user nova-compute[73010]:   <vcpu max='288'/>
Aug 15 00:27:50 user nova-compute[73010]:   <iothreads supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:   <os supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:     <enum name='firmware'>
Aug 15 00:27:50 user nova-compute[73010]:       <value>efi</value>
Aug 15 00:27:50 user nova-compute[73010]:     </enum>
Aug 15 00:27:50 user nova-compute[73010]:     <loader supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='type'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>rom</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>pflash</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='readonly'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>yes</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>no</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='secure'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>yes</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>no</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </loader>
Aug 15 00:27:50 user nova-compute[73010]:   </os>
Aug 15 00:27:50 user nova-compute[73010]:   <cpu>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='host-passthrough' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='hostPassthroughMigratable'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>on</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>off</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='maximum' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='maximumMigratable'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>on</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>off</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='host-model' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <vendor>Intel</vendor>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ss'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='vmx'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='pcid'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='hypervisor'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='arat'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='umip'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='md-clear'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='stibp'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ssbd'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='invtsc'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ibpb'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ibrs'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='amd-stibp'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='rsba'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='disable' name='erms'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='custom' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>qemu64</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>qemu32</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>phenom</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>pentium3</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>pentium2</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>pentium</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>n270</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>kvm64</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>kvm32</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>coreduo</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>core2duo</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>athlon</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Westmere</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Snowridge</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Server</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Client</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>SandyBridge</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Penryn</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G5</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G4</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G3</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G2</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Opteron_G1</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Nehalem</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>IvyBridge</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Icelake-Server</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC-Rome</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC-Milan</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Dhyana</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Cooperlake</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Conroe</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>486</model>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:   </cpu>
Aug 15 00:27:50 user nova-compute[73010]:   <memoryBacking supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:     <enum name='sourceType'>
Aug 15 00:27:50 user nova-compute[73010]:       <value>file</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>anonymous</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>memfd</value>
Aug 15 00:27:50 user nova-compute[73010]:     </enum>
Aug 15 00:27:50 user nova-compute[73010]:   </memoryBacking>
Aug 15 00:27:50 user nova-compute[73010]:   <devices>
Aug 15 00:27:50 user nova-compute[73010]:     <disk supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='diskDevice'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>disk</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>cdrom</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>floppy</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>lun</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='bus'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>fdc</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>scsi</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>usb</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>sata</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='model'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-non-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </disk>
Aug 15 00:27:50 user nova-compute[73010]:     <graphics supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='type'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>sdl</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>vnc</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>spice</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>egl-headless</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </graphics>
Aug 15 00:27:50 user nova-compute[73010]:     <video supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='modelType'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>vga</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>cirrus</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>vmvga</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>qxl</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>none</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>bochs</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>ramfb</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </video>
Aug 15 00:27:50 user nova-compute[73010]:     <hostdev supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='mode'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>subsystem</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='startupPolicy'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>default</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>mandatory</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>requisite</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>optional</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='subsysType'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>usb</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>pci</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>scsi</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='capsType'/>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='pciBackend'/>
Aug 15 00:27:50 user nova-compute[73010]:     </hostdev>
Aug 15 00:27:50 user nova-compute[73010]:     <rng supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='model'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-non-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='backendModel'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>random</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>egd</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>builtin</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </rng>
Aug 15 00:27:50 user nova-compute[73010]:     <filesystem supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='driverType'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>path</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>handle</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtiofs</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </filesystem>
Aug 15 00:27:50 user nova-compute[73010]:     <tpm supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='model'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>tpm-tis</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>tpm-crb</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='backendModel'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>passthrough</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>emulator</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </tpm>
Aug 15 00:27:50 user nova-compute[73010]:   </devices>
Aug 15 00:27:50 user nova-compute[73010]:   <features>
Aug 15 00:27:50 user nova-compute[73010]:     <gic supported='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     <vmcoreinfo supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <genid supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <backingStoreInput supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <backup supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <sev supported='no'/>
Aug 15 00:27:50 user nova-compute[73010]:   </features>
Aug 15 00:27:50 user nova-compute[73010]: </domainCapabilities>
Aug 15 00:27:50 user nova-compute[73010]:  {{(pid=73010) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 15 00:27:50 user nova-compute[73010]: <domainCapabilities>
Aug 15 00:27:50 user nova-compute[73010]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 00:27:50 user nova-compute[73010]:   <domain>kvm</domain>
Aug 15 00:27:50 user nova-compute[73010]:   <machine>pc-i440fx-jammy</machine>
Aug 15 00:27:50 user nova-compute[73010]:   <arch>x86_64</arch>
Aug 15 00:27:50 user nova-compute[73010]:   <vcpu max='255'/>
Aug 15 00:27:50 user nova-compute[73010]:   <iothreads supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:   <os supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:     <enum name='firmware'>
Aug 15 00:27:50 user nova-compute[73010]:       <value>efi</value>
Aug 15 00:27:50 user nova-compute[73010]:     </enum>
Aug 15 00:27:50 user nova-compute[73010]:     <loader supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='type'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>rom</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>pflash</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='readonly'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>yes</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>no</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='secure'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>no</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </loader>
Aug 15 00:27:50 user nova-compute[73010]:   </os>
Aug 15 00:27:50 user nova-compute[73010]:   <cpu>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='host-passthrough' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='hostPassthroughMigratable'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>on</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>off</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='maximum' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='maximumMigratable'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>on</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>off</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='host-model' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <vendor>Intel</vendor>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ss'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='vmx'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='pcid'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='hypervisor'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='arat'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='umip'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='md-clear'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='stibp'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ssbd'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='invtsc'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ibpb'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ibrs'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='amd-stibp'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='rsba'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='disable' name='erms'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='custom' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>qemu64</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>qemu32</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>phenom</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>pentium3</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>pentium2</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>pentium</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>n270</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>kvm64</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>kvm32</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>coreduo</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>core2duo</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>athlon</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Westmere</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Snowridge</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Server</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Client</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>SandyBridge</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Penryn</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G5</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G4</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G3</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G2</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Opteron_G1</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Nehalem</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>IvyBridge</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Icelake-Server</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC-Rome</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC-Milan</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Dhyana</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Cooperlake</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Conroe</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>486</model>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:   </cpu>
Aug 15 00:27:50 user nova-compute[73010]:   <memoryBacking supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:     <enum name='sourceType'>
Aug 15 00:27:50 user nova-compute[73010]:       <value>file</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>anonymous</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>memfd</value>
Aug 15 00:27:50 user nova-compute[73010]:     </enum>
Aug 15 00:27:50 user nova-compute[73010]:   </memoryBacking>
Aug 15 00:27:50 user nova-compute[73010]:   <devices>
Aug 15 00:27:50 user nova-compute[73010]:     <disk supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='diskDevice'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>disk</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>cdrom</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>floppy</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>lun</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='bus'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>ide</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>fdc</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>scsi</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>usb</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>sata</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='model'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-non-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </disk>
Aug 15 00:27:50 user nova-compute[73010]:     <graphics supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='type'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>sdl</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>vnc</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>spice</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>egl-headless</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </graphics>
Aug 15 00:27:50 user nova-compute[73010]:     <video supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='modelType'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>vga</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>cirrus</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>vmvga</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>qxl</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>none</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>bochs</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>ramfb</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </video>
Aug 15 00:27:50 user nova-compute[73010]:     <hostdev supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='mode'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>subsystem</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='startupPolicy'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>default</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>mandatory</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>requisite</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>optional</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='subsysType'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>usb</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>pci</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>scsi</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='capsType'/>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='pciBackend'/>
Aug 15 00:27:50 user nova-compute[73010]:     </hostdev>
Aug 15 00:27:50 user nova-compute[73010]:     <rng supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='model'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-non-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='backendModel'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>random</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>egd</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>builtin</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </rng>
Aug 15 00:27:50 user nova-compute[73010]:     <filesystem supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='driverType'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>path</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>handle</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtiofs</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </filesystem>
Aug 15 00:27:50 user nova-compute[73010]:     <tpm supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='model'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>tpm-tis</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>tpm-crb</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='backendModel'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>passthrough</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>emulator</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </tpm>
Aug 15 00:27:50 user nova-compute[73010]:   </devices>
Aug 15 00:27:50 user nova-compute[73010]:   <features>
Aug 15 00:27:50 user nova-compute[73010]:     <gic supported='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     <vmcoreinfo supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <genid supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <backingStoreInput supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <backup supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <sev supported='no'/>
Aug 15 00:27:50 user nova-compute[73010]:   </features>
Aug 15 00:27:50 user nova-compute[73010]: </domainCapabilities>
Aug 15 00:27:50 user nova-compute[73010]:  {{(pid=73010) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 15 00:27:50 user nova-compute[73010]: <domainCapabilities>
Aug 15 00:27:50 user nova-compute[73010]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 00:27:50 user nova-compute[73010]:   <domain>kvm</domain>
Aug 15 00:27:50 user nova-compute[73010]:   <machine>pc-i440fx-6.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:   <arch>x86_64</arch>
Aug 15 00:27:50 user nova-compute[73010]:   <vcpu max='255'/>
Aug 15 00:27:50 user nova-compute[73010]:   <iothreads supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:   <os supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:     <enum name='firmware'>
Aug 15 00:27:50 user nova-compute[73010]:       <value>efi</value>
Aug 15 00:27:50 user nova-compute[73010]:     </enum>
Aug 15 00:27:50 user nova-compute[73010]:     <loader supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='type'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>rom</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>pflash</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='readonly'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>yes</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>no</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='secure'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>no</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </loader>
Aug 15 00:27:50 user nova-compute[73010]:   </os>
Aug 15 00:27:50 user nova-compute[73010]:   <cpu>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='host-passthrough' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='hostPassthroughMigratable'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>on</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>off</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='maximum' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='maximumMigratable'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>on</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>off</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='host-model' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <vendor>Intel</vendor>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ss'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='vmx'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='pcid'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='hypervisor'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='arat'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='umip'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='md-clear'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='stibp'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ssbd'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='invtsc'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ibpb'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ibrs'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='amd-stibp'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='rsba'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='disable' name='erms'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='custom' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>qemu64</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>qemu32</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>phenom</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>pentium3</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>pentium2</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>pentium</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>n270</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>kvm64</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>kvm32</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>coreduo</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>core2duo</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>athlon</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Westmere</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Snowridge</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Server</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Client</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>SandyBridge</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Penryn</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G5</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G4</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G3</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G2</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Opteron_G1</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Nehalem</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>IvyBridge</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Icelake-Server</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC-Rome</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC-Milan</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Dhyana</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Cooperlake</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Conroe</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>486</model>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:   </cpu>
Aug 15 00:27:50 user nova-compute[73010]:   <memoryBacking supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:     <enum name='sourceType'>
Aug 15 00:27:50 user nova-compute[73010]:       <value>file</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>anonymous</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>memfd</value>
Aug 15 00:27:50 user nova-compute[73010]:     </enum>
Aug 15 00:27:50 user nova-compute[73010]:   </memoryBacking>
Aug 15 00:27:50 user nova-compute[73010]:   <devices>
Aug 15 00:27:50 user nova-compute[73010]:     <disk supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='diskDevice'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>disk</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>cdrom</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>floppy</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>lun</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='bus'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>ide</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>fdc</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>scsi</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>usb</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>sata</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='model'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-non-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </disk>
Aug 15 00:27:50 user nova-compute[73010]:     <graphics supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='type'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>sdl</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>vnc</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>spice</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>egl-headless</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </graphics>
Aug 15 00:27:50 user nova-compute[73010]:     <video supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='modelType'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>vga</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>cirrus</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>vmvga</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>qxl</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>none</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>bochs</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>ramfb</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </video>
Aug 15 00:27:50 user nova-compute[73010]:     <hostdev supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='mode'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>subsystem</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='startupPolicy'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>default</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>mandatory</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>requisite</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>optional</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='subsysType'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>usb</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>pci</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>scsi</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='capsType'/>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='pciBackend'/>
Aug 15 00:27:50 user nova-compute[73010]:     </hostdev>
Aug 15 00:27:50 user nova-compute[73010]:     <rng supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='model'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-non-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='backendModel'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>random</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>egd</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>builtin</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </rng>
Aug 15 00:27:50 user nova-compute[73010]:     <filesystem supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='driverType'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>path</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>handle</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtiofs</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </filesystem>
Aug 15 00:27:50 user nova-compute[73010]:     <tpm supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='model'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>tpm-tis</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>tpm-crb</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='backendModel'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>passthrough</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>emulator</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </tpm>
Aug 15 00:27:50 user nova-compute[73010]:   </devices>
Aug 15 00:27:50 user nova-compute[73010]:   <features>
Aug 15 00:27:50 user nova-compute[73010]:     <gic supported='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     <vmcoreinfo supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <genid supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <backingStoreInput supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <backup supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <sev supported='no'/>
Aug 15 00:27:50 user nova-compute[73010]:   </features>
Aug 15 00:27:50 user nova-compute[73010]: </domainCapabilities>
Aug 15 00:27:50 user nova-compute[73010]:  {{(pid=73010) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 15 00:27:50 user nova-compute[73010]: <domainCapabilities>
Aug 15 00:27:50 user nova-compute[73010]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 00:27:50 user nova-compute[73010]:   <domain>kvm</domain>
Aug 15 00:27:50 user nova-compute[73010]:   <machine>pc-q35-6.2</machine>
Aug 15 00:27:50 user nova-compute[73010]:   <arch>x86_64</arch>
Aug 15 00:27:50 user nova-compute[73010]:   <vcpu max='288'/>
Aug 15 00:27:50 user nova-compute[73010]:   <iothreads supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:   <os supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:     <enum name='firmware'>
Aug 15 00:27:50 user nova-compute[73010]:       <value>efi</value>
Aug 15 00:27:50 user nova-compute[73010]:     </enum>
Aug 15 00:27:50 user nova-compute[73010]:     <loader supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='type'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>rom</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>pflash</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='readonly'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>yes</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>no</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='secure'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>yes</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>no</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </loader>
Aug 15 00:27:50 user nova-compute[73010]:   </os>
Aug 15 00:27:50 user nova-compute[73010]:   <cpu>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='host-passthrough' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='hostPassthroughMigratable'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>on</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>off</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='maximum' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='maximumMigratable'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>on</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>off</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='host-model' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <vendor>Intel</vendor>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ss'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='vmx'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='pcid'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='hypervisor'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='arat'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='umip'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='md-clear'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='stibp'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ssbd'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='invtsc'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ibpb'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='ibrs'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='amd-stibp'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='rsba'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='disable' name='erms'/>
Aug 15 00:27:50 user nova-compute[73010]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:     <mode name='custom' supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>qemu64</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>qemu32</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>phenom</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>pentium3</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>pentium2</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>pentium</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>n270</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>kvm64</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>kvm32</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>coreduo</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>core2duo</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>athlon</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Westmere</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Snowridge</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Server</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Skylake-Client</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>SandyBridge</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Penryn</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G5</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G4</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G3</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Opteron_G2</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Opteron_G1</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Nehalem</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>IvyBridge</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Icelake-Server</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Haswell</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC-Rome</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC-Milan</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>EPYC</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Dhyana</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Cooperlake</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>Conroe</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='no'>Broadwell</model>
Aug 15 00:27:50 user nova-compute[73010]:       <model usable='yes'>486</model>
Aug 15 00:27:50 user nova-compute[73010]:     </mode>
Aug 15 00:27:50 user nova-compute[73010]:   </cpu>
Aug 15 00:27:50 user nova-compute[73010]:   <memoryBacking supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:     <enum name='sourceType'>
Aug 15 00:27:50 user nova-compute[73010]:       <value>file</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>anonymous</value>
Aug 15 00:27:50 user nova-compute[73010]:       <value>memfd</value>
Aug 15 00:27:50 user nova-compute[73010]:     </enum>
Aug 15 00:27:50 user nova-compute[73010]:   </memoryBacking>
Aug 15 00:27:50 user nova-compute[73010]:   <devices>
Aug 15 00:27:50 user nova-compute[73010]:     <disk supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='diskDevice'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>disk</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>cdrom</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>floppy</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>lun</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='bus'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>fdc</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>scsi</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>usb</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>sata</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='model'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-non-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </disk>
Aug 15 00:27:50 user nova-compute[73010]:     <graphics supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='type'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>sdl</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>vnc</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>spice</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>egl-headless</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </graphics>
Aug 15 00:27:50 user nova-compute[73010]:     <video supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='modelType'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>vga</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>cirrus</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>vmvga</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>qxl</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>none</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>bochs</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>ramfb</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </video>
Aug 15 00:27:50 user nova-compute[73010]:     <hostdev supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='mode'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>subsystem</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='startupPolicy'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>default</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>mandatory</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>requisite</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>optional</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='subsysType'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>usb</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>pci</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>scsi</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='capsType'/>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='pciBackend'/>
Aug 15 00:27:50 user nova-compute[73010]:     </hostdev>
Aug 15 00:27:50 user nova-compute[73010]:     <rng supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='model'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtio-non-transitional</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='backendModel'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>random</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>egd</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>builtin</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </rng>
Aug 15 00:27:50 user nova-compute[73010]:     <filesystem supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='driverType'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>path</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>handle</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>virtiofs</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </filesystem>
Aug 15 00:27:50 user nova-compute[73010]:     <tpm supported='yes'>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='model'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>tpm-tis</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>tpm-crb</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:       <enum name='backendModel'>
Aug 15 00:27:50 user nova-compute[73010]:         <value>passthrough</value>
Aug 15 00:27:50 user nova-compute[73010]:         <value>emulator</value>
Aug 15 00:27:50 user nova-compute[73010]:       </enum>
Aug 15 00:27:50 user nova-compute[73010]:     </tpm>
Aug 15 00:27:50 user nova-compute[73010]:   </devices>
Aug 15 00:27:50 user nova-compute[73010]:   <features>
Aug 15 00:27:50 user nova-compute[73010]:     <gic supported='no'/>
Aug 15 00:27:50 user nova-compute[73010]:     <vmcoreinfo supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <genid supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <backingStoreInput supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <backup supported='yes'/>
Aug 15 00:27:50 user nova-compute[73010]:     <sev supported='no'/>
Aug 15 00:27:50 user nova-compute[73010]:   </features>
Aug 15 00:27:50 user nova-compute[73010]: </domainCapabilities>
Aug 15 00:27:50 user nova-compute[73010]:  {{(pid=73010) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73010) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73010) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Checking secure boot support for host arch (x86_64) {{(pid=73010) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 00:27:50 user nova-compute[73010]: INFO nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Secure Boot support detected
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] cpu compare xml: <cpu match="exact">
Aug 15 00:27:50 user nova-compute[73010]:   <model>Nehalem</model>
Aug 15 00:27:50 user nova-compute[73010]: </cpu>
Aug 15 00:27:50 user nova-compute[73010]:  {{(pid=73010) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 15 00:27:50 user nova-compute[73010]: INFO nova.virt.node [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Generated node identity 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e
Aug 15 00:27:50 user nova-compute[73010]: INFO nova.virt.node [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Wrote node identity 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e to /opt/stack/data/nova/compute_id
Aug 15 00:27:50 user nova-compute[73010]: WARNING nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Compute nodes ['76a450bc-e3b1-48a7-9fac-9bdbe0890d8e'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 15 00:27:50 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 15 00:27:50 user nova-compute[73010]: WARNING nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 15 00:27:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:27:50 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:27:50 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Hypervisor/Node resource view: name=user free_ram=10929MB free_disk=26.479206085205078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:27:50 user nova-compute[73010]: WARNING nova.compute.resource_tracker [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] No compute node record for user:76a450bc-e3b1-48a7-9fac-9bdbe0890d8e: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e could not be found.
Aug 15 00:27:50 user nova-compute[73010]: INFO nova.compute.resource_tracker [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Compute node record created for user:user with uuid: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:27:50 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:27:51 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [req-3aa0f4c1-0cb3-42c2-b793-f4ca273cf656] Created resource provider record via placement API for resource provider with UUID 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e and name user.
Aug 15 00:27:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73010) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 15 00:27:51 user nova-compute[73010]: INFO nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] kernel doesn't support AMD SEV
Aug 15 00:27:51 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Updating inventory in ProviderTree for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 00:27:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:27:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Libvirt baseline CPU <cpu>
Aug 15 00:27:51 user nova-compute[73010]:   <arch>x86_64</arch>
Aug 15 00:27:51 user nova-compute[73010]:   <model>Nehalem</model>
Aug 15 00:27:51 user nova-compute[73010]:   <vendor>Intel</vendor>
Aug 15 00:27:51 user nova-compute[73010]:   <topology sockets="6" cores="1" threads="1"/>
Aug 15 00:27:51 user nova-compute[73010]: </cpu>
Aug 15 00:27:51 user nova-compute[73010]:  {{(pid=73010) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 15 00:27:51 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Updated inventory for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 15 00:27:51 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Updating resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e generation from 0 to 1 during operation: update_inventory {{(pid=73010) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 15 00:27:51 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Updating inventory in ProviderTree for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 00:27:51 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Updating resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e generation from 1 to 2 during operation: update_traits {{(pid=73010) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 15 00:27:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:27:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.619s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:27:51 user nova-compute[73010]: DEBUG nova.service [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Creating RPC server for service compute {{(pid=73010) start /opt/stack/nova/nova/service.py:182}}
Aug 15 00:27:51 user nova-compute[73010]: DEBUG nova.service [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Join ServiceGroup membership for this service compute {{(pid=73010) start /opt/stack/nova/nova/service.py:199}}
Aug 15 00:27:51 user nova-compute[73010]: DEBUG nova.servicegroup.drivers.db [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73010) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 15 00:28:00 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_power_states {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:28:00 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Didn't find any instances for network info cache update. {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:28:42 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:28:42 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:28:42 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=10302MB free_disk=26.38292694091797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:28:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:29:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:29:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:29:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:29:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:29:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 00:29:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Didn't find any instances for network info cache update. {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 00:29:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:29:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:29:43 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:29:43 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:29:43 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:29:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:29:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:29:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:29:43 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:29:43 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:29:43 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:29:43 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=10244MB free_disk=26.428970336914062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:29:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:29:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:29:43 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:29:43 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:29:43 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:29:43 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:29:43 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:29:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.096s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:29:44 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:29:44 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:29:44 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:30:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:30:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:30:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 00:30:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Didn't find any instances for network info cache update. {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 00:30:43 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:30:43 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:30:43 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:30:43 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:30:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:30:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:30:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:30:43 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:30:43 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:30:43 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:30:43 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=10219MB free_disk=26.213245391845703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:30:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:30:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:30:43 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:30:43 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:30:43 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:30:43 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:30:43 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:30:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.100s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:30:44 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:30:44 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:30:45 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:30:45 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:30:46 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:31:43 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:31:43 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:31:43 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:31:43 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 00:31:43 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Didn't find any instances for network info cache update. {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 00:31:43 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:31:44 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:31:44 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:31:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:31:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:31:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:31:44 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:31:44 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:31:44 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:31:44 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=9522MB free_disk=26.236160278320312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:31:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:31:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:31:45 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:31:45 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:31:45 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:31:45 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:31:45 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:31:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.373s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:31:46 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:31:46 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:31:46 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:31:47 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:31:47 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:31:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:32:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Acquiring lock "1ba131ea-c646-4719-b85a-5fc021555fcc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "1ba131ea-c646-4719-b85a-5fc021555fcc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:32:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:01 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:32:01 user nova-compute[73010]: INFO nova.compute.claims [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Claim successful on node user
Aug 15 00:32:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "983577b5-4abb-4280-b8e8-a63f42d8f796" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:32:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:01 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:32:01 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:32:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:32:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.140s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:01 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:32:01 user nova-compute[73010]: INFO nova.compute.claims [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Claim successful on node user
Aug 15 00:32:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:32:01 user nova-compute[73010]: DEBUG nova.network.neutron [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:32:01 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:32:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:32:01 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:32:01 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:32:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:32:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:32:01 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Creating image(s)
Aug 15 00:32:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ba131ea-c646-4719-b85a-5fc021555fcc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "/opt/stack/data/nova/instances/1ba131ea-c646-4719-b85a-5fc021555fcc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "/opt/stack/data/nova/instances/1ba131ea-c646-4719-b85a-5fc021555fcc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.314s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36.part --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG nova.network.neutron [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:32:02 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:32:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36.part --force-share --output=json" returned: 0 in 0.178s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG nova.virt.images [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] 6c3513d3-9ca6-46bf-ad11-90f2f27f3126 was qcow2, converting to raw {{(pid=73010) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG nova.privsep.utils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73010) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36.part /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36.converted {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG nova.policy [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '235b32ee84cb49f88e560ea34f659ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4613c3de3a28481ab5528489a43216aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG nova.policy [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5e4be2f71154849a225adb0628fa70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1588cfc0b04643a881de076bea2e23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:32:02 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Creating image(s)
Aug 15 00:32:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "/opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "/opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "/opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36.part /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36.converted" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36.converted --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:32:02 user nova-compute[73010]: INFO nova.compute.claims [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Claim successful on node user
Aug 15 00:32:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.088s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:02 user nova-compute[73010]: INFO oslo.privsep.daemon [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpoi_s2u3i/privsep.sock']
Aug 15 00:32:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.310s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:02 user sudo[82345]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpoi_s2u3i/privsep.sock
Aug 15 00:32:02 user sudo[82345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 00:32:02 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:32:02 user nova-compute[73010]: DEBUG nova.network.neutron [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:32:03 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:32:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:32:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:32:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:32:03 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Creating image(s)
Aug 15 00:32:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "/opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "/opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "/opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:03 user nova-compute[73010]: DEBUG nova.policy [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53c8150819854d29b1d8c865da2642ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50aaf528c8c4d4ba8d39b3b203b5a52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:32:04 user sudo[82345]: pam_unix(sudo:session): session closed for user root
Aug 15 00:32:04 user nova-compute[73010]: INFO oslo.privsep.daemon [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Spawned new privsep daemon via rootwrap
Aug 15 00:32:04 user nova-compute[73010]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 00:32:04 user nova-compute[73010]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 00:32:04 user nova-compute[73010]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 15 00:32:04 user nova-compute[73010]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82353
Aug 15 00:32:04 user nova-compute[73010]: WARNING oslo_privsep.priv_context [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] privsep daemon already running
Aug 15 00:32:04 user nova-compute[73010]: WARNING oslo_privsep.priv_context [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] privsep daemon already running
Aug 15 00:32:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.180s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.221s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.194s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.213s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/1ba131ea-c646-4719-b85a-5fc021555fcc/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/1ba131ea-c646-4719-b85a-5fc021555fcc/disk 1073741824" returned: 0 in 0.046s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.236s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG nova.network.neutron [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Successfully created port: ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG nova.network.neutron [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Successfully created port: 692b6d7e-a3c6-4330-9e76-851a1501950c {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.172s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ba131ea-c646-4719-b85a-5fc021555fcc/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba131ea-c646-4719-b85a-5fc021555fcc/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.263s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk 1073741824" returned: 0 in 0.053s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.322s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.594s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba131ea-c646-4719-b85a-5fc021555fcc/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Cannot resize image /opt/stack/data/nova/instances/1ba131ea-c646-4719-b85a-5fc021555fcc/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG nova.objects.instance [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lazy-loading 'migration_context' on Instance uuid 1ba131ea-c646-4719-b85a-5fc021555fcc {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Ensure instance console log exists: /opt/stack/data/nova/instances/1ba131ea-c646-4719-b85a-5fc021555fcc/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.261s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Checking if we can resize image /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.259s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk 1073741824" returned: 0 in 0.072s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.338s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:06 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Cannot resize image /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:32:06 user nova-compute[73010]: DEBUG nova.objects.instance [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lazy-loading 'migration_context' on Instance uuid 983577b5-4abb-4280-b8e8-a63f42d8f796 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:32:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:32:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Ensure instance console log exists: /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:32:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.253s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:06 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Checking if we can resize image /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:32:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:06 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Cannot resize image /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:32:06 user nova-compute[73010]: DEBUG nova.objects.instance [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'migration_context' on Instance uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:32:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:32:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Ensure instance console log exists: /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:32:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:06 user nova-compute[73010]: DEBUG nova.network.neutron [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Successfully created port: 2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:32:08 user nova-compute[73010]: DEBUG nova.network.neutron [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Successfully updated port: ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:32:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:32:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquired lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:32:08 user nova-compute[73010]: DEBUG nova.network.neutron [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:32:09 user nova-compute[73010]: DEBUG nova.network.neutron [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:32:09 user nova-compute[73010]: DEBUG nova.compute.manager [req-4778f9d6-fce9-43ff-84ae-551cce1b9544 req-1a9e7f9b-4557-45a3-a0b1-450f8e96e302 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received event network-changed-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:32:09 user nova-compute[73010]: DEBUG nova.compute.manager [req-4778f9d6-fce9-43ff-84ae-551cce1b9544 req-1a9e7f9b-4557-45a3-a0b1-450f8e96e302 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Refreshing instance network info cache due to event network-changed-ba4444c9-ca0d-4265-a567-f931f42b3115. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:32:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4778f9d6-fce9-43ff-84ae-551cce1b9544 req-1a9e7f9b-4557-45a3-a0b1-450f8e96e302 service nova] Acquiring lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:32:09 user nova-compute[73010]: DEBUG nova.network.neutron [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Successfully updated port: 692b6d7e-a3c6-4330-9e76-851a1501950c {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:32:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Acquiring lock "refresh_cache-1ba131ea-c646-4719-b85a-5fc021555fcc" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:32:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Acquired lock "refresh_cache-1ba131ea-c646-4719-b85a-5fc021555fcc" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:32:09 user nova-compute[73010]: DEBUG nova.network.neutron [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.network.neutron [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.compute.manager [req-c3b7854f-812d-4670-9f8c-5e228cdbd534 req-cc7372c0-b67e-49b1-a30e-cdfc327d93d4 service nova] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Received event network-changed-692b6d7e-a3c6-4330-9e76-851a1501950c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.compute.manager [req-c3b7854f-812d-4670-9f8c-5e228cdbd534 req-cc7372c0-b67e-49b1-a30e-cdfc327d93d4 service nova] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Refreshing instance network info cache due to event network-changed-692b6d7e-a3c6-4330-9e76-851a1501950c. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c3b7854f-812d-4670-9f8c-5e228cdbd534 req-cc7372c0-b67e-49b1-a30e-cdfc327d93d4 service nova] Acquiring lock "refresh_cache-1ba131ea-c646-4719-b85a-5fc021555fcc" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.network.neutron [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Updating instance_info_cache with network_info: [{"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Releasing lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Instance network_info: |[{"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4778f9d6-fce9-43ff-84ae-551cce1b9544 req-1a9e7f9b-4557-45a3-a0b1-450f8e96e302 service nova] Acquired lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.network.neutron [req-4778f9d6-fce9-43ff-84ae-551cce1b9544 req-1a9e7f9b-4557-45a3-a0b1-450f8e96e302 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Refreshing network info cache for port ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Start _get_guest_xml network_info=[{"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:32:10 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:32:10 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.privsep.utils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73010) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1216295700',display_name='tempest-ServerActionsTestOtherB-server-1216295700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1216295700',id=2,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVoikkIiX9fqlWUgAuNi/64W1pPax2fim7TT4ZilB7kZJFBTddrjL8mZ+9EedRXSwMMm3xZIb3UP53hHNu173Z0/TxgKI44bIEdZkISEoJSalzaVJQjVXA5W+j4ISJAVA==',key_name='tempest-keypair-1664333158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1588cfc0b04643a881de076bea2e23b5',ramdisk_id='',reservation_id='r-t3ok78f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-594907864',owner_user_name='tempest-ServerActionsTestOtherB-594907864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:32:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5e4be2f71154849a225adb0628fa70e',uuid=983577b5-4abb-4280-b8e8-a63f42d8f796,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Converting VIF {"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:64:22,bridge_name='br-int',has_traffic_filtering=True,id=ba4444c9-ca0d-4265-a567-f931f42b3115,network=Network(25ddd6d0-e3f6-4a35-b15f-a41da18091ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4444c9-ca') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.objects.instance [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lazy-loading 'pci_devices' on Instance uuid 983577b5-4abb-4280-b8e8-a63f42d8f796 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:32:10 user nova-compute[73010]:   <uuid>983577b5-4abb-4280-b8e8-a63f42d8f796</uuid>
Aug 15 00:32:10 user nova-compute[73010]:   <name>instance-00000002</name>
Aug 15 00:32:10 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:32:10 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:32:10 user nova-compute[73010]:   <metadata>
Aug 15 00:32:10 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:32:10 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:32:10 user nova-compute[73010]:       <nova:name>tempest-ServerActionsTestOtherB-server-1216295700</nova:name>
Aug 15 00:32:10 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:32:10</nova:creationTime>
Aug 15 00:32:10 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:32:10 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:32:10 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:32:10 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:32:10 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:32:10 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:32:10 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:32:10 user nova-compute[73010]:       <nova:owner>
Aug 15 00:32:10 user nova-compute[73010]:         <nova:user uuid="a5e4be2f71154849a225adb0628fa70e">tempest-ServerActionsTestOtherB-594907864-project-member</nova:user>
Aug 15 00:32:10 user nova-compute[73010]:         <nova:project uuid="1588cfc0b04643a881de076bea2e23b5">tempest-ServerActionsTestOtherB-594907864</nova:project>
Aug 15 00:32:10 user nova-compute[73010]:       </nova:owner>
Aug 15 00:32:10 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:32:10 user nova-compute[73010]:       <nova:ports>
Aug 15 00:32:10 user nova-compute[73010]:         <nova:port uuid="ba4444c9-ca0d-4265-a567-f931f42b3115">
Aug 15 00:32:10 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 00:32:10 user nova-compute[73010]:         </nova:port>
Aug 15 00:32:10 user nova-compute[73010]:       </nova:ports>
Aug 15 00:32:10 user nova-compute[73010]:     </nova:instance>
Aug 15 00:32:10 user nova-compute[73010]:   </metadata>
Aug 15 00:32:10 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:32:10 user nova-compute[73010]:     <system>
Aug 15 00:32:10 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:32:10 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:32:10 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:32:10 user nova-compute[73010]:       <entry name="serial">983577b5-4abb-4280-b8e8-a63f42d8f796</entry>
Aug 15 00:32:10 user nova-compute[73010]:       <entry name="uuid">983577b5-4abb-4280-b8e8-a63f42d8f796</entry>
Aug 15 00:32:10 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:32:10 user nova-compute[73010]:     </system>
Aug 15 00:32:10 user nova-compute[73010]:   </sysinfo>
Aug 15 00:32:10 user nova-compute[73010]:   <os>
Aug 15 00:32:10 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:32:10 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:32:10 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:32:10 user nova-compute[73010]:   </os>
Aug 15 00:32:10 user nova-compute[73010]:   <features>
Aug 15 00:32:10 user nova-compute[73010]:     <acpi/>
Aug 15 00:32:10 user nova-compute[73010]:     <apic/>
Aug 15 00:32:10 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:32:10 user nova-compute[73010]:   </features>
Aug 15 00:32:10 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:32:10 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:32:10 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:32:10 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:32:10 user nova-compute[73010]:   </clock>
Aug 15 00:32:10 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:32:10 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:32:10 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:32:10 user nova-compute[73010]:   </cpu>
Aug 15 00:32:10 user nova-compute[73010]:   <devices>
Aug 15 00:32:10 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:32:10 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:32:10 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk"/>
Aug 15 00:32:10 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:32:10 user nova-compute[73010]:     </disk>
Aug 15 00:32:10 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:32:10 user nova-compute[73010]:       <mac address="fa:16:3e:b9:64:22"/>
Aug 15 00:32:10 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:32:10 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:32:10 user nova-compute[73010]:       <target dev="tapba4444c9-ca"/>
Aug 15 00:32:10 user nova-compute[73010]:     </interface>
Aug 15 00:32:10 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:32:10 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/console.log" append="off"/>
Aug 15 00:32:10 user nova-compute[73010]:     </serial>
Aug 15 00:32:10 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:32:10 user nova-compute[73010]:     <video>
Aug 15 00:32:10 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:32:10 user nova-compute[73010]:     </video>
Aug 15 00:32:10 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:32:10 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:32:10 user nova-compute[73010]:     </rng>
Aug 15 00:32:10 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:32:10 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:32:10 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:32:10 user nova-compute[73010]:     </memballoon>
Aug 15 00:32:10 user nova-compute[73010]:   </devices>
Aug 15 00:32:10 user nova-compute[73010]: </domain>
Aug 15 00:32:10 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1216295700',display_name='tempest-ServerActionsTestOtherB-server-1216295700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1216295700',id=2,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVoikkIiX9fqlWUgAuNi/64W1pPax2fim7TT4ZilB7kZJFBTddrjL8mZ+9EedRXSwMMm3xZIb3UP53hHNu173Z0/TxgKI44bIEdZkISEoJSalzaVJQjVXA5W+j4ISJAVA==',key_name='tempest-keypair-1664333158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1588cfc0b04643a881de076bea2e23b5',ramdisk_id='',reservation_id='r-t3ok78f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-594907864',owner_user_name='tempest-ServerActionsTestOtherB-594907864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:32:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5e4be2f71154849a225adb0628fa70e',uuid=983577b5-4abb-4280-b8e8-a63f42d8f796,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Converting VIF {"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:64:22,bridge_name='br-int',has_traffic_filtering=True,id=ba4444c9-ca0d-4265-a567-f931f42b3115,network=Network(25ddd6d0-e3f6-4a35-b15f-a41da18091ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4444c9-ca') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG os_vif [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:64:22,bridge_name='br-int',has_traffic_filtering=True,id=ba4444c9-ca0d-4265-a567-f931f42b3115,network=Network(25ddd6d0-e3f6-4a35-b15f-a41da18091ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4444c9-ca') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Created schema index Interface.name {{(pid=73010) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Created schema index Port.name {{(pid=73010) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Created schema index Bridge.name {{(pid=73010) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [POLLOUT] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:32:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:32:10 user nova-compute[73010]: INFO oslo.privsep.daemon [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpcubm3jys/privsep.sock']
Aug 15 00:32:10 user sudo[82407]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpcubm3jys/privsep.sock
Aug 15 00:32:10 user sudo[82407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 00:32:10 user nova-compute[73010]: DEBUG nova.network.neutron [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Successfully updated port: 2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "refresh_cache-afcd0a05-e035-492e-9fbe-cd63f4c3ea42" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquired lock "refresh_cache-afcd0a05-e035-492e-9fbe-cd63f4c3ea42" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.network.neutron [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.network.neutron [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.network.neutron [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Updating instance_info_cache with network_info: [{"id": "692b6d7e-a3c6-4330-9e76-851a1501950c", "address": "fa:16:3e:07:4d:fc", "network": {"id": "1ea47cb1-fc85-491d-95a7-927606f5e3d4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-620603594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4613c3de3a28481ab5528489a43216aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap692b6d7e-a3", "ovs_interfaceid": "692b6d7e-a3c6-4330-9e76-851a1501950c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Releasing lock "refresh_cache-1ba131ea-c646-4719-b85a-5fc021555fcc" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.compute.manager [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Instance network_info: |[{"id": "692b6d7e-a3c6-4330-9e76-851a1501950c", "address": "fa:16:3e:07:4d:fc", "network": {"id": "1ea47cb1-fc85-491d-95a7-927606f5e3d4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-620603594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4613c3de3a28481ab5528489a43216aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap692b6d7e-a3", "ovs_interfaceid": "692b6d7e-a3c6-4330-9e76-851a1501950c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c3b7854f-812d-4670-9f8c-5e228cdbd534 req-cc7372c0-b67e-49b1-a30e-cdfc327d93d4 service nova] Acquired lock "refresh_cache-1ba131ea-c646-4719-b85a-5fc021555fcc" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.network.neutron [req-c3b7854f-812d-4670-9f8c-5e228cdbd534 req-cc7372c0-b67e-49b1-a30e-cdfc327d93d4 service nova] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Refreshing network info cache for port 692b6d7e-a3c6-4330-9e76-851a1501950c {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Start _get_guest_xml network_info=[{"id": "692b6d7e-a3c6-4330-9e76-851a1501950c", "address": "fa:16:3e:07:4d:fc", "network": {"id": "1ea47cb1-fc85-491d-95a7-927606f5e3d4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-620603594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4613c3de3a28481ab5528489a43216aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap692b6d7e-a3", "ovs_interfaceid": "692b6d7e-a3c6-4330-9e76-851a1501950c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.network.neutron [req-4778f9d6-fce9-43ff-84ae-551cce1b9544 req-1a9e7f9b-4557-45a3-a0b1-450f8e96e302 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Updated VIF entry in instance network info cache for port ba4444c9-ca0d-4265-a567-f931f42b3115. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.network.neutron [req-4778f9d6-fce9-43ff-84ae-551cce1b9544 req-1a9e7f9b-4557-45a3-a0b1-450f8e96e302 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Updating instance_info_cache with network_info: [{"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:32:11 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:32:11 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4778f9d6-fce9-43ff-84ae-551cce1b9544 req-1a9e7f9b-4557-45a3-a0b1-450f8e96e302 service nova] Releasing lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1210883711',display_name='tempest-DeleteServersTestJSON-server-1210883711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1210883711',id=1,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4613c3de3a28481ab5528489a43216aa',ramdisk_id='',reservation_id='r-9zt6xu6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1412161916',owner_user_name='tempest-DeleteServersTestJSON-1412161916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:32:02Z,user_data=None,user_id='235b32ee84cb49f88e560ea34f659ad5',uuid=1ba131ea-c646-4719-b85a-5fc021555fcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "692b6d7e-a3c6-4330-9e76-851a1501950c", "address": "fa:16:3e:07:4d:fc", "network": {"id": "1ea47cb1-fc85-491d-95a7-927606f5e3d4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-620603594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4613c3de3a28481ab5528489a43216aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap692b6d7e-a3", "ovs_interfaceid": "692b6d7e-a3c6-4330-9e76-851a1501950c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Converting VIF {"id": "692b6d7e-a3c6-4330-9e76-851a1501950c", "address": "fa:16:3e:07:4d:fc", "network": {"id": "1ea47cb1-fc85-491d-95a7-927606f5e3d4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-620603594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4613c3de3a28481ab5528489a43216aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap692b6d7e-a3", "ovs_interfaceid": "692b6d7e-a3c6-4330-9e76-851a1501950c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:4d:fc,bridge_name='br-int',has_traffic_filtering=True,id=692b6d7e-a3c6-4330-9e76-851a1501950c,network=Network(1ea47cb1-fc85-491d-95a7-927606f5e3d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap692b6d7e-a3') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.objects.instance [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ba131ea-c646-4719-b85a-5fc021555fcc {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:32:11 user nova-compute[73010]:   <uuid>1ba131ea-c646-4719-b85a-5fc021555fcc</uuid>
Aug 15 00:32:11 user nova-compute[73010]:   <name>instance-00000001</name>
Aug 15 00:32:11 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:32:11 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:32:11 user nova-compute[73010]:   <metadata>
Aug 15 00:32:11 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:32:11 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:32:11 user nova-compute[73010]:       <nova:name>tempest-DeleteServersTestJSON-server-1210883711</nova:name>
Aug 15 00:32:11 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:32:11</nova:creationTime>
Aug 15 00:32:11 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:32:11 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:32:11 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:32:11 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:32:11 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:32:11 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:32:11 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:32:11 user nova-compute[73010]:       <nova:owner>
Aug 15 00:32:11 user nova-compute[73010]:         <nova:user uuid="235b32ee84cb49f88e560ea34f659ad5">tempest-DeleteServersTestJSON-1412161916-project-member</nova:user>
Aug 15 00:32:11 user nova-compute[73010]:         <nova:project uuid="4613c3de3a28481ab5528489a43216aa">tempest-DeleteServersTestJSON-1412161916</nova:project>
Aug 15 00:32:11 user nova-compute[73010]:       </nova:owner>
Aug 15 00:32:11 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:32:11 user nova-compute[73010]:       <nova:ports>
Aug 15 00:32:11 user nova-compute[73010]:         <nova:port uuid="692b6d7e-a3c6-4330-9e76-851a1501950c">
Aug 15 00:32:11 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 00:32:11 user nova-compute[73010]:         </nova:port>
Aug 15 00:32:11 user nova-compute[73010]:       </nova:ports>
Aug 15 00:32:11 user nova-compute[73010]:     </nova:instance>
Aug 15 00:32:11 user nova-compute[73010]:   </metadata>
Aug 15 00:32:11 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:32:11 user nova-compute[73010]:     <system>
Aug 15 00:32:11 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:32:11 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:32:11 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:32:11 user nova-compute[73010]:       <entry name="serial">1ba131ea-c646-4719-b85a-5fc021555fcc</entry>
Aug 15 00:32:11 user nova-compute[73010]:       <entry name="uuid">1ba131ea-c646-4719-b85a-5fc021555fcc</entry>
Aug 15 00:32:11 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:32:11 user nova-compute[73010]:     </system>
Aug 15 00:32:11 user nova-compute[73010]:   </sysinfo>
Aug 15 00:32:11 user nova-compute[73010]:   <os>
Aug 15 00:32:11 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:32:11 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:32:11 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:32:11 user nova-compute[73010]:   </os>
Aug 15 00:32:11 user nova-compute[73010]:   <features>
Aug 15 00:32:11 user nova-compute[73010]:     <acpi/>
Aug 15 00:32:11 user nova-compute[73010]:     <apic/>
Aug 15 00:32:11 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:32:11 user nova-compute[73010]:   </features>
Aug 15 00:32:11 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:32:11 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:32:11 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:32:11 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:32:11 user nova-compute[73010]:   </clock>
Aug 15 00:32:11 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:32:11 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:32:11 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:32:11 user nova-compute[73010]:   </cpu>
Aug 15 00:32:11 user nova-compute[73010]:   <devices>
Aug 15 00:32:11 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:32:11 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:32:11 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/1ba131ea-c646-4719-b85a-5fc021555fcc/disk"/>
Aug 15 00:32:11 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:32:11 user nova-compute[73010]:     </disk>
Aug 15 00:32:11 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:32:11 user nova-compute[73010]:       <mac address="fa:16:3e:07:4d:fc"/>
Aug 15 00:32:11 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:32:11 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:32:11 user nova-compute[73010]:       <target dev="tap692b6d7e-a3"/>
Aug 15 00:32:11 user nova-compute[73010]:     </interface>
Aug 15 00:32:11 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:32:11 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/1ba131ea-c646-4719-b85a-5fc021555fcc/console.log" append="off"/>
Aug 15 00:32:11 user nova-compute[73010]:     </serial>
Aug 15 00:32:11 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:32:11 user nova-compute[73010]:     <video>
Aug 15 00:32:11 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:32:11 user nova-compute[73010]:     </video>
Aug 15 00:32:11 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:32:11 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:32:11 user nova-compute[73010]:     </rng>
Aug 15 00:32:11 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:32:11 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:32:11 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:32:11 user nova-compute[73010]:     </memballoon>
Aug 15 00:32:11 user nova-compute[73010]:   </devices>
Aug 15 00:32:11 user nova-compute[73010]: </domain>
Aug 15 00:32:11 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1210883711',display_name='tempest-DeleteServersTestJSON-server-1210883711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1210883711',id=1,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4613c3de3a28481ab5528489a43216aa',ramdisk_id='',reservation_id='r-9zt6xu6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1412161916',owner_user_name='tempest-DeleteServersTestJSON-1412161916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:32:02Z,user_data=None,user_id='235b32ee84cb49f88e560ea34f659ad5',uuid=1ba131ea-c646-4719-b85a-5fc021555fcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "692b6d7e-a3c6-4330-9e76-851a1501950c", "address": "fa:16:3e:07:4d:fc", "network": {"id": "1ea47cb1-fc85-491d-95a7-927606f5e3d4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-620603594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4613c3de3a28481ab5528489a43216aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap692b6d7e-a3", "ovs_interfaceid": "692b6d7e-a3c6-4330-9e76-851a1501950c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Converting VIF {"id": "692b6d7e-a3c6-4330-9e76-851a1501950c", "address": "fa:16:3e:07:4d:fc", "network": {"id": "1ea47cb1-fc85-491d-95a7-927606f5e3d4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-620603594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4613c3de3a28481ab5528489a43216aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap692b6d7e-a3", "ovs_interfaceid": "692b6d7e-a3c6-4330-9e76-851a1501950c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:4d:fc,bridge_name='br-int',has_traffic_filtering=True,id=692b6d7e-a3c6-4330-9e76-851a1501950c,network=Network(1ea47cb1-fc85-491d-95a7-927606f5e3d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap692b6d7e-a3') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG os_vif [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:4d:fc,bridge_name='br-int',has_traffic_filtering=True,id=692b6d7e-a3c6-4330-9e76-851a1501950c,network=Network(1ea47cb1-fc85-491d-95a7-927606f5e3d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap692b6d7e-a3') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:32:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.network.neutron [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Updating instance_info_cache with network_info: [{"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Releasing lock "refresh_cache-afcd0a05-e035-492e-9fbe-cd63f4c3ea42" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.compute.manager [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Instance network_info: |[{"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Start _get_guest_xml network_info=[{"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:32:12 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:32:12 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1899570606',display_name='tempest-AttachVolumeTestJSON-server-1899570606',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1899570606',id=3,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMV9Ia1g6S1Dqv5u52uv7YpM19NUmr26Hj+tCSO6tG0aZL4zk5VCqdKIe6IWKX3KiHIXyqR1c1NApawOfSvd8OOhU+aA7fYaPBkxC185NYPaDo0+I9Vsdwf99lfNe8lrhw==',key_name='tempest-keypair-1489578241',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50aaf528c8c4d4ba8d39b3b203b5a52',ramdisk_id='',reservation_id='r-abzuan7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-338922600',owner_user_name='tempest-AttachVolumeTestJSON-338922600-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:32:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53c8150819854d29b1d8c865da2642ca',uuid=afcd0a05-e035-492e-9fbe-cd63f4c3ea42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Converting VIF {"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:68:0b,bridge_name='br-int',has_traffic_filtering=True,id=2f2b345b-67b5-4d95-bbd3-3fe48aafaee5,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b345b-67') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.objects.instance [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'pci_devices' on Instance uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:32:12 user nova-compute[73010]:   <uuid>afcd0a05-e035-492e-9fbe-cd63f4c3ea42</uuid>
Aug 15 00:32:12 user nova-compute[73010]:   <name>instance-00000003</name>
Aug 15 00:32:12 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:32:12 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:32:12 user nova-compute[73010]:   <metadata>
Aug 15 00:32:12 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:32:12 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:32:12 user nova-compute[73010]:       <nova:name>tempest-AttachVolumeTestJSON-server-1899570606</nova:name>
Aug 15 00:32:12 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:32:12</nova:creationTime>
Aug 15 00:32:12 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:32:12 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:32:12 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:32:12 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:32:12 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:32:12 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:32:12 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:32:12 user nova-compute[73010]:       <nova:owner>
Aug 15 00:32:12 user nova-compute[73010]:         <nova:user uuid="53c8150819854d29b1d8c865da2642ca">tempest-AttachVolumeTestJSON-338922600-project-member</nova:user>
Aug 15 00:32:12 user nova-compute[73010]:         <nova:project uuid="e50aaf528c8c4d4ba8d39b3b203b5a52">tempest-AttachVolumeTestJSON-338922600</nova:project>
Aug 15 00:32:12 user nova-compute[73010]:       </nova:owner>
Aug 15 00:32:12 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:32:12 user nova-compute[73010]:       <nova:ports>
Aug 15 00:32:12 user nova-compute[73010]:         <nova:port uuid="2f2b345b-67b5-4d95-bbd3-3fe48aafaee5">
Aug 15 00:32:12 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 00:32:12 user nova-compute[73010]:         </nova:port>
Aug 15 00:32:12 user nova-compute[73010]:       </nova:ports>
Aug 15 00:32:12 user nova-compute[73010]:     </nova:instance>
Aug 15 00:32:12 user nova-compute[73010]:   </metadata>
Aug 15 00:32:12 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:32:12 user nova-compute[73010]:     <system>
Aug 15 00:32:12 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:32:12 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:32:12 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:32:12 user nova-compute[73010]:       <entry name="serial">afcd0a05-e035-492e-9fbe-cd63f4c3ea42</entry>
Aug 15 00:32:12 user nova-compute[73010]:       <entry name="uuid">afcd0a05-e035-492e-9fbe-cd63f4c3ea42</entry>
Aug 15 00:32:12 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:32:12 user nova-compute[73010]:     </system>
Aug 15 00:32:12 user nova-compute[73010]:   </sysinfo>
Aug 15 00:32:12 user nova-compute[73010]:   <os>
Aug 15 00:32:12 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:32:12 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:32:12 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:32:12 user nova-compute[73010]:   </os>
Aug 15 00:32:12 user nova-compute[73010]:   <features>
Aug 15 00:32:12 user nova-compute[73010]:     <acpi/>
Aug 15 00:32:12 user nova-compute[73010]:     <apic/>
Aug 15 00:32:12 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:32:12 user nova-compute[73010]:   </features>
Aug 15 00:32:12 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:32:12 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:32:12 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:32:12 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:32:12 user nova-compute[73010]:   </clock>
Aug 15 00:32:12 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:32:12 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:32:12 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:32:12 user nova-compute[73010]:   </cpu>
Aug 15 00:32:12 user nova-compute[73010]:   <devices>
Aug 15 00:32:12 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:32:12 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:32:12 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk"/>
Aug 15 00:32:12 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:32:12 user nova-compute[73010]:     </disk>
Aug 15 00:32:12 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:32:12 user nova-compute[73010]:       <mac address="fa:16:3e:7b:68:0b"/>
Aug 15 00:32:12 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:32:12 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:32:12 user nova-compute[73010]:       <target dev="tap2f2b345b-67"/>
Aug 15 00:32:12 user nova-compute[73010]:     </interface>
Aug 15 00:32:12 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:32:12 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/console.log" append="off"/>
Aug 15 00:32:12 user nova-compute[73010]:     </serial>
Aug 15 00:32:12 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:32:12 user nova-compute[73010]:     <video>
Aug 15 00:32:12 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:32:12 user nova-compute[73010]:     </video>
Aug 15 00:32:12 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:32:12 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:32:12 user nova-compute[73010]:     </rng>
Aug 15 00:32:12 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:32:12 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:32:12 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:32:12 user nova-compute[73010]:     </memballoon>
Aug 15 00:32:12 user nova-compute[73010]:   </devices>
Aug 15 00:32:12 user nova-compute[73010]: </domain>
Aug 15 00:32:12 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1899570606',display_name='tempest-AttachVolumeTestJSON-server-1899570606',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1899570606',id=3,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMV9Ia1g6S1Dqv5u52uv7YpM19NUmr26Hj+tCSO6tG0aZL4zk5VCqdKIe6IWKX3KiHIXyqR1c1NApawOfSvd8OOhU+aA7fYaPBkxC185NYPaDo0+I9Vsdwf99lfNe8lrhw==',key_name='tempest-keypair-1489578241',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50aaf528c8c4d4ba8d39b3b203b5a52',ramdisk_id='',reservation_id='r-abzuan7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-338922600',owner_user_name='tempest-AttachVolumeTestJSON-338922600-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:32:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53c8150819854d29b1d8c865da2642ca',uuid=afcd0a05-e035-492e-9fbe-cd63f4c3ea42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Converting VIF {"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:68:0b,bridge_name='br-int',has_traffic_filtering=True,id=2f2b345b-67b5-4d95-bbd3-3fe48aafaee5,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b345b-67') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG os_vif [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:68:0b,bridge_name='br-int',has_traffic_filtering=True,id=2f2b345b-67b5-4d95-bbd3-3fe48aafaee5,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b345b-67') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-74180dc9-97e0-44f5-96df-c5db9c833137 req-3d13f404-f055-4fb6-8b66-0702a72d3d5f service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received event network-changed-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-74180dc9-97e0-44f5-96df-c5db9c833137 req-3d13f404-f055-4fb6-8b66-0702a72d3d5f service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Refreshing instance network info cache due to event network-changed-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-74180dc9-97e0-44f5-96df-c5db9c833137 req-3d13f404-f055-4fb6-8b66-0702a72d3d5f service nova] Acquiring lock "refresh_cache-afcd0a05-e035-492e-9fbe-cd63f4c3ea42" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-74180dc9-97e0-44f5-96df-c5db9c833137 req-3d13f404-f055-4fb6-8b66-0702a72d3d5f service nova] Acquired lock "refresh_cache-afcd0a05-e035-492e-9fbe-cd63f4c3ea42" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:32:12 user nova-compute[73010]: DEBUG nova.network.neutron [req-74180dc9-97e0-44f5-96df-c5db9c833137 req-3d13f404-f055-4fb6-8b66-0702a72d3d5f service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Refreshing network info cache for port 2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:32:12 user sudo[82407]: pam_unix(sudo:session): session closed for user root
Aug 15 00:32:12 user nova-compute[73010]: INFO oslo.privsep.daemon [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Spawned new privsep daemon via rootwrap
Aug 15 00:32:12 user nova-compute[73010]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 00:32:12 user nova-compute[73010]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 00:32:12 user nova-compute[73010]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 15 00:32:12 user nova-compute[73010]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82412
Aug 15 00:32:12 user nova-compute[73010]: WARNING oslo_privsep.priv_context [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] privsep daemon already running
Aug 15 00:32:12 user nova-compute[73010]: WARNING oslo_privsep.priv_context [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] privsep daemon already running
Aug 15 00:32:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG nova.network.neutron [req-c3b7854f-812d-4670-9f8c-5e228cdbd534 req-cc7372c0-b67e-49b1-a30e-cdfc327d93d4 service nova] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Updated VIF entry in instance network info cache for port 692b6d7e-a3c6-4330-9e76-851a1501950c. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG nova.network.neutron [req-c3b7854f-812d-4670-9f8c-5e228cdbd534 req-cc7372c0-b67e-49b1-a30e-cdfc327d93d4 service nova] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Updating instance_info_cache with network_info: [{"id": "692b6d7e-a3c6-4330-9e76-851a1501950c", "address": "fa:16:3e:07:4d:fc", "network": {"id": "1ea47cb1-fc85-491d-95a7-927606f5e3d4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-620603594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4613c3de3a28481ab5528489a43216aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap692b6d7e-a3", "ovs_interfaceid": "692b6d7e-a3c6-4330-9e76-851a1501950c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c3b7854f-812d-4670-9f8c-5e228cdbd534 req-cc7372c0-b67e-49b1-a30e-cdfc327d93d4 service nova] Releasing lock "refresh_cache-1ba131ea-c646-4719-b85a-5fc021555fcc" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f2b345b-67, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2f2b345b-67, col_values=(('external_ids', {'iface-id': '2f2b345b-67b5-4d95-bbd3-3fe48aafaee5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:68:0b', 'vm-uuid': 'afcd0a05-e035-492e-9fbe-cd63f4c3ea42'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:13 user nova-compute[73010]: INFO os_vif [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:68:0b,bridge_name='br-int',has_traffic_filtering=True,id=2f2b345b-67b5-4d95-bbd3-3fe48aafaee5,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b345b-67')
Aug 15 00:32:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap692b6d7e-a3, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap692b6d7e-a3, col_values=(('external_ids', {'iface-id': '692b6d7e-a3c6-4330-9e76-851a1501950c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:4d:fc', 'vm-uuid': '1ba131ea-c646-4719-b85a-5fc021555fcc'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:13 user nova-compute[73010]: INFO os_vif [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:4d:fc,bridge_name='br-int',has_traffic_filtering=True,id=692b6d7e-a3c6-4330-9e76-851a1501950c,network=Network(1ea47cb1-fc85-491d-95a7-927606f5e3d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap692b6d7e-a3')
Aug 15 00:32:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba4444c9-ca, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba4444c9-ca, col_values=(('external_ids', {'iface-id': 'ba4444c9-ca0d-4265-a567-f931f42b3115', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:64:22', 'vm-uuid': '983577b5-4abb-4280-b8e8-a63f42d8f796'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:13 user nova-compute[73010]: INFO os_vif [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:64:22,bridge_name='br-int',has_traffic_filtering=True,id=ba4444c9-ca0d-4265-a567-f931f42b3115,network=Network(25ddd6d0-e3f6-4a35-b15f-a41da18091ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4444c9-ca')
Aug 15 00:32:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] No VIF found with MAC fa:16:3e:7b:68:0b, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] No VIF found with MAC fa:16:3e:07:4d:fc, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] No VIF found with MAC fa:16:3e:b9:64:22, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG nova.network.neutron [req-74180dc9-97e0-44f5-96df-c5db9c833137 req-3d13f404-f055-4fb6-8b66-0702a72d3d5f service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Updated VIF entry in instance network info cache for port 2f2b345b-67b5-4d95-bbd3-3fe48aafaee5. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG nova.network.neutron [req-74180dc9-97e0-44f5-96df-c5db9c833137 req-3d13f404-f055-4fb6-8b66-0702a72d3d5f service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Updating instance_info_cache with network_info: [{"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:32:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-74180dc9-97e0-44f5-96df-c5db9c833137 req-3d13f404-f055-4fb6-8b66-0702a72d3d5f service nova] Releasing lock "refresh_cache-afcd0a05-e035-492e-9fbe-cd63f4c3ea42" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:32:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquiring lock "0588a46c-2314-47e3-b984-1e04518e8a63" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "0588a46c-2314-47e3-b984-1e04518e8a63" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:32:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:18 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:32:18 user nova-compute[73010]: INFO nova.compute.claims [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Claim successful on node user
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.640s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.network.neutron [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:32:19 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.policy [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8948cbf02ab4061a56a10037186f60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a620c803f76045d6a5b5b78ec1894c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:32:19 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Creating image(s)
Aug 15 00:32:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquiring lock "/opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "/opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "/opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059539.6530821, 983577b5-4abb-4280-b8e8-a63f42d8f796 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:32:19 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] VM Resumed (Lifecycle Event)
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.compute.manager [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:32:19 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Instance spawned successfully.
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.compute.manager [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:19 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Instance spawned successfully.
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.243s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.compute.manager [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:32:19 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059539.663585, 983577b5-4abb-4280-b8e8-a63f42d8f796 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:32:19 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] VM Started (Lifecycle Event)
Aug 15 00:32:19 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Instance spawned successfully.
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:32:19 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:32:20 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059539.7613716, 1ba131ea-c646-4719-b85a-5fc021555fcc => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:32:20 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] VM Resumed (Lifecycle Event)
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.257s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:20 user nova-compute[73010]: INFO nova.compute.manager [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Took 17.78 seconds to spawn the instance on the hypervisor.
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:32:20 user nova-compute[73010]: INFO nova.compute.manager [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Took 18.59 seconds to spawn the instance on the hypervisor.
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:32:20 user nova-compute[73010]: INFO nova.compute.manager [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Took 16.98 seconds to spawn the instance on the hypervisor.
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk 1073741824" returned: 0 in 0.099s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.362s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.245s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:20 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059539.7633512, 1ba131ea-c646-4719-b85a-5fc021555fcc => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:32:20 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] VM Started (Lifecycle Event)
Aug 15 00:32:20 user nova-compute[73010]: INFO nova.compute.manager [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Took 19.67 seconds to build instance.
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:32:20 user nova-compute[73010]: INFO nova.compute.manager [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Took 18.05 seconds to build instance.
Aug 15 00:32:20 user nova-compute[73010]: INFO nova.compute.manager [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Took 19.47 seconds to build instance.
Aug 15 00:32:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f5a45db-c863-4a4e-86bd-98fb9e837796 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "1ba131ea-c646-4719-b85a-5fc021555fcc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.898s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059539.8793662, afcd0a05-e035-492e-9fbe-cd63f4c3ea42 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:32:20 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] VM Resumed (Lifecycle Event)
Aug 15 00:32:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-341f9a11-cfb2-4231-9981-1037f5feb3bf tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.613s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-70fa42fd-47be-4abd-8eff-4f76bd07ef47 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.273s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059539.8812747, afcd0a05-e035-492e-9fbe-cd63f4c3ea42 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:32:20 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] VM Started (Lifecycle Event)
Aug 15 00:32:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json" returned: 0 in 0.316s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Cannot resize image /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.objects.instance [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lazy-loading 'migration_context' on Instance uuid 0588a46c-2314-47e3-b984-1e04518e8a63 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Ensure instance console log exists: /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:32:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:32:21 user nova-compute[73010]: DEBUG nova.network.neutron [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Successfully created port: 61021aff-d0dd-4ba3-b862-d989711f4b33 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:32:22 user nova-compute[73010]: DEBUG nova.compute.manager [req-ad6b3ec0-d191-4c4f-9db6-d19682ea1d5e req-662037ff-511e-4873-ac08-12722a91ddb3 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received event network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:32:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ad6b3ec0-d191-4c4f-9db6-d19682ea1d5e req-662037ff-511e-4873-ac08-12722a91ddb3 service nova] Acquiring lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ad6b3ec0-d191-4c4f-9db6-d19682ea1d5e req-662037ff-511e-4873-ac08-12722a91ddb3 service nova] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ad6b3ec0-d191-4c4f-9db6-d19682ea1d5e req-662037ff-511e-4873-ac08-12722a91ddb3 service nova] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:22 user nova-compute[73010]: DEBUG nova.compute.manager [req-ad6b3ec0-d191-4c4f-9db6-d19682ea1d5e req-662037ff-511e-4873-ac08-12722a91ddb3 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] No waiting events found dispatching network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:32:22 user nova-compute[73010]: WARNING nova.compute.manager [req-ad6b3ec0-d191-4c4f-9db6-d19682ea1d5e req-662037ff-511e-4873-ac08-12722a91ddb3 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received unexpected event network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 for instance with vm_state active and task_state None.
Aug 15 00:32:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Acquiring lock "eabef054-b50f-4a34-a501-eb1b991d76af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "eabef054-b50f-4a34-a501-eb1b991d76af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:23 user nova-compute[73010]: DEBUG nova.compute.manager [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:32:23 user nova-compute[73010]: DEBUG nova.network.neutron [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Successfully updated port: 61021aff-d0dd-4ba3-b862-d989711f4b33 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:32:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquiring lock "refresh_cache-0588a46c-2314-47e3-b984-1e04518e8a63" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:32:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquired lock "refresh_cache-0588a46c-2314-47e3-b984-1e04518e8a63" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:32:23 user nova-compute[73010]: DEBUG nova.network.neutron [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:32:23 user nova-compute[73010]: DEBUG nova.compute.manager [req-49966401-3bf5-4daa-a858-a044e668660b req-c8418e65-29db-4b79-abfc-dc3f487c439f service nova] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Received event network-changed-61021aff-d0dd-4ba3-b862-d989711f4b33 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:32:23 user nova-compute[73010]: DEBUG nova.compute.manager [req-49966401-3bf5-4daa-a858-a044e668660b req-c8418e65-29db-4b79-abfc-dc3f487c439f service nova] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Refreshing instance network info cache due to event network-changed-61021aff-d0dd-4ba3-b862-d989711f4b33. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:32:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-49966401-3bf5-4daa-a858-a044e668660b req-c8418e65-29db-4b79-abfc-dc3f487c439f service nova] Acquiring lock "refresh_cache-0588a46c-2314-47e3-b984-1e04518e8a63" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:32:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:32:23 user nova-compute[73010]: INFO nova.compute.claims [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Claim successful on node user
Aug 15 00:32:23 user nova-compute[73010]: DEBUG nova.network.neutron [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG nova.network.neutron [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:32:24 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 15 00:32:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG nova.compute.manager [req-e69e2a86-badf-4a14-adfb-e97caa933aad req-7e9c8cec-8f7b-4117-9607-2a2002dc693c service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received event network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e69e2a86-badf-4a14-adfb-e97caa933aad req-7e9c8cec-8f7b-4117-9607-2a2002dc693c service nova] Acquiring lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e69e2a86-badf-4a14-adfb-e97caa933aad req-7e9c8cec-8f7b-4117-9607-2a2002dc693c service nova] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e69e2a86-badf-4a14-adfb-e97caa933aad req-7e9c8cec-8f7b-4117-9607-2a2002dc693c service nova] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG nova.compute.manager [req-e69e2a86-badf-4a14-adfb-e97caa933aad req-7e9c8cec-8f7b-4117-9607-2a2002dc693c service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] No waiting events found dispatching network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:32:24 user nova-compute[73010]: WARNING nova.compute.manager [req-e69e2a86-badf-4a14-adfb-e97caa933aad req-7e9c8cec-8f7b-4117-9607-2a2002dc693c service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received unexpected event network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 for instance with vm_state active and task_state None.
Aug 15 00:32:24 user nova-compute[73010]: DEBUG nova.compute.manager [req-e69e2a86-badf-4a14-adfb-e97caa933aad req-7e9c8cec-8f7b-4117-9607-2a2002dc693c service nova] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Received event network-vif-plugged-692b6d7e-a3c6-4330-9e76-851a1501950c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e69e2a86-badf-4a14-adfb-e97caa933aad req-7e9c8cec-8f7b-4117-9607-2a2002dc693c service nova] Acquiring lock "1ba131ea-c646-4719-b85a-5fc021555fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e69e2a86-badf-4a14-adfb-e97caa933aad req-7e9c8cec-8f7b-4117-9607-2a2002dc693c service nova] Lock "1ba131ea-c646-4719-b85a-5fc021555fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e69e2a86-badf-4a14-adfb-e97caa933aad req-7e9c8cec-8f7b-4117-9607-2a2002dc693c service nova] Lock "1ba131ea-c646-4719-b85a-5fc021555fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG nova.compute.manager [req-e69e2a86-badf-4a14-adfb-e97caa933aad req-7e9c8cec-8f7b-4117-9607-2a2002dc693c service nova] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] No waiting events found dispatching network-vif-plugged-692b6d7e-a3c6-4330-9e76-851a1501950c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:32:24 user nova-compute[73010]: WARNING nova.compute.manager [req-e69e2a86-badf-4a14-adfb-e97caa933aad req-7e9c8cec-8f7b-4117-9607-2a2002dc693c service nova] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Received unexpected event network-vif-plugged-692b6d7e-a3c6-4330-9e76-851a1501950c for instance with vm_state active and task_state None.
Aug 15 00:32:24 user nova-compute[73010]: DEBUG nova.compute.manager [req-e69e2a86-badf-4a14-adfb-e97caa933aad req-7e9c8cec-8f7b-4117-9607-2a2002dc693c service nova] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Received event network-vif-plugged-692b6d7e-a3c6-4330-9e76-851a1501950c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e69e2a86-badf-4a14-adfb-e97caa933aad req-7e9c8cec-8f7b-4117-9607-2a2002dc693c service nova] Acquiring lock "1ba131ea-c646-4719-b85a-5fc021555fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e69e2a86-badf-4a14-adfb-e97caa933aad req-7e9c8cec-8f7b-4117-9607-2a2002dc693c service nova] Lock "1ba131ea-c646-4719-b85a-5fc021555fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e69e2a86-badf-4a14-adfb-e97caa933aad req-7e9c8cec-8f7b-4117-9607-2a2002dc693c service nova] Lock "1ba131ea-c646-4719-b85a-5fc021555fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG nova.compute.manager [req-e69e2a86-badf-4a14-adfb-e97caa933aad req-7e9c8cec-8f7b-4117-9607-2a2002dc693c service nova] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] No waiting events found dispatching network-vif-plugged-692b6d7e-a3c6-4330-9e76-851a1501950c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:32:24 user nova-compute[73010]: WARNING nova.compute.manager [req-e69e2a86-badf-4a14-adfb-e97caa933aad req-7e9c8cec-8f7b-4117-9607-2a2002dc693c service nova] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Received unexpected event network-vif-plugged-692b6d7e-a3c6-4330-9e76-851a1501950c for instance with vm_state active and task_state None.
Aug 15 00:32:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:32:24 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Creating image(s)
Aug 15 00:32:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Acquiring lock "/opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "/opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "/opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Acquiring lock "d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG nova.network.neutron [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Updating instance_info_cache with network_info: [{"id": "61021aff-d0dd-4ba3-b862-d989711f4b33", "address": "fa:16:3e:8d:63:82", "network": {"id": "9aa91991-9d4c-4b0d-a955-652df703cde1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-393715584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a620c803f76045d6a5b5b78ec1894c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61021aff-d0", "ovs_interfaceid": "61021aff-d0dd-4ba3-b862-d989711f4b33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Releasing lock "refresh_cache-0588a46c-2314-47e3-b984-1e04518e8a63" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Instance network_info: |[{"id": "61021aff-d0dd-4ba3-b862-d989711f4b33", "address": "fa:16:3e:8d:63:82", "network": {"id": "9aa91991-9d4c-4b0d-a955-652df703cde1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-393715584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a620c803f76045d6a5b5b78ec1894c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61021aff-d0", "ovs_interfaceid": "61021aff-d0dd-4ba3-b862-d989711f4b33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-49966401-3bf5-4daa-a858-a044e668660b req-c8418e65-29db-4b79-abfc-dc3f487c439f service nova] Acquired lock "refresh_cache-0588a46c-2314-47e3-b984-1e04518e8a63" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG nova.network.neutron [req-49966401-3bf5-4daa-a858-a044e668660b req-c8418e65-29db-4b79-abfc-dc3f487c439f service nova] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Refreshing network info cache for port 61021aff-d0dd-4ba3-b862-d989711f4b33 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:32:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Start _get_guest_xml network_info=[{"id": "61021aff-d0dd-4ba3-b862-d989711f4b33", "address": "fa:16:3e:8d:63:82", "network": {"id": "9aa91991-9d4c-4b0d-a955-652df703cde1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-393715584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a620c803f76045d6a5b5b78ec1894c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61021aff-d0", "ovs_interfaceid": "61021aff-d0dd-4ba3-b862-d989711f4b33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77.part --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.policy [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a9ba889139040b1b65d5d89d023959f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1345a35a7947442a82d566d64bcde2b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:25 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:32:25 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1541399817',display_name='tempest-VolumesAdminNegativeTest-server-1541399817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1541399817',id=4,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIDG6KZ1SQQWytzmi+qJLQk42ncLAqL/vSUZ0cDedrwxb7bEd+3/FVJXYwCTK4wbpXhcrhaA3TluovYJlwjPTWI1cUglevyMOihUHmGcGFvmMoPkeW6YngjG8YATveRUQ==',key_name='tempest-keypair-506867360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a620c803f76045d6a5b5b78ec1894c5f',ramdisk_id='',reservation_id='r-p4yxauga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-507850758',owner_user_name='tempest-VolumesAdminNegativeTest-507850758-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8948cbf02ab4061a56a10037186f60e',uuid=0588a46c-2314-47e3-b984-1e04518e8a63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61021aff-d0dd-4ba3-b862-d989711f4b33", "address": "fa:16:3e:8d:63:82", "network": {"id": "9aa91991-9d4c-4b0d-a955-652df703cde1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-393715584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a620c803f76045d6a5b5b78ec1894c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61021aff-d0", "ovs_interfaceid": "61021aff-d0dd-4ba3-b862-d989711f4b33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Converting VIF {"id": "61021aff-d0dd-4ba3-b862-d989711f4b33", "address": "fa:16:3e:8d:63:82", "network": {"id": "9aa91991-9d4c-4b0d-a955-652df703cde1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-393715584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a620c803f76045d6a5b5b78ec1894c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61021aff-d0", "ovs_interfaceid": "61021aff-d0dd-4ba3-b862-d989711f4b33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:63:82,bridge_name='br-int',has_traffic_filtering=True,id=61021aff-d0dd-4ba3-b862-d989711f4b33,network=Network(9aa91991-9d4c-4b0d-a955-652df703cde1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61021aff-d0') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.objects.instance [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lazy-loading 'pci_devices' on Instance uuid 0588a46c-2314-47e3-b984-1e04518e8a63 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77.part --force-share --output=json" returned: 0 in 0.236s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.virt.images [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] 437d0ef2-1250-478e-82a8-6bd5914d7aa3 was qcow2, converting to raw {{(pid=73010) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.privsep.utils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73010) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77.part /opt/stack/data/nova/instances/_base/d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77.converted {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:32:25 user nova-compute[73010]:   <uuid>0588a46c-2314-47e3-b984-1e04518e8a63</uuid>
Aug 15 00:32:25 user nova-compute[73010]:   <name>instance-00000004</name>
Aug 15 00:32:25 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:32:25 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:32:25 user nova-compute[73010]:   <metadata>
Aug 15 00:32:25 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:32:25 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:32:25 user nova-compute[73010]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1541399817</nova:name>
Aug 15 00:32:25 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:32:25</nova:creationTime>
Aug 15 00:32:25 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:32:25 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:32:25 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:32:25 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:32:25 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:32:25 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:32:25 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:32:25 user nova-compute[73010]:       <nova:owner>
Aug 15 00:32:25 user nova-compute[73010]:         <nova:user uuid="f8948cbf02ab4061a56a10037186f60e">tempest-VolumesAdminNegativeTest-507850758-project-member</nova:user>
Aug 15 00:32:25 user nova-compute[73010]:         <nova:project uuid="a620c803f76045d6a5b5b78ec1894c5f">tempest-VolumesAdminNegativeTest-507850758</nova:project>
Aug 15 00:32:25 user nova-compute[73010]:       </nova:owner>
Aug 15 00:32:25 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:32:25 user nova-compute[73010]:       <nova:ports>
Aug 15 00:32:25 user nova-compute[73010]:         <nova:port uuid="61021aff-d0dd-4ba3-b862-d989711f4b33">
Aug 15 00:32:25 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 00:32:25 user nova-compute[73010]:         </nova:port>
Aug 15 00:32:25 user nova-compute[73010]:       </nova:ports>
Aug 15 00:32:25 user nova-compute[73010]:     </nova:instance>
Aug 15 00:32:25 user nova-compute[73010]:   </metadata>
Aug 15 00:32:25 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:32:25 user nova-compute[73010]:     <system>
Aug 15 00:32:25 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:32:25 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:32:25 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:32:25 user nova-compute[73010]:       <entry name="serial">0588a46c-2314-47e3-b984-1e04518e8a63</entry>
Aug 15 00:32:25 user nova-compute[73010]:       <entry name="uuid">0588a46c-2314-47e3-b984-1e04518e8a63</entry>
Aug 15 00:32:25 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:32:25 user nova-compute[73010]:     </system>
Aug 15 00:32:25 user nova-compute[73010]:   </sysinfo>
Aug 15 00:32:25 user nova-compute[73010]:   <os>
Aug 15 00:32:25 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:32:25 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:32:25 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:32:25 user nova-compute[73010]:   </os>
Aug 15 00:32:25 user nova-compute[73010]:   <features>
Aug 15 00:32:25 user nova-compute[73010]:     <acpi/>
Aug 15 00:32:25 user nova-compute[73010]:     <apic/>
Aug 15 00:32:25 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:32:25 user nova-compute[73010]:   </features>
Aug 15 00:32:25 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:32:25 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:32:25 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:32:25 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:32:25 user nova-compute[73010]:   </clock>
Aug 15 00:32:25 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:32:25 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:32:25 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:32:25 user nova-compute[73010]:   </cpu>
Aug 15 00:32:25 user nova-compute[73010]:   <devices>
Aug 15 00:32:25 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:32:25 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:32:25 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk"/>
Aug 15 00:32:25 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:32:25 user nova-compute[73010]:     </disk>
Aug 15 00:32:25 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:32:25 user nova-compute[73010]:       <mac address="fa:16:3e:8d:63:82"/>
Aug 15 00:32:25 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:32:25 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:32:25 user nova-compute[73010]:       <target dev="tap61021aff-d0"/>
Aug 15 00:32:25 user nova-compute[73010]:     </interface>
Aug 15 00:32:25 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:32:25 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/console.log" append="off"/>
Aug 15 00:32:25 user nova-compute[73010]:     </serial>
Aug 15 00:32:25 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:32:25 user nova-compute[73010]:     <video>
Aug 15 00:32:25 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:32:25 user nova-compute[73010]:     </video>
Aug 15 00:32:25 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:32:25 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:32:25 user nova-compute[73010]:     </rng>
Aug 15 00:32:25 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:32:25 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:32:25 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:32:25 user nova-compute[73010]:     </memballoon>
Aug 15 00:32:25 user nova-compute[73010]:   </devices>
Aug 15 00:32:25 user nova-compute[73010]: </domain>
Aug 15 00:32:25 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1541399817',display_name='tempest-VolumesAdminNegativeTest-server-1541399817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1541399817',id=4,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIDG6KZ1SQQWytzmi+qJLQk42ncLAqL/vSUZ0cDedrwxb7bEd+3/FVJXYwCTK4wbpXhcrhaA3TluovYJlwjPTWI1cUglevyMOihUHmGcGFvmMoPkeW6YngjG8YATveRUQ==',key_name='tempest-keypair-506867360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a620c803f76045d6a5b5b78ec1894c5f',ramdisk_id='',reservation_id='r-p4yxauga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-507850758',owner_user_name='tempest-VolumesAdminNegativeTest-507850758-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8948cbf02ab4061a56a10037186f60e',uuid=0588a46c-2314-47e3-b984-1e04518e8a63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61021aff-d0dd-4ba3-b862-d989711f4b33", "address": "fa:16:3e:8d:63:82", "network": {"id": "9aa91991-9d4c-4b0d-a955-652df703cde1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-393715584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a620c803f76045d6a5b5b78ec1894c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61021aff-d0", "ovs_interfaceid": "61021aff-d0dd-4ba3-b862-d989711f4b33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Converting VIF {"id": "61021aff-d0dd-4ba3-b862-d989711f4b33", "address": "fa:16:3e:8d:63:82", "network": {"id": "9aa91991-9d4c-4b0d-a955-652df703cde1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-393715584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a620c803f76045d6a5b5b78ec1894c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61021aff-d0", "ovs_interfaceid": "61021aff-d0dd-4ba3-b862-d989711f4b33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:63:82,bridge_name='br-int',has_traffic_filtering=True,id=61021aff-d0dd-4ba3-b862-d989711f4b33,network=Network(9aa91991-9d4c-4b0d-a955-652df703cde1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61021aff-d0') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG os_vif [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:63:82,bridge_name='br-int',has_traffic_filtering=True,id=61021aff-d0dd-4ba3-b862-d989711f4b33,network=Network(9aa91991-9d4c-4b0d-a955-652df703cde1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61021aff-d0') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61021aff-d0, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap61021aff-d0, col_values=(('external_ids', {'iface-id': '61021aff-d0dd-4ba3-b862-d989711f4b33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:63:82', 'vm-uuid': '0588a46c-2314-47e3-b984-1e04518e8a63'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:25 user nova-compute[73010]: INFO os_vif [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:63:82,bridge_name='br-int',has_traffic_filtering=True,id=61021aff-d0dd-4ba3-b862-d989711f4b33,network=Network(9aa91991-9d4c-4b0d-a955-652df703cde1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61021aff-d0')
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] No VIF found with MAC fa:16:3e:8d:63:82, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77.part /opt/stack/data/nova/instances/_base/d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77.converted" returned: 0 in 0.296s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77.converted --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:26 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77.converted --force-share --output=json" returned: 0 in 0.296s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Acquiring lock "de9297d8-10e8-4244-b25d-54d4c2a83aea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Lock "de9297d8-10e8-4244-b25d-54d4c2a83aea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.539s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:26 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:26 user nova-compute[73010]: DEBUG nova.compute.manager [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:32:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:26 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:32:26 user nova-compute[73010]: INFO nova.compute.claims [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Claim successful on node user
Aug 15 00:32:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:26 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77 --force-share --output=json" returned: 0 in 0.306s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Acquiring lock "d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:26 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:26 user nova-compute[73010]: DEBUG nova.network.neutron [req-49966401-3bf5-4daa-a858-a044e668660b req-c8418e65-29db-4b79-abfc-dc3f487c439f service nova] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Updated VIF entry in instance network info cache for port 61021aff-d0dd-4ba3-b862-d989711f4b33. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:32:26 user nova-compute[73010]: DEBUG nova.network.neutron [req-49966401-3bf5-4daa-a858-a044e668660b req-c8418e65-29db-4b79-abfc-dc3f487c439f service nova] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Updating instance_info_cache with network_info: [{"id": "61021aff-d0dd-4ba3-b862-d989711f4b33", "address": "fa:16:3e:8d:63:82", "network": {"id": "9aa91991-9d4c-4b0d-a955-652df703cde1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-393715584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a620c803f76045d6a5b5b78ec1894c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61021aff-d0", "ovs_interfaceid": "61021aff-d0dd-4ba3-b862-d989711f4b33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:32:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-49966401-3bf5-4daa-a858-a044e668660b req-c8418e65-29db-4b79-abfc-dc3f487c439f service nova] Releasing lock "refresh_cache-0588a46c-2314-47e3-b984-1e04518e8a63" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:32:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:26 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77 --force-share --output=json" returned: 0 in 0.373s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:26 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77,backing_fmt=raw /opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:26 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77,backing_fmt=raw /opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af/disk 1073741824" returned: 0 in 0.121s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.499s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:26 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG nova.network.neutron [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Successfully created port: 54ba8c70-915f-4da3-8354-d2a49b3f776e {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77 --force-share --output=json" returned: 0 in 0.248s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.962s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG nova.network.neutron [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:32:27 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:32:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Cannot resize image /opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG nova.objects.instance [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lazy-loading 'migration_context' on Instance uuid eabef054-b50f-4a34-a501-eb1b991d76af {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Ensure instance console log exists: /opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG nova.policy [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a155f32fbbb496288e2fd58a8feb4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2ef5987cbe4bc0a98749cac9455b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:32:27 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Creating image(s)
Aug 15 00:32:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Acquiring lock "/opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Lock "/opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Lock "/opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.257s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.236s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea/disk 1073741824" returned: 0 in 0.070s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG nova.network.neutron [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Successfully updated port: 54ba8c70-915f-4da3-8354-d2a49b3f776e {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Acquiring lock "refresh_cache-eabef054-b50f-4a34-a501-eb1b991d76af" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Acquired lock "refresh_cache-eabef054-b50f-4a34-a501-eb1b991d76af" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG nova.network.neutron [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-c8482a10-f9c2-4a3f-8cc8-ed166c93af0c req-b5dd5bd9-62fe-41bc-881c-7decaa68ec42 service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Received event network-changed-54ba8c70-915f-4da3-8354-d2a49b3f776e {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-c8482a10-f9c2-4a3f-8cc8-ed166c93af0c req-b5dd5bd9-62fe-41bc-881c-7decaa68ec42 service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Refreshing instance network info cache due to event network-changed-54ba8c70-915f-4da3-8354-d2a49b3f776e. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c8482a10-f9c2-4a3f-8cc8-ed166c93af0c req-b5dd5bd9-62fe-41bc-881c-7decaa68ec42 service nova] Acquiring lock "refresh_cache-eabef054-b50f-4a34-a501-eb1b991d76af" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.310s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG nova.network.neutron [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG nova.network.neutron [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Successfully created port: e8325311-2426-4587-b3be-94ebc97c7d9c {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Cannot resize image /opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:32:28 user nova-compute[73010]: DEBUG nova.objects.instance [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Lazy-loading 'migration_context' on Instance uuid de9297d8-10e8-4244-b25d-54d4c2a83aea {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Ensure instance console log exists: /opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.network.neutron [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Updating instance_info_cache with network_info: [{"id": "54ba8c70-915f-4da3-8354-d2a49b3f776e", "address": "fa:16:3e:1a:29:68", "network": {"id": "b301d89d-4779-4c2c-9706-69290914800f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1794168145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1345a35a7947442a82d566d64bcde2b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ba8c70-91", "ovs_interfaceid": "54ba8c70-915f-4da3-8354-d2a49b3f776e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Releasing lock "refresh_cache-eabef054-b50f-4a34-a501-eb1b991d76af" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.compute.manager [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Instance network_info: |[{"id": "54ba8c70-915f-4da3-8354-d2a49b3f776e", "address": "fa:16:3e:1a:29:68", "network": {"id": "b301d89d-4779-4c2c-9706-69290914800f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1794168145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1345a35a7947442a82d566d64bcde2b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ba8c70-91", "ovs_interfaceid": "54ba8c70-915f-4da3-8354-d2a49b3f776e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c8482a10-f9c2-4a3f-8cc8-ed166c93af0c req-b5dd5bd9-62fe-41bc-881c-7decaa68ec42 service nova] Acquired lock "refresh_cache-eabef054-b50f-4a34-a501-eb1b991d76af" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.network.neutron [req-c8482a10-f9c2-4a3f-8cc8-ed166c93af0c req-b5dd5bd9-62fe-41bc-881c-7decaa68ec42 service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Refreshing network info cache for port 54ba8c70-915f-4da3-8354-d2a49b3f776e {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Start _get_guest_xml network_info=[{"id": "54ba8c70-915f-4da3-8354-d2a49b3f776e", "address": "fa:16:3e:1a:29:68", "network": {"id": "b301d89d-4779-4c2c-9706-69290914800f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1794168145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1345a35a7947442a82d566d64bcde2b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ba8c70-91", "ovs_interfaceid": "54ba8c70-915f-4da3-8354-d2a49b3f776e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:32:16Z,direct_url=<?>,disk_format='qcow2',id=437d0ef2-1250-478e-82a8-6bd5914d7aa3,min_disk=0,min_ram=0,name='',owner='a5232ff61df441cc95bebc6298fe9315',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:32:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'scsi', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/sda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '437d0ef2-1250-478e-82a8-6bd5914d7aa3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:32:29 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:32:29 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:32:16Z,direct_url=<?>,disk_format='qcow2',id=437d0ef2-1250-478e-82a8-6bd5914d7aa3,min_disk=0,min_ram=0,name='',owner='a5232ff61df441cc95bebc6298fe9315',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:32:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:32:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-982755511',display_name='tempest-AttachSCSIVolumeTestJSON-server-982755511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-982755511',id=5,image_ref='437d0ef2-1250-478e-82a8-6bd5914d7aa3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcGDTkHecei8uWZJMvNnj2qLTSP7xRFV/pGQWUMWex8lGrzW9FR5OKQRmpHiz3oaMgSSHR71J83dM5EtXVp7Lbmh7Zj++r1aqFg8kCZmxW5GwZ3vIWOP2ZIBFMnR0G25A==',key_name='tempest-keypair-1416261456',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1345a35a7947442a82d566d64bcde2b7',ramdisk_id='',reservation_id='r-x80vz07t',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='437d0ef2-1250-478e-82a8-6bd5914d7aa3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-105430535',owner_user_name='tempest-AttachSCSIVolumeTestJSON-105430535-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:32:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a9ba889139040b1b65d5d89d023959f',uuid=eabef054-b50f-4a34-a501-eb1b991d76af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54ba8c70-915f-4da3-8354-d2a49b3f776e", "address": "fa:16:3e:1a:29:68", "network": {"id": "b301d89d-4779-4c2c-9706-69290914800f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1794168145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1345a35a7947442a82d566d64bcde2b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ba8c70-91", "ovs_interfaceid": "54ba8c70-915f-4da3-8354-d2a49b3f776e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Converting VIF {"id": "54ba8c70-915f-4da3-8354-d2a49b3f776e", "address": "fa:16:3e:1a:29:68", "network": {"id": "b301d89d-4779-4c2c-9706-69290914800f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1794168145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1345a35a7947442a82d566d64bcde2b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ba8c70-91", "ovs_interfaceid": "54ba8c70-915f-4da3-8354-d2a49b3f776e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:29:68,bridge_name='br-int',has_traffic_filtering=True,id=54ba8c70-915f-4da3-8354-d2a49b3f776e,network=Network(b301d89d-4779-4c2c-9706-69290914800f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ba8c70-91') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.objects.instance [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lazy-loading 'pci_devices' on Instance uuid eabef054-b50f-4a34-a501-eb1b991d76af {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:32:29 user nova-compute[73010]:   <uuid>eabef054-b50f-4a34-a501-eb1b991d76af</uuid>
Aug 15 00:32:29 user nova-compute[73010]:   <name>instance-00000005</name>
Aug 15 00:32:29 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:32:29 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:32:29 user nova-compute[73010]:   <metadata>
Aug 15 00:32:29 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:32:29 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:32:29 user nova-compute[73010]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-982755511</nova:name>
Aug 15 00:32:29 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:32:29</nova:creationTime>
Aug 15 00:32:29 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:32:29 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:32:29 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:32:29 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:32:29 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:32:29 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:32:29 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:32:29 user nova-compute[73010]:       <nova:owner>
Aug 15 00:32:29 user nova-compute[73010]:         <nova:user uuid="3a9ba889139040b1b65d5d89d023959f">tempest-AttachSCSIVolumeTestJSON-105430535-project-member</nova:user>
Aug 15 00:32:29 user nova-compute[73010]:         <nova:project uuid="1345a35a7947442a82d566d64bcde2b7">tempest-AttachSCSIVolumeTestJSON-105430535</nova:project>
Aug 15 00:32:29 user nova-compute[73010]:       </nova:owner>
Aug 15 00:32:29 user nova-compute[73010]:       <nova:root type="image" uuid="437d0ef2-1250-478e-82a8-6bd5914d7aa3"/>
Aug 15 00:32:29 user nova-compute[73010]:       <nova:ports>
Aug 15 00:32:29 user nova-compute[73010]:         <nova:port uuid="54ba8c70-915f-4da3-8354-d2a49b3f776e">
Aug 15 00:32:29 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 00:32:29 user nova-compute[73010]:         </nova:port>
Aug 15 00:32:29 user nova-compute[73010]:       </nova:ports>
Aug 15 00:32:29 user nova-compute[73010]:     </nova:instance>
Aug 15 00:32:29 user nova-compute[73010]:   </metadata>
Aug 15 00:32:29 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:32:29 user nova-compute[73010]:     <system>
Aug 15 00:32:29 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:32:29 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:32:29 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:32:29 user nova-compute[73010]:       <entry name="serial">eabef054-b50f-4a34-a501-eb1b991d76af</entry>
Aug 15 00:32:29 user nova-compute[73010]:       <entry name="uuid">eabef054-b50f-4a34-a501-eb1b991d76af</entry>
Aug 15 00:32:29 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:32:29 user nova-compute[73010]:     </system>
Aug 15 00:32:29 user nova-compute[73010]:   </sysinfo>
Aug 15 00:32:29 user nova-compute[73010]:   <os>
Aug 15 00:32:29 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:32:29 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:32:29 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:32:29 user nova-compute[73010]:   </os>
Aug 15 00:32:29 user nova-compute[73010]:   <features>
Aug 15 00:32:29 user nova-compute[73010]:     <acpi/>
Aug 15 00:32:29 user nova-compute[73010]:     <apic/>
Aug 15 00:32:29 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:32:29 user nova-compute[73010]:   </features>
Aug 15 00:32:29 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:32:29 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:32:29 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:32:29 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:32:29 user nova-compute[73010]:   </clock>
Aug 15 00:32:29 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:32:29 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:32:29 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:32:29 user nova-compute[73010]:   </cpu>
Aug 15 00:32:29 user nova-compute[73010]:   <devices>
Aug 15 00:32:29 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:32:29 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:32:29 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af/disk"/>
Aug 15 00:32:29 user nova-compute[73010]:       <target dev="sda" bus="scsi"/>
Aug 15 00:32:29 user nova-compute[73010]:       <address type="drive" controller="0" unit="0"/>
Aug 15 00:32:29 user nova-compute[73010]:     </disk>
Aug 15 00:32:29 user nova-compute[73010]:     <disk type="file" device="cdrom">
Aug 15 00:32:29 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 00:32:29 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af/disk.config"/>
Aug 15 00:32:29 user nova-compute[73010]:       <target dev="sdb" bus="scsi"/>
Aug 15 00:32:29 user nova-compute[73010]:       <address type="drive" controller="0" unit="1"/>
Aug 15 00:32:29 user nova-compute[73010]:     </disk>
Aug 15 00:32:29 user nova-compute[73010]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 15 00:32:29 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:32:29 user nova-compute[73010]:       <mac address="fa:16:3e:1a:29:68"/>
Aug 15 00:32:29 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:32:29 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:32:29 user nova-compute[73010]:       <target dev="tap54ba8c70-91"/>
Aug 15 00:32:29 user nova-compute[73010]:     </interface>
Aug 15 00:32:29 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:32:29 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af/console.log" append="off"/>
Aug 15 00:32:29 user nova-compute[73010]:     </serial>
Aug 15 00:32:29 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:32:29 user nova-compute[73010]:     <video>
Aug 15 00:32:29 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:32:29 user nova-compute[73010]:     </video>
Aug 15 00:32:29 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:32:29 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:32:29 user nova-compute[73010]:     </rng>
Aug 15 00:32:29 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:32:29 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:32:29 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:32:29 user nova-compute[73010]:     </memballoon>
Aug 15 00:32:29 user nova-compute[73010]:   </devices>
Aug 15 00:32:29 user nova-compute[73010]: </domain>
Aug 15 00:32:29 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:32:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-982755511',display_name='tempest-AttachSCSIVolumeTestJSON-server-982755511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-982755511',id=5,image_ref='437d0ef2-1250-478e-82a8-6bd5914d7aa3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcGDTkHecei8uWZJMvNnj2qLTSP7xRFV/pGQWUMWex8lGrzW9FR5OKQRmpHiz3oaMgSSHR71J83dM5EtXVp7Lbmh7Zj++r1aqFg8kCZmxW5GwZ3vIWOP2ZIBFMnR0G25A==',key_name='tempest-keypair-1416261456',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1345a35a7947442a82d566d64bcde2b7',ramdisk_id='',reservation_id='r-x80vz07t',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='437d0ef2-1250-478e-82a8-6bd5914d7aa3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-105430535',owner_user_name='tempest-AttachSCSIVolumeTestJSON-105430535-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:32:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a9ba889139040b1b65d5d89d023959f',uuid=eabef054-b50f-4a34-a501-eb1b991d76af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54ba8c70-915f-4da3-8354-d2a49b3f776e", "address": "fa:16:3e:1a:29:68", "network": {"id": "b301d89d-4779-4c2c-9706-69290914800f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1794168145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1345a35a7947442a82d566d64bcde2b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ba8c70-91", "ovs_interfaceid": "54ba8c70-915f-4da3-8354-d2a49b3f776e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Converting VIF {"id": "54ba8c70-915f-4da3-8354-d2a49b3f776e", "address": "fa:16:3e:1a:29:68", "network": {"id": "b301d89d-4779-4c2c-9706-69290914800f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1794168145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1345a35a7947442a82d566d64bcde2b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ba8c70-91", "ovs_interfaceid": "54ba8c70-915f-4da3-8354-d2a49b3f776e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:29:68,bridge_name='br-int',has_traffic_filtering=True,id=54ba8c70-915f-4da3-8354-d2a49b3f776e,network=Network(b301d89d-4779-4c2c-9706-69290914800f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ba8c70-91') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG os_vif [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:29:68,bridge_name='br-int',has_traffic_filtering=True,id=54ba8c70-915f-4da3-8354-d2a49b3f776e,network=Network(b301d89d-4779-4c2c-9706-69290914800f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ba8c70-91') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54ba8c70-91, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap54ba8c70-91, col_values=(('external_ids', {'iface-id': '54ba8c70-915f-4da3-8354-d2a49b3f776e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:29:68', 'vm-uuid': 'eabef054-b50f-4a34-a501-eb1b991d76af'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:29 user nova-compute[73010]: INFO os_vif [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:29:68,bridge_name='br-int',has_traffic_filtering=True,id=54ba8c70-915f-4da3-8354-d2a49b3f776e,network=Network(b301d89d-4779-4c2c-9706-69290914800f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ba8c70-91')
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] No BDM found with device name sda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:32:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] No VIF found with MAC fa:16:3e:1a:29:68, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:32:29 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Using config drive
Aug 15 00:32:30 user nova-compute[73010]: DEBUG nova.network.neutron [req-c8482a10-f9c2-4a3f-8cc8-ed166c93af0c req-b5dd5bd9-62fe-41bc-881c-7decaa68ec42 service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Updated VIF entry in instance network info cache for port 54ba8c70-915f-4da3-8354-d2a49b3f776e. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:32:30 user nova-compute[73010]: DEBUG nova.network.neutron [req-c8482a10-f9c2-4a3f-8cc8-ed166c93af0c req-b5dd5bd9-62fe-41bc-881c-7decaa68ec42 service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Updating instance_info_cache with network_info: [{"id": "54ba8c70-915f-4da3-8354-d2a49b3f776e", "address": "fa:16:3e:1a:29:68", "network": {"id": "b301d89d-4779-4c2c-9706-69290914800f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1794168145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1345a35a7947442a82d566d64bcde2b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ba8c70-91", "ovs_interfaceid": "54ba8c70-915f-4da3-8354-d2a49b3f776e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:32:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c8482a10-f9c2-4a3f-8cc8-ed166c93af0c req-b5dd5bd9-62fe-41bc-881c-7decaa68ec42 service nova] Releasing lock "refresh_cache-eabef054-b50f-4a34-a501-eb1b991d76af" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:32:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:30 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059550.5657399, 0588a46c-2314-47e3-b984-1e04518e8a63 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:32:30 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] VM Resumed (Lifecycle Event)
Aug 15 00:32:30 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:32:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:32:30 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Instance spawned successfully.
Aug 15 00:32:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:32:30 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:32:30 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:32:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:30 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:32:30 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059550.569467, 0588a46c-2314-47e3-b984-1e04518e8a63 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:32:30 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] VM Started (Lifecycle Event)
Aug 15 00:32:30 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:32:30 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:32:30 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:32:30 user nova-compute[73010]: INFO nova.compute.manager [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Took 11.10 seconds to spawn the instance on the hypervisor.
Aug 15 00:32:30 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:32:30 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Creating config drive at /opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af/disk.config
Aug 15 00:32:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcfo_67xw {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:30 user nova-compute[73010]: INFO nova.compute.manager [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Took 12.25 seconds to build instance.
Aug 15 00:32:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcfo_67xw" returned: 0 in 0.068s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8911535a-c20d-483c-8a68-d344ccae7c53 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "0588a46c-2314-47e3-b984-1e04518e8a63" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.466s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.network.neutron [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Successfully updated port: e8325311-2426-4587-b3be-94ebc97c7d9c {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Acquiring lock "refresh_cache-de9297d8-10e8-4244-b25d-54d4c2a83aea" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Acquired lock "refresh_cache-de9297d8-10e8-4244-b25d-54d4c2a83aea" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.network.neutron [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.compute.manager [req-a9814207-4993-42c9-a3b5-f25f50119735 req-c4c129c4-b3d4-4463-bda4-6ae2faa5adb4 service nova] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Received event network-changed-e8325311-2426-4587-b3be-94ebc97c7d9c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.compute.manager [req-a9814207-4993-42c9-a3b5-f25f50119735 req-c4c129c4-b3d4-4463-bda4-6ae2faa5adb4 service nova] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Refreshing instance network info cache due to event network-changed-e8325311-2426-4587-b3be-94ebc97c7d9c. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a9814207-4993-42c9-a3b5-f25f50119735 req-c4c129c4-b3d4-4463-bda4-6ae2faa5adb4 service nova] Acquiring lock "refresh_cache-de9297d8-10e8-4244-b25d-54d4c2a83aea" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.network.neutron [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.network.neutron [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Updating instance_info_cache with network_info: [{"id": "e8325311-2426-4587-b3be-94ebc97c7d9c", "address": "fa:16:3e:3c:07:e1", "network": {"id": "fe36cefd-7a91-4307-92a8-1200af86e04e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-185864758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d2ef5987cbe4bc0a98749cac9455b6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8325311-24", "ovs_interfaceid": "e8325311-2426-4587-b3be-94ebc97c7d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Releasing lock "refresh_cache-de9297d8-10e8-4244-b25d-54d4c2a83aea" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.compute.manager [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Instance network_info: |[{"id": "e8325311-2426-4587-b3be-94ebc97c7d9c", "address": "fa:16:3e:3c:07:e1", "network": {"id": "fe36cefd-7a91-4307-92a8-1200af86e04e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-185864758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d2ef5987cbe4bc0a98749cac9455b6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8325311-24", "ovs_interfaceid": "e8325311-2426-4587-b3be-94ebc97c7d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a9814207-4993-42c9-a3b5-f25f50119735 req-c4c129c4-b3d4-4463-bda4-6ae2faa5adb4 service nova] Acquired lock "refresh_cache-de9297d8-10e8-4244-b25d-54d4c2a83aea" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.network.neutron [req-a9814207-4993-42c9-a3b5-f25f50119735 req-c4c129c4-b3d4-4463-bda4-6ae2faa5adb4 service nova] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Refreshing network info cache for port e8325311-2426-4587-b3be-94ebc97c7d9c {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Start _get_guest_xml network_info=[{"id": "e8325311-2426-4587-b3be-94ebc97c7d9c", "address": "fa:16:3e:3c:07:e1", "network": {"id": "fe36cefd-7a91-4307-92a8-1200af86e04e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-185864758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d2ef5987cbe4bc0a98749cac9455b6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8325311-24", "ovs_interfaceid": "e8325311-2426-4587-b3be-94ebc97c7d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:32:31 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:32:31 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-124624336',display_name='tempest-VolumesAssistedSnapshotsTest-server-124624336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-124624336',id=6,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVmO0tRNeT3IYqGeCuKj6dXSiUJi9p1VCoswpoYi054l+LWpaZFwX+iTUu5KByrJGv/LHSZAGE+4No6Ze1tijb1dxNg3MXTfWv74p7EeSyIYqphY0BQjv1YnumojodCUA==',key_name='tempest-keypair-1311122172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d2ef5987cbe4bc0a98749cac9455b6b',ramdisk_id='',reservation_id='r-kuv2q1d7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-987061659',owner_user_name='tempest-VolumesAssistedSnapshotsTest-987061659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:32:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a155f32fbbb496288e2fd58a8feb4b7',uuid=de9297d8-10e8-4244-b25d-54d4c2a83aea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8325311-2426-4587-b3be-94ebc97c7d9c", "address": "fa:16:3e:3c:07:e1", "network": {"id": "fe36cefd-7a91-4307-92a8-1200af86e04e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-185864758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d2ef5987cbe4bc0a98749cac9455b6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8325311-24", "ovs_interfaceid": "e8325311-2426-4587-b3be-94ebc97c7d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Converting VIF {"id": "e8325311-2426-4587-b3be-94ebc97c7d9c", "address": "fa:16:3e:3c:07:e1", "network": {"id": "fe36cefd-7a91-4307-92a8-1200af86e04e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-185864758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d2ef5987cbe4bc0a98749cac9455b6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8325311-24", "ovs_interfaceid": "e8325311-2426-4587-b3be-94ebc97c7d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:07:e1,bridge_name='br-int',has_traffic_filtering=True,id=e8325311-2426-4587-b3be-94ebc97c7d9c,network=Network(fe36cefd-7a91-4307-92a8-1200af86e04e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8325311-24') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.objects.instance [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Lazy-loading 'pci_devices' on Instance uuid de9297d8-10e8-4244-b25d-54d4c2a83aea {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:32:31 user nova-compute[73010]:   <uuid>de9297d8-10e8-4244-b25d-54d4c2a83aea</uuid>
Aug 15 00:32:31 user nova-compute[73010]:   <name>instance-00000006</name>
Aug 15 00:32:31 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:32:31 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:32:31 user nova-compute[73010]:   <metadata>
Aug 15 00:32:31 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:32:31 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:32:31 user nova-compute[73010]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-124624336</nova:name>
Aug 15 00:32:31 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:32:31</nova:creationTime>
Aug 15 00:32:31 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:32:31 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:32:31 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:32:31 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:32:31 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:32:31 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:32:31 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:32:31 user nova-compute[73010]:       <nova:owner>
Aug 15 00:32:31 user nova-compute[73010]:         <nova:user uuid="2a155f32fbbb496288e2fd58a8feb4b7">tempest-VolumesAssistedSnapshotsTest-987061659-project-member</nova:user>
Aug 15 00:32:31 user nova-compute[73010]:         <nova:project uuid="7d2ef5987cbe4bc0a98749cac9455b6b">tempest-VolumesAssistedSnapshotsTest-987061659</nova:project>
Aug 15 00:32:31 user nova-compute[73010]:       </nova:owner>
Aug 15 00:32:31 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:32:31 user nova-compute[73010]:       <nova:ports>
Aug 15 00:32:31 user nova-compute[73010]:         <nova:port uuid="e8325311-2426-4587-b3be-94ebc97c7d9c">
Aug 15 00:32:31 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 00:32:31 user nova-compute[73010]:         </nova:port>
Aug 15 00:32:31 user nova-compute[73010]:       </nova:ports>
Aug 15 00:32:31 user nova-compute[73010]:     </nova:instance>
Aug 15 00:32:31 user nova-compute[73010]:   </metadata>
Aug 15 00:32:31 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:32:31 user nova-compute[73010]:     <system>
Aug 15 00:32:31 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:32:31 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:32:31 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:32:31 user nova-compute[73010]:       <entry name="serial">de9297d8-10e8-4244-b25d-54d4c2a83aea</entry>
Aug 15 00:32:31 user nova-compute[73010]:       <entry name="uuid">de9297d8-10e8-4244-b25d-54d4c2a83aea</entry>
Aug 15 00:32:31 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:32:31 user nova-compute[73010]:     </system>
Aug 15 00:32:31 user nova-compute[73010]:   </sysinfo>
Aug 15 00:32:31 user nova-compute[73010]:   <os>
Aug 15 00:32:31 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:32:31 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:32:31 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:32:31 user nova-compute[73010]:   </os>
Aug 15 00:32:31 user nova-compute[73010]:   <features>
Aug 15 00:32:31 user nova-compute[73010]:     <acpi/>
Aug 15 00:32:31 user nova-compute[73010]:     <apic/>
Aug 15 00:32:31 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:32:31 user nova-compute[73010]:   </features>
Aug 15 00:32:31 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:32:31 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:32:31 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:32:31 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:32:31 user nova-compute[73010]:   </clock>
Aug 15 00:32:31 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:32:31 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:32:31 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:32:31 user nova-compute[73010]:   </cpu>
Aug 15 00:32:31 user nova-compute[73010]:   <devices>
Aug 15 00:32:31 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:32:31 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:32:31 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea/disk"/>
Aug 15 00:32:31 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:32:31 user nova-compute[73010]:     </disk>
Aug 15 00:32:31 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:32:31 user nova-compute[73010]:       <mac address="fa:16:3e:3c:07:e1"/>
Aug 15 00:32:31 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:32:31 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:32:31 user nova-compute[73010]:       <target dev="tape8325311-24"/>
Aug 15 00:32:31 user nova-compute[73010]:     </interface>
Aug 15 00:32:31 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:32:31 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea/console.log" append="off"/>
Aug 15 00:32:31 user nova-compute[73010]:     </serial>
Aug 15 00:32:31 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:32:31 user nova-compute[73010]:     <video>
Aug 15 00:32:31 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:32:31 user nova-compute[73010]:     </video>
Aug 15 00:32:31 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:32:31 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:32:31 user nova-compute[73010]:     </rng>
Aug 15 00:32:31 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:32:31 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:32:31 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:32:31 user nova-compute[73010]:     </memballoon>
Aug 15 00:32:31 user nova-compute[73010]:   </devices>
Aug 15 00:32:31 user nova-compute[73010]: </domain>
Aug 15 00:32:31 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-124624336',display_name='tempest-VolumesAssistedSnapshotsTest-server-124624336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-124624336',id=6,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVmO0tRNeT3IYqGeCuKj6dXSiUJi9p1VCoswpoYi054l+LWpaZFwX+iTUu5KByrJGv/LHSZAGE+4No6Ze1tijb1dxNg3MXTfWv74p7EeSyIYqphY0BQjv1YnumojodCUA==',key_name='tempest-keypair-1311122172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d2ef5987cbe4bc0a98749cac9455b6b',ramdisk_id='',reservation_id='r-kuv2q1d7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-987061659',owner_user_name='tempest-VolumesAssistedSnapshotsTest-987061659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:32:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a155f32fbbb496288e2fd58a8feb4b7',uuid=de9297d8-10e8-4244-b25d-54d4c2a83aea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8325311-2426-4587-b3be-94ebc97c7d9c", "address": "fa:16:3e:3c:07:e1", "network": {"id": "fe36cefd-7a91-4307-92a8-1200af86e04e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-185864758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d2ef5987cbe4bc0a98749cac9455b6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8325311-24", "ovs_interfaceid": "e8325311-2426-4587-b3be-94ebc97c7d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Converting VIF {"id": "e8325311-2426-4587-b3be-94ebc97c7d9c", "address": "fa:16:3e:3c:07:e1", "network": {"id": "fe36cefd-7a91-4307-92a8-1200af86e04e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-185864758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d2ef5987cbe4bc0a98749cac9455b6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8325311-24", "ovs_interfaceid": "e8325311-2426-4587-b3be-94ebc97c7d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:07:e1,bridge_name='br-int',has_traffic_filtering=True,id=e8325311-2426-4587-b3be-94ebc97c7d9c,network=Network(fe36cefd-7a91-4307-92a8-1200af86e04e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8325311-24') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG os_vif [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:07:e1,bridge_name='br-int',has_traffic_filtering=True,id=e8325311-2426-4587-b3be-94ebc97c7d9c,network=Network(fe36cefd-7a91-4307-92a8-1200af86e04e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8325311-24') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8325311-24, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape8325311-24, col_values=(('external_ids', {'iface-id': 'e8325311-2426-4587-b3be-94ebc97c7d9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:07:e1', 'vm-uuid': 'de9297d8-10e8-4244-b25d-54d4c2a83aea'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:31 user nova-compute[73010]: INFO os_vif [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:07:e1,bridge_name='br-int',has_traffic_filtering=True,id=e8325311-2426-4587-b3be-94ebc97c7d9c,network=Network(fe36cefd-7a91-4307-92a8-1200af86e04e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8325311-24')
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:32:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] No VIF found with MAC fa:16:3e:3c:07:e1, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:32:32 user nova-compute[73010]: DEBUG nova.network.neutron [req-a9814207-4993-42c9-a3b5-f25f50119735 req-c4c129c4-b3d4-4463-bda4-6ae2faa5adb4 service nova] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Updated VIF entry in instance network info cache for port e8325311-2426-4587-b3be-94ebc97c7d9c. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:32:32 user nova-compute[73010]: DEBUG nova.network.neutron [req-a9814207-4993-42c9-a3b5-f25f50119735 req-c4c129c4-b3d4-4463-bda4-6ae2faa5adb4 service nova] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Updating instance_info_cache with network_info: [{"id": "e8325311-2426-4587-b3be-94ebc97c7d9c", "address": "fa:16:3e:3c:07:e1", "network": {"id": "fe36cefd-7a91-4307-92a8-1200af86e04e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-185864758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d2ef5987cbe4bc0a98749cac9455b6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8325311-24", "ovs_interfaceid": "e8325311-2426-4587-b3be-94ebc97c7d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:32:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a9814207-4993-42c9-a3b5-f25f50119735 req-c4c129c4-b3d4-4463-bda4-6ae2faa5adb4 service nova] Releasing lock "refresh_cache-de9297d8-10e8-4244-b25d-54d4c2a83aea" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:32:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:33 user nova-compute[73010]: DEBUG nova.compute.manager [req-9814d5d8-bf10-4b8e-8fc0-ff580aaa9ff4 req-fb53a2ff-70c5-4cc2-99ec-5222a8bee26b service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Received event network-vif-plugged-54ba8c70-915f-4da3-8354-d2a49b3f776e {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:32:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9814d5d8-bf10-4b8e-8fc0-ff580aaa9ff4 req-fb53a2ff-70c5-4cc2-99ec-5222a8bee26b service nova] Acquiring lock "eabef054-b50f-4a34-a501-eb1b991d76af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9814d5d8-bf10-4b8e-8fc0-ff580aaa9ff4 req-fb53a2ff-70c5-4cc2-99ec-5222a8bee26b service nova] Lock "eabef054-b50f-4a34-a501-eb1b991d76af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9814d5d8-bf10-4b8e-8fc0-ff580aaa9ff4 req-fb53a2ff-70c5-4cc2-99ec-5222a8bee26b service nova] Lock "eabef054-b50f-4a34-a501-eb1b991d76af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:33 user nova-compute[73010]: DEBUG nova.compute.manager [req-9814d5d8-bf10-4b8e-8fc0-ff580aaa9ff4 req-fb53a2ff-70c5-4cc2-99ec-5222a8bee26b service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] No waiting events found dispatching network-vif-plugged-54ba8c70-915f-4da3-8354-d2a49b3f776e {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:32:33 user nova-compute[73010]: WARNING nova.compute.manager [req-9814d5d8-bf10-4b8e-8fc0-ff580aaa9ff4 req-fb53a2ff-70c5-4cc2-99ec-5222a8bee26b service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Received unexpected event network-vif-plugged-54ba8c70-915f-4da3-8354-d2a49b3f776e for instance with vm_state building and task_state spawning.
Aug 15 00:32:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:35 user nova-compute[73010]: DEBUG nova.compute.manager [req-81873064-c69f-4c86-81c9-fff29201d12f req-26ef8892-328f-4c61-b040-7c75cafcc666 service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Received event network-vif-plugged-54ba8c70-915f-4da3-8354-d2a49b3f776e {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:32:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-81873064-c69f-4c86-81c9-fff29201d12f req-26ef8892-328f-4c61-b040-7c75cafcc666 service nova] Acquiring lock "eabef054-b50f-4a34-a501-eb1b991d76af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-81873064-c69f-4c86-81c9-fff29201d12f req-26ef8892-328f-4c61-b040-7c75cafcc666 service nova] Lock "eabef054-b50f-4a34-a501-eb1b991d76af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-81873064-c69f-4c86-81c9-fff29201d12f req-26ef8892-328f-4c61-b040-7c75cafcc666 service nova] Lock "eabef054-b50f-4a34-a501-eb1b991d76af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:35 user nova-compute[73010]: DEBUG nova.compute.manager [req-81873064-c69f-4c86-81c9-fff29201d12f req-26ef8892-328f-4c61-b040-7c75cafcc666 service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] No waiting events found dispatching network-vif-plugged-54ba8c70-915f-4da3-8354-d2a49b3f776e {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:32:35 user nova-compute[73010]: WARNING nova.compute.manager [req-81873064-c69f-4c86-81c9-fff29201d12f req-26ef8892-328f-4c61-b040-7c75cafcc666 service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Received unexpected event network-vif-plugged-54ba8c70-915f-4da3-8354-d2a49b3f776e for instance with vm_state building and task_state spawning.
Aug 15 00:32:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Acquiring lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:35 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:32:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:35 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:32:35 user nova-compute[73010]: INFO nova.compute.claims [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Claim successful on node user
Aug 15 00:32:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:36 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:32:36 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:32:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:36 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:32:36 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:32:36 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:32:36 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:32:36 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:32:36 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:32:36 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:32:36 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Creating image(s)
Aug 15 00:32:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "/opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "/opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:36 user nova-compute[73010]: DEBUG nova.policy [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8f76161fed446bf9ebf53beef8dc0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331f005ccb394d18a5ec723b1a94bf73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:32:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.214s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.175s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk 1073741824" returned: 0 in 0.051s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059557.2255406, eabef054-b50f-4a34-a501-eb1b991d76af => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:32:37 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] VM Resumed (Lifecycle Event)
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:32:37 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Instance spawned successfully.
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:32:37 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059557.255827, eabef054-b50f-4a34-a501-eb1b991d76af => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:32:37 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] VM Started (Lifecycle Event)
Aug 15 00:32:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.216s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:32:37 user nova-compute[73010]: INFO nova.compute.manager [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Took 12.77 seconds to spawn the instance on the hypervisor.
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:32:37 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.compute.manager [req-70dad951-e8d5-415c-93a7-8065ab90dcf2 req-1b9024da-643e-4832-9d33-c677828aef2f service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received event network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-70dad951-e8d5-415c-93a7-8065ab90dcf2 req-1b9024da-643e-4832-9d33-c677828aef2f service nova] Acquiring lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-70dad951-e8d5-415c-93a7-8065ab90dcf2 req-1b9024da-643e-4832-9d33-c677828aef2f service nova] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-70dad951-e8d5-415c-93a7-8065ab90dcf2 req-1b9024da-643e-4832-9d33-c677828aef2f service nova] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.compute.manager [req-70dad951-e8d5-415c-93a7-8065ab90dcf2 req-1b9024da-643e-4832-9d33-c677828aef2f service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] No waiting events found dispatching network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:32:37 user nova-compute[73010]: WARNING nova.compute.manager [req-70dad951-e8d5-415c-93a7-8065ab90dcf2 req-1b9024da-643e-4832-9d33-c677828aef2f service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received unexpected event network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 for instance with vm_state active and task_state None.
Aug 15 00:32:37 user nova-compute[73010]: INFO nova.compute.manager [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Took 13.92 seconds to build instance.
Aug 15 00:32:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a80fb1bd-03cb-4b4a-abe3-62605d2af561 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "eabef054-b50f-4a34-a501-eb1b991d76af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.074s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Cannot resize image /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.objects.instance [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lazy-loading 'migration_context' on Instance uuid b1d5a938-3f1e-4e8c-bdda-0786d4e27d98 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Ensure instance console log exists: /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059557.686698, de9297d8-10e8-4244-b25d-54d4c2a83aea => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:32:37 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] VM Resumed (Lifecycle Event)
Aug 15 00:32:37 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Instance spawned successfully.
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:37 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059557.692508, de9297d8-10e8-4244-b25d-54d4c2a83aea => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:32:37 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] VM Started (Lifecycle Event)
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:32:37 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:32:37 user nova-compute[73010]: INFO nova.compute.manager [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Took 10.06 seconds to spawn the instance on the hypervisor.
Aug 15 00:32:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:32:37 user nova-compute[73010]: INFO nova.compute.manager [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Took 11.64 seconds to build instance.
Aug 15 00:32:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-004e4c70-d5b2-48e5-8feb-ddcaf903ef19 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Lock "de9297d8-10e8-4244-b25d-54d4c2a83aea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.847s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:38 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Successfully created port: cd4cdfd2-7917-4c56-b348-6856691dec61 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:32:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:39 user nova-compute[73010]: DEBUG nova.compute.manager [req-70394c13-7cfe-4a17-8a51-f62bb170205d req-6645a0a3-85c5-4d2f-9c30-e6a6281b901a service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received event network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:32:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-70394c13-7cfe-4a17-8a51-f62bb170205d req-6645a0a3-85c5-4d2f-9c30-e6a6281b901a service nova] Acquiring lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-70394c13-7cfe-4a17-8a51-f62bb170205d req-6645a0a3-85c5-4d2f-9c30-e6a6281b901a service nova] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-70394c13-7cfe-4a17-8a51-f62bb170205d req-6645a0a3-85c5-4d2f-9c30-e6a6281b901a service nova] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:39 user nova-compute[73010]: DEBUG nova.compute.manager [req-70394c13-7cfe-4a17-8a51-f62bb170205d req-6645a0a3-85c5-4d2f-9c30-e6a6281b901a service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] No waiting events found dispatching network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:32:39 user nova-compute[73010]: WARNING nova.compute.manager [req-70394c13-7cfe-4a17-8a51-f62bb170205d req-6645a0a3-85c5-4d2f-9c30-e6a6281b901a service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received unexpected event network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 for instance with vm_state active and task_state None.
Aug 15 00:32:39 user nova-compute[73010]: DEBUG nova.compute.manager [req-70394c13-7cfe-4a17-8a51-f62bb170205d req-6645a0a3-85c5-4d2f-9c30-e6a6281b901a service nova] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Received event network-vif-plugged-61021aff-d0dd-4ba3-b862-d989711f4b33 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:32:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-70394c13-7cfe-4a17-8a51-f62bb170205d req-6645a0a3-85c5-4d2f-9c30-e6a6281b901a service nova] Acquiring lock "0588a46c-2314-47e3-b984-1e04518e8a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-70394c13-7cfe-4a17-8a51-f62bb170205d req-6645a0a3-85c5-4d2f-9c30-e6a6281b901a service nova] Lock "0588a46c-2314-47e3-b984-1e04518e8a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-70394c13-7cfe-4a17-8a51-f62bb170205d req-6645a0a3-85c5-4d2f-9c30-e6a6281b901a service nova] Lock "0588a46c-2314-47e3-b984-1e04518e8a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:39 user nova-compute[73010]: DEBUG nova.compute.manager [req-70394c13-7cfe-4a17-8a51-f62bb170205d req-6645a0a3-85c5-4d2f-9c30-e6a6281b901a service nova] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] No waiting events found dispatching network-vif-plugged-61021aff-d0dd-4ba3-b862-d989711f4b33 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:32:39 user nova-compute[73010]: WARNING nova.compute.manager [req-70394c13-7cfe-4a17-8a51-f62bb170205d req-6645a0a3-85c5-4d2f-9c30-e6a6281b901a service nova] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Received unexpected event network-vif-plugged-61021aff-d0dd-4ba3-b862-d989711f4b33 for instance with vm_state active and task_state None.
Aug 15 00:32:39 user nova-compute[73010]: DEBUG nova.compute.manager [req-70394c13-7cfe-4a17-8a51-f62bb170205d req-6645a0a3-85c5-4d2f-9c30-e6a6281b901a service nova] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Received event network-vif-plugged-61021aff-d0dd-4ba3-b862-d989711f4b33 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:32:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-70394c13-7cfe-4a17-8a51-f62bb170205d req-6645a0a3-85c5-4d2f-9c30-e6a6281b901a service nova] Acquiring lock "0588a46c-2314-47e3-b984-1e04518e8a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-70394c13-7cfe-4a17-8a51-f62bb170205d req-6645a0a3-85c5-4d2f-9c30-e6a6281b901a service nova] Lock "0588a46c-2314-47e3-b984-1e04518e8a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-70394c13-7cfe-4a17-8a51-f62bb170205d req-6645a0a3-85c5-4d2f-9c30-e6a6281b901a service nova] Lock "0588a46c-2314-47e3-b984-1e04518e8a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:39 user nova-compute[73010]: DEBUG nova.compute.manager [req-70394c13-7cfe-4a17-8a51-f62bb170205d req-6645a0a3-85c5-4d2f-9c30-e6a6281b901a service nova] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] No waiting events found dispatching network-vif-plugged-61021aff-d0dd-4ba3-b862-d989711f4b33 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:32:39 user nova-compute[73010]: WARNING nova.compute.manager [req-70394c13-7cfe-4a17-8a51-f62bb170205d req-6645a0a3-85c5-4d2f-9c30-e6a6281b901a service nova] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Received unexpected event network-vif-plugged-61021aff-d0dd-4ba3-b862-d989711f4b33 for instance with vm_state active and task_state None.
Aug 15 00:32:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:40 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Successfully updated port: cd4cdfd2-7917-4c56-b348-6856691dec61 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:32:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Acquiring lock "refresh_cache-b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:32:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Acquired lock "refresh_cache-b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:32:40 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:32:40 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Updating instance_info_cache with network_info: [{"id": "cd4cdfd2-7917-4c56-b348-6856691dec61", "address": "fa:16:3e:19:09:43", "network": {"id": "af43fc40-99df-4eac-b5f1-c481b6de298a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378376468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331f005ccb394d18a5ec723b1a94bf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4cdfd2-79", "ovs_interfaceid": "cd4cdfd2-7917-4c56-b348-6856691dec61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Releasing lock "refresh_cache-b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Instance network_info: |[{"id": "cd4cdfd2-7917-4c56-b348-6856691dec61", "address": "fa:16:3e:19:09:43", "network": {"id": "af43fc40-99df-4eac-b5f1-c481b6de298a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378376468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331f005ccb394d18a5ec723b1a94bf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4cdfd2-79", "ovs_interfaceid": "cd4cdfd2-7917-4c56-b348-6856691dec61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Start _get_guest_xml network_info=[{"id": "cd4cdfd2-7917-4c56-b348-6856691dec61", "address": "fa:16:3e:19:09:43", "network": {"id": "af43fc40-99df-4eac-b5f1-c481b6de298a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378376468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331f005ccb394d18a5ec723b1a94bf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4cdfd2-79", "ovs_interfaceid": "cd4cdfd2-7917-4c56-b348-6856691dec61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:32:41 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:32:41 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1646459107',display_name='tempest-TestVolumeSwap-server-1646459107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1646459107',id=7,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPZCXzXUJ0htBJqMWP6P6MyY9g5dh/fzIuEqPI8plA6qru3b/nkjxS3WeOwFI+KnsXdNXkswJPHrFRld3VpQ/esCeSkMfxmCUU0WQL51iNxfK9OyyiDKuxURsclckqszw==',key_name='tempest-keypair-245191451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='331f005ccb394d18a5ec723b1a94bf73',ramdisk_id='',reservation_id='r-tg61aa3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1341975594',owner_user_name='tempest-TestVolumeSwap-1341975594-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:32:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f76161fed446bf9ebf53beef8dc0d0',uuid=b1d5a938-3f1e-4e8c-bdda-0786d4e27d98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd4cdfd2-7917-4c56-b348-6856691dec61", "address": "fa:16:3e:19:09:43", "network": {"id": "af43fc40-99df-4eac-b5f1-c481b6de298a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378376468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331f005ccb394d18a5ec723b1a94bf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4cdfd2-79", "ovs_interfaceid": "cd4cdfd2-7917-4c56-b348-6856691dec61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Converting VIF {"id": "cd4cdfd2-7917-4c56-b348-6856691dec61", "address": "fa:16:3e:19:09:43", "network": {"id": "af43fc40-99df-4eac-b5f1-c481b6de298a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378376468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331f005ccb394d18a5ec723b1a94bf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4cdfd2-79", "ovs_interfaceid": "cd4cdfd2-7917-4c56-b348-6856691dec61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:09:43,bridge_name='br-int',has_traffic_filtering=True,id=cd4cdfd2-7917-4c56-b348-6856691dec61,network=Network(af43fc40-99df-4eac-b5f1-c481b6de298a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd4cdfd2-79') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.objects.instance [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lazy-loading 'pci_devices' on Instance uuid b1d5a938-3f1e-4e8c-bdda-0786d4e27d98 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:32:41 user nova-compute[73010]:   <uuid>b1d5a938-3f1e-4e8c-bdda-0786d4e27d98</uuid>
Aug 15 00:32:41 user nova-compute[73010]:   <name>instance-00000007</name>
Aug 15 00:32:41 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:32:41 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:32:41 user nova-compute[73010]:   <metadata>
Aug 15 00:32:41 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:32:41 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:32:41 user nova-compute[73010]:       <nova:name>tempest-TestVolumeSwap-server-1646459107</nova:name>
Aug 15 00:32:41 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:32:41</nova:creationTime>
Aug 15 00:32:41 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:32:41 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:32:41 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:32:41 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:32:41 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:32:41 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:32:41 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:32:41 user nova-compute[73010]:       <nova:owner>
Aug 15 00:32:41 user nova-compute[73010]:         <nova:user uuid="d8f76161fed446bf9ebf53beef8dc0d0">tempest-TestVolumeSwap-1341975594-project-member</nova:user>
Aug 15 00:32:41 user nova-compute[73010]:         <nova:project uuid="331f005ccb394d18a5ec723b1a94bf73">tempest-TestVolumeSwap-1341975594</nova:project>
Aug 15 00:32:41 user nova-compute[73010]:       </nova:owner>
Aug 15 00:32:41 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:32:41 user nova-compute[73010]:       <nova:ports>
Aug 15 00:32:41 user nova-compute[73010]:         <nova:port uuid="cd4cdfd2-7917-4c56-b348-6856691dec61">
Aug 15 00:32:41 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 00:32:41 user nova-compute[73010]:         </nova:port>
Aug 15 00:32:41 user nova-compute[73010]:       </nova:ports>
Aug 15 00:32:41 user nova-compute[73010]:     </nova:instance>
Aug 15 00:32:41 user nova-compute[73010]:   </metadata>
Aug 15 00:32:41 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:32:41 user nova-compute[73010]:     <system>
Aug 15 00:32:41 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:32:41 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:32:41 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:32:41 user nova-compute[73010]:       <entry name="serial">b1d5a938-3f1e-4e8c-bdda-0786d4e27d98</entry>
Aug 15 00:32:41 user nova-compute[73010]:       <entry name="uuid">b1d5a938-3f1e-4e8c-bdda-0786d4e27d98</entry>
Aug 15 00:32:41 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:32:41 user nova-compute[73010]:     </system>
Aug 15 00:32:41 user nova-compute[73010]:   </sysinfo>
Aug 15 00:32:41 user nova-compute[73010]:   <os>
Aug 15 00:32:41 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:32:41 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:32:41 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:32:41 user nova-compute[73010]:   </os>
Aug 15 00:32:41 user nova-compute[73010]:   <features>
Aug 15 00:32:41 user nova-compute[73010]:     <acpi/>
Aug 15 00:32:41 user nova-compute[73010]:     <apic/>
Aug 15 00:32:41 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:32:41 user nova-compute[73010]:   </features>
Aug 15 00:32:41 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:32:41 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:32:41 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:32:41 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:32:41 user nova-compute[73010]:   </clock>
Aug 15 00:32:41 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:32:41 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:32:41 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:32:41 user nova-compute[73010]:   </cpu>
Aug 15 00:32:41 user nova-compute[73010]:   <devices>
Aug 15 00:32:41 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:32:41 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:32:41 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk"/>
Aug 15 00:32:41 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:32:41 user nova-compute[73010]:     </disk>
Aug 15 00:32:41 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:32:41 user nova-compute[73010]:       <mac address="fa:16:3e:19:09:43"/>
Aug 15 00:32:41 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:32:41 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:32:41 user nova-compute[73010]:       <target dev="tapcd4cdfd2-79"/>
Aug 15 00:32:41 user nova-compute[73010]:     </interface>
Aug 15 00:32:41 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:32:41 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/console.log" append="off"/>
Aug 15 00:32:41 user nova-compute[73010]:     </serial>
Aug 15 00:32:41 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:32:41 user nova-compute[73010]:     <video>
Aug 15 00:32:41 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:32:41 user nova-compute[73010]:     </video>
Aug 15 00:32:41 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:32:41 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:32:41 user nova-compute[73010]:     </rng>
Aug 15 00:32:41 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:32:41 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:32:41 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:32:41 user nova-compute[73010]:     </memballoon>
Aug 15 00:32:41 user nova-compute[73010]:   </devices>
Aug 15 00:32:41 user nova-compute[73010]: </domain>
Aug 15 00:32:41 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1646459107',display_name='tempest-TestVolumeSwap-server-1646459107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1646459107',id=7,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPZCXzXUJ0htBJqMWP6P6MyY9g5dh/fzIuEqPI8plA6qru3b/nkjxS3WeOwFI+KnsXdNXkswJPHrFRld3VpQ/esCeSkMfxmCUU0WQL51iNxfK9OyyiDKuxURsclckqszw==',key_name='tempest-keypair-245191451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='331f005ccb394d18a5ec723b1a94bf73',ramdisk_id='',reservation_id='r-tg61aa3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1341975594',owner_user_name='tempest-TestVolumeSwap-1341975594-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:32:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f76161fed446bf9ebf53beef8dc0d0',uuid=b1d5a938-3f1e-4e8c-bdda-0786d4e27d98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd4cdfd2-7917-4c56-b348-6856691dec61", "address": "fa:16:3e:19:09:43", "network": {"id": "af43fc40-99df-4eac-b5f1-c481b6de298a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378376468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331f005ccb394d18a5ec723b1a94bf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4cdfd2-79", "ovs_interfaceid": "cd4cdfd2-7917-4c56-b348-6856691dec61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Converting VIF {"id": "cd4cdfd2-7917-4c56-b348-6856691dec61", "address": "fa:16:3e:19:09:43", "network": {"id": "af43fc40-99df-4eac-b5f1-c481b6de298a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378376468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331f005ccb394d18a5ec723b1a94bf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4cdfd2-79", "ovs_interfaceid": "cd4cdfd2-7917-4c56-b348-6856691dec61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:09:43,bridge_name='br-int',has_traffic_filtering=True,id=cd4cdfd2-7917-4c56-b348-6856691dec61,network=Network(af43fc40-99df-4eac-b5f1-c481b6de298a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd4cdfd2-79') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG os_vif [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:09:43,bridge_name='br-int',has_traffic_filtering=True,id=cd4cdfd2-7917-4c56-b348-6856691dec61,network=Network(af43fc40-99df-4eac-b5f1-c481b6de298a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd4cdfd2-79') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd4cdfd2-79, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcd4cdfd2-79, col_values=(('external_ids', {'iface-id': 'cd4cdfd2-7917-4c56-b348-6856691dec61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:09:43', 'vm-uuid': 'b1d5a938-3f1e-4e8c-bdda-0786d4e27d98'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:41 user nova-compute[73010]: INFO os_vif [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:09:43,bridge_name='br-int',has_traffic_filtering=True,id=cd4cdfd2-7917-4c56-b348-6856691dec61,network=Network(af43fc40-99df-4eac-b5f1-c481b6de298a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd4cdfd2-79')
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] No VIF found with MAC fa:16:3e:19:09:43, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-45c238fd-94ae-4637-9064-acae9f4cea80 req-ad5cd6cc-0202-4fd1-9516-b544043ce0b2 service nova] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Received event network-vif-plugged-e8325311-2426-4587-b3be-94ebc97c7d9c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-45c238fd-94ae-4637-9064-acae9f4cea80 req-ad5cd6cc-0202-4fd1-9516-b544043ce0b2 service nova] Acquiring lock "de9297d8-10e8-4244-b25d-54d4c2a83aea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-45c238fd-94ae-4637-9064-acae9f4cea80 req-ad5cd6cc-0202-4fd1-9516-b544043ce0b2 service nova] Lock "de9297d8-10e8-4244-b25d-54d4c2a83aea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-45c238fd-94ae-4637-9064-acae9f4cea80 req-ad5cd6cc-0202-4fd1-9516-b544043ce0b2 service nova] Lock "de9297d8-10e8-4244-b25d-54d4c2a83aea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-45c238fd-94ae-4637-9064-acae9f4cea80 req-ad5cd6cc-0202-4fd1-9516-b544043ce0b2 service nova] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] No waiting events found dispatching network-vif-plugged-e8325311-2426-4587-b3be-94ebc97c7d9c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:32:41 user nova-compute[73010]: WARNING nova.compute.manager [req-45c238fd-94ae-4637-9064-acae9f4cea80 req-ad5cd6cc-0202-4fd1-9516-b544043ce0b2 service nova] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Received unexpected event network-vif-plugged-e8325311-2426-4587-b3be-94ebc97c7d9c for instance with vm_state active and task_state None.
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-45c238fd-94ae-4637-9064-acae9f4cea80 req-ad5cd6cc-0202-4fd1-9516-b544043ce0b2 service nova] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Received event network-vif-plugged-e8325311-2426-4587-b3be-94ebc97c7d9c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-45c238fd-94ae-4637-9064-acae9f4cea80 req-ad5cd6cc-0202-4fd1-9516-b544043ce0b2 service nova] Acquiring lock "de9297d8-10e8-4244-b25d-54d4c2a83aea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-45c238fd-94ae-4637-9064-acae9f4cea80 req-ad5cd6cc-0202-4fd1-9516-b544043ce0b2 service nova] Lock "de9297d8-10e8-4244-b25d-54d4c2a83aea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-45c238fd-94ae-4637-9064-acae9f4cea80 req-ad5cd6cc-0202-4fd1-9516-b544043ce0b2 service nova] Lock "de9297d8-10e8-4244-b25d-54d4c2a83aea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-45c238fd-94ae-4637-9064-acae9f4cea80 req-ad5cd6cc-0202-4fd1-9516-b544043ce0b2 service nova] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] No waiting events found dispatching network-vif-plugged-e8325311-2426-4587-b3be-94ebc97c7d9c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:32:41 user nova-compute[73010]: WARNING nova.compute.manager [req-45c238fd-94ae-4637-9064-acae9f4cea80 req-ad5cd6cc-0202-4fd1-9516-b544043ce0b2 service nova] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Received unexpected event network-vif-plugged-e8325311-2426-4587-b3be-94ebc97c7d9c for instance with vm_state active and task_state None.
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-45c238fd-94ae-4637-9064-acae9f4cea80 req-ad5cd6cc-0202-4fd1-9516-b544043ce0b2 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Received event network-changed-cd4cdfd2-7917-4c56-b348-6856691dec61 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-45c238fd-94ae-4637-9064-acae9f4cea80 req-ad5cd6cc-0202-4fd1-9516-b544043ce0b2 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Refreshing instance network info cache due to event network-changed-cd4cdfd2-7917-4c56-b348-6856691dec61. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-45c238fd-94ae-4637-9064-acae9f4cea80 req-ad5cd6cc-0202-4fd1-9516-b544043ce0b2 service nova] Acquiring lock "refresh_cache-b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-45c238fd-94ae-4637-9064-acae9f4cea80 req-ad5cd6cc-0202-4fd1-9516-b544043ce0b2 service nova] Acquired lock "refresh_cache-b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:32:41 user nova-compute[73010]: DEBUG nova.network.neutron [req-45c238fd-94ae-4637-9064-acae9f4cea80 req-ad5cd6cc-0202-4fd1-9516-b544043ce0b2 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Refreshing network info cache for port cd4cdfd2-7917-4c56-b348-6856691dec61 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:32:42 user nova-compute[73010]: DEBUG nova.network.neutron [req-45c238fd-94ae-4637-9064-acae9f4cea80 req-ad5cd6cc-0202-4fd1-9516-b544043ce0b2 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Updated VIF entry in instance network info cache for port cd4cdfd2-7917-4c56-b348-6856691dec61. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:32:42 user nova-compute[73010]: DEBUG nova.network.neutron [req-45c238fd-94ae-4637-9064-acae9f4cea80 req-ad5cd6cc-0202-4fd1-9516-b544043ce0b2 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Updating instance_info_cache with network_info: [{"id": "cd4cdfd2-7917-4c56-b348-6856691dec61", "address": "fa:16:3e:19:09:43", "network": {"id": "af43fc40-99df-4eac-b5f1-c481b6de298a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378376468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331f005ccb394d18a5ec723b1a94bf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4cdfd2-79", "ovs_interfaceid": "cd4cdfd2-7917-4c56-b348-6856691dec61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:32:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-45c238fd-94ae-4637-9064-acae9f4cea80 req-ad5cd6cc-0202-4fd1-9516-b544043ce0b2 service nova] Releasing lock "refresh_cache-b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:32:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:32:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Cleaning up deleted instances {{(pid=73010) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 00:32:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] There are 0 instances to clean {{(pid=73010) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 00:32:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:32:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73010) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 00:32:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:32:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:43 user nova-compute[73010]: DEBUG nova.compute.manager [req-45573035-974e-4045-a932-ed96783c99c4 req-5088a117-b9f2-4e8f-b0ba-68a7dbb2b1f9 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Received event network-vif-plugged-cd4cdfd2-7917-4c56-b348-6856691dec61 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:32:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-45573035-974e-4045-a932-ed96783c99c4 req-5088a117-b9f2-4e8f-b0ba-68a7dbb2b1f9 service nova] Acquiring lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-45573035-974e-4045-a932-ed96783c99c4 req-5088a117-b9f2-4e8f-b0ba-68a7dbb2b1f9 service nova] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-45573035-974e-4045-a932-ed96783c99c4 req-5088a117-b9f2-4e8f-b0ba-68a7dbb2b1f9 service nova] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:43 user nova-compute[73010]: DEBUG nova.compute.manager [req-45573035-974e-4045-a932-ed96783c99c4 req-5088a117-b9f2-4e8f-b0ba-68a7dbb2b1f9 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] No waiting events found dispatching network-vif-plugged-cd4cdfd2-7917-4c56-b348-6856691dec61 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:32:43 user nova-compute[73010]: WARNING nova.compute.manager [req-45573035-974e-4045-a932-ed96783c99c4 req-5088a117-b9f2-4e8f-b0ba-68a7dbb2b1f9 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Received unexpected event network-vif-plugged-cd4cdfd2-7917-4c56-b348-6856691dec61 for instance with vm_state building and task_state spawning.
Aug 15 00:32:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:44 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:32:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:44 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:32:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba131ea-c646-4719-b85a-5fc021555fcc/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:45 user nova-compute[73010]: DEBUG nova.compute.manager [req-48609ca1-204b-4233-938f-6470c2c3d07a req-4d6bd432-d5a4-46be-9aea-ddaccffd4930 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Received event network-vif-plugged-cd4cdfd2-7917-4c56-b348-6856691dec61 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:32:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-48609ca1-204b-4233-938f-6470c2c3d07a req-4d6bd432-d5a4-46be-9aea-ddaccffd4930 service nova] Acquiring lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-48609ca1-204b-4233-938f-6470c2c3d07a req-4d6bd432-d5a4-46be-9aea-ddaccffd4930 service nova] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-48609ca1-204b-4233-938f-6470c2c3d07a req-4d6bd432-d5a4-46be-9aea-ddaccffd4930 service nova] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:45 user nova-compute[73010]: DEBUG nova.compute.manager [req-48609ca1-204b-4233-938f-6470c2c3d07a req-4d6bd432-d5a4-46be-9aea-ddaccffd4930 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] No waiting events found dispatching network-vif-plugged-cd4cdfd2-7917-4c56-b348-6856691dec61 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:32:45 user nova-compute[73010]: WARNING nova.compute.manager [req-48609ca1-204b-4233-938f-6470c2c3d07a req-4d6bd432-d5a4-46be-9aea-ddaccffd4930 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Received unexpected event network-vif-plugged-cd4cdfd2-7917-4c56-b348-6856691dec61 for instance with vm_state building and task_state spawning.
Aug 15 00:32:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba131ea-c646-4719-b85a-5fc021555fcc/disk --force-share --output=json" returned: 0 in 0.337s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba131ea-c646-4719-b85a-5fc021555fcc/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:45 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059565.7790391, b1d5a938-3f1e-4e8c-bdda-0786d4e27d98 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:32:45 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] VM Resumed (Lifecycle Event)
Aug 15 00:32:45 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:32:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:32:45 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Instance spawned successfully.
Aug 15 00:32:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:32:45 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:32:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:32:45 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:32:45 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:32:45 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059565.7806726, b1d5a938-3f1e-4e8c-bdda-0786d4e27d98 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:32:45 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] VM Started (Lifecycle Event)
Aug 15 00:32:45 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:32:45 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:32:46 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:32:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba131ea-c646-4719-b85a-5fc021555fcc/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:46 user nova-compute[73010]: INFO nova.compute.manager [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Took 9.45 seconds to spawn the instance on the hypervisor.
Aug 15 00:32:46 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:32:46 user nova-compute[73010]: INFO nova.compute.manager [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Took 10.53 seconds to build instance.
Aug 15 00:32:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c2037895-71a4-4601-b1bf-c0c3ab053a28 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.743s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:49 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:32:49 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:32:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=7819MB free_disk=26.02130126953125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:32:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 1ba131ea-c646-4719-b85a-5fc021555fcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:32:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 983577b5-4abb-4280-b8e8-a63f42d8f796 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:32:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance afcd0a05-e035-492e-9fbe-cd63f4c3ea42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:32:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 0588a46c-2314-47e3-b984-1e04518e8a63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:32:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance eabef054-b50f-4a34-a501-eb1b991d76af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:32:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance de9297d8-10e8-4244-b25d-54d4c2a83aea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:32:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance b1d5a938-3f1e-4e8c-bdda-0786d4e27d98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:32:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:32:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:32:49 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:32:49 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:32:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:32:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.564s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:50 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:32:50 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:32:50 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:32:50 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 00:32:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-1ba131ea-c646-4719-b85a-5fc021555fcc" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:32:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-1ba131ea-c646-4719-b85a-5fc021555fcc" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:32:50 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 00:32:50 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lazy-loading 'info_cache' on Instance uuid 1ba131ea-c646-4719-b85a-5fc021555fcc {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:32:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:51 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Updating instance_info_cache with network_info: [{"id": "692b6d7e-a3c6-4330-9e76-851a1501950c", "address": "fa:16:3e:07:4d:fc", "network": {"id": "1ea47cb1-fc85-491d-95a7-927606f5e3d4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-620603594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4613c3de3a28481ab5528489a43216aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap692b6d7e-a3", "ovs_interfaceid": "692b6d7e-a3c6-4330-9e76-851a1501950c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:32:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-1ba131ea-c646-4719-b85a-5fc021555fcc" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:32:51 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 00:32:51 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:32:51 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:32:51 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:32:51 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:32:51 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:32:51 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:32:51 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:32:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Acquiring lock "0627dc52-eca1-48b3-ab8c-c612629a1db2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Lock "0627dc52-eca1-48b3-ab8c-c612629a1db2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:56 user nova-compute[73010]: DEBUG nova.compute.manager [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:32:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:56 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:32:56 user nova-compute[73010]: INFO nova.compute.claims [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Claim successful on node user
Aug 15 00:32:56 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Refreshing inventories for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 00:32:56 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Updating ProviderTree inventory for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 00:32:56 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Updating inventory in ProviderTree for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 00:32:57 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Refreshing aggregate associations for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e, aggregates: None {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 00:32:57 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Refreshing trait associations for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 00:32:57 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:32:57 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:32:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:32:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:32:57 user nova-compute[73010]: DEBUG nova.network.neutron [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:32:57 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:32:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:32:57 user nova-compute[73010]: DEBUG nova.policy [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbd8d398678a4209b631a1f7efb26052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa034555126d4d708c936d814907d3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:32:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:32:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:32:57 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Creating image(s)
Aug 15 00:32:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Acquiring lock "/opt/stack/data/nova/instances/0627dc52-eca1-48b3-ab8c-c612629a1db2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Lock "/opt/stack/data/nova/instances/0627dc52-eca1-48b3-ab8c-c612629a1db2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Lock "/opt/stack/data/nova/instances/0627dc52-eca1-48b3-ab8c-c612629a1db2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.194s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.193s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/0627dc52-eca1-48b3-ab8c-c612629a1db2/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/0627dc52-eca1-48b3-ab8c-c612629a1db2/disk 1073741824" returned: 0 in 0.135s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.335s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:58 user nova-compute[73010]: DEBUG nova.network.neutron [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Successfully created port: a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:32:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.222s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:58 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0627dc52-eca1-48b3-ab8c-c612629a1db2/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:32:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0627dc52-eca1-48b3-ab8c-c612629a1db2/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:32:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0627dc52-eca1-48b3-ab8c-c612629a1db2/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:32:58 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Cannot resize image /opt/stack/data/nova/instances/0627dc52-eca1-48b3-ab8c-c612629a1db2/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:32:58 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Lazy-loading 'migration_context' on Instance uuid 0627dc52-eca1-48b3-ab8c-c612629a1db2 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:32:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:32:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Ensure instance console log exists: /opt/stack/data/nova/instances/0627dc52-eca1-48b3-ab8c-c612629a1db2/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:32:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:32:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:32:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.network.neutron [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Successfully updated port: a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Acquiring lock "refresh_cache-0627dc52-eca1-48b3-ab8c-c612629a1db2" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Acquired lock "refresh_cache-0627dc52-eca1-48b3-ab8c-c612629a1db2" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.network.neutron [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-5d51b1f2-cd0a-465f-8c11-8feb013d0fcf req-e316b826-29c4-4eff-a9e2-1b09f81badc5 service nova] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Received event network-changed-a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-5d51b1f2-cd0a-465f-8c11-8feb013d0fcf req-e316b826-29c4-4eff-a9e2-1b09f81badc5 service nova] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Refreshing instance network info cache due to event network-changed-a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5d51b1f2-cd0a-465f-8c11-8feb013d0fcf req-e316b826-29c4-4eff-a9e2-1b09f81badc5 service nova] Acquiring lock "refresh_cache-0627dc52-eca1-48b3-ab8c-c612629a1db2" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.network.neutron [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.network.neutron [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Updating instance_info_cache with network_info: [{"id": "a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40", "address": "fa:16:3e:42:ed:c2", "network": {"id": "284020d9-9139-4ae6-b9d5-423309aecbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1943154676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa034555126d4d708c936d814907d3e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c9fd2-b1", "ovs_interfaceid": "a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Releasing lock "refresh_cache-0627dc52-eca1-48b3-ab8c-c612629a1db2" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.compute.manager [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Instance network_info: |[{"id": "a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40", "address": "fa:16:3e:42:ed:c2", "network": {"id": "284020d9-9139-4ae6-b9d5-423309aecbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1943154676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa034555126d4d708c936d814907d3e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c9fd2-b1", "ovs_interfaceid": "a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5d51b1f2-cd0a-465f-8c11-8feb013d0fcf req-e316b826-29c4-4eff-a9e2-1b09f81badc5 service nova] Acquired lock "refresh_cache-0627dc52-eca1-48b3-ab8c-c612629a1db2" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.network.neutron [req-5d51b1f2-cd0a-465f-8c11-8feb013d0fcf req-e316b826-29c4-4eff-a9e2-1b09f81badc5 service nova] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Refreshing network info cache for port a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Start _get_guest_xml network_info=[{"id": "a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40", "address": "fa:16:3e:42:ed:c2", "network": {"id": "284020d9-9139-4ae6-b9d5-423309aecbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1943154676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa034555126d4d708c936d814907d3e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c9fd2-b1", "ovs_interfaceid": "a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:32:59 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:32:59 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1635998963',display_name='tempest-VolumesActionsTest-instance-1635998963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1635998963',id=8,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa034555126d4d708c936d814907d3e5',ramdisk_id='',reservation_id='r-eesihso1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-258940867',owner_user_name='tempest-VolumesActionsTest-258940867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:32:58Z,user_data=None,user_id='bbd8d398678a4209b631a1f7efb26052',uuid=0627dc52-eca1-48b3-ab8c-c612629a1db2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40", "address": "fa:16:3e:42:ed:c2", "network": {"id": "284020d9-9139-4ae6-b9d5-423309aecbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1943154676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa034555126d4d708c936d814907d3e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c9fd2-b1", "ovs_interfaceid": "a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Converting VIF {"id": "a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40", "address": "fa:16:3e:42:ed:c2", "network": {"id": "284020d9-9139-4ae6-b9d5-423309aecbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1943154676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa034555126d4d708c936d814907d3e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c9fd2-b1", "ovs_interfaceid": "a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:ed:c2,bridge_name='br-int',has_traffic_filtering=True,id=a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40,network=Network(284020d9-9139-4ae6-b9d5-423309aecbb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa90c9fd2-b1') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Lazy-loading 'pci_devices' on Instance uuid 0627dc52-eca1-48b3-ab8c-c612629a1db2 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:32:59 user nova-compute[73010]:   <uuid>0627dc52-eca1-48b3-ab8c-c612629a1db2</uuid>
Aug 15 00:32:59 user nova-compute[73010]:   <name>instance-00000008</name>
Aug 15 00:32:59 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:32:59 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:32:59 user nova-compute[73010]:   <metadata>
Aug 15 00:32:59 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:32:59 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:32:59 user nova-compute[73010]:       <nova:name>tempest-VolumesActionsTest-instance-1635998963</nova:name>
Aug 15 00:32:59 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:32:59</nova:creationTime>
Aug 15 00:32:59 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:32:59 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:32:59 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:32:59 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:32:59 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:32:59 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:32:59 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:32:59 user nova-compute[73010]:       <nova:owner>
Aug 15 00:32:59 user nova-compute[73010]:         <nova:user uuid="bbd8d398678a4209b631a1f7efb26052">tempest-VolumesActionsTest-258940867-project-member</nova:user>
Aug 15 00:32:59 user nova-compute[73010]:         <nova:project uuid="fa034555126d4d708c936d814907d3e5">tempest-VolumesActionsTest-258940867</nova:project>
Aug 15 00:32:59 user nova-compute[73010]:       </nova:owner>
Aug 15 00:32:59 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:32:59 user nova-compute[73010]:       <nova:ports>
Aug 15 00:32:59 user nova-compute[73010]:         <nova:port uuid="a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40">
Aug 15 00:32:59 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 00:32:59 user nova-compute[73010]:         </nova:port>
Aug 15 00:32:59 user nova-compute[73010]:       </nova:ports>
Aug 15 00:32:59 user nova-compute[73010]:     </nova:instance>
Aug 15 00:32:59 user nova-compute[73010]:   </metadata>
Aug 15 00:32:59 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:32:59 user nova-compute[73010]:     <system>
Aug 15 00:32:59 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:32:59 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:32:59 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:32:59 user nova-compute[73010]:       <entry name="serial">0627dc52-eca1-48b3-ab8c-c612629a1db2</entry>
Aug 15 00:32:59 user nova-compute[73010]:       <entry name="uuid">0627dc52-eca1-48b3-ab8c-c612629a1db2</entry>
Aug 15 00:32:59 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:32:59 user nova-compute[73010]:     </system>
Aug 15 00:32:59 user nova-compute[73010]:   </sysinfo>
Aug 15 00:32:59 user nova-compute[73010]:   <os>
Aug 15 00:32:59 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:32:59 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:32:59 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:32:59 user nova-compute[73010]:   </os>
Aug 15 00:32:59 user nova-compute[73010]:   <features>
Aug 15 00:32:59 user nova-compute[73010]:     <acpi/>
Aug 15 00:32:59 user nova-compute[73010]:     <apic/>
Aug 15 00:32:59 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:32:59 user nova-compute[73010]:   </features>
Aug 15 00:32:59 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:32:59 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:32:59 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:32:59 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:32:59 user nova-compute[73010]:   </clock>
Aug 15 00:32:59 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:32:59 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:32:59 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:32:59 user nova-compute[73010]:   </cpu>
Aug 15 00:32:59 user nova-compute[73010]:   <devices>
Aug 15 00:32:59 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:32:59 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:32:59 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/0627dc52-eca1-48b3-ab8c-c612629a1db2/disk"/>
Aug 15 00:32:59 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:32:59 user nova-compute[73010]:     </disk>
Aug 15 00:32:59 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:32:59 user nova-compute[73010]:       <mac address="fa:16:3e:42:ed:c2"/>
Aug 15 00:32:59 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:32:59 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:32:59 user nova-compute[73010]:       <target dev="tapa90c9fd2-b1"/>
Aug 15 00:32:59 user nova-compute[73010]:     </interface>
Aug 15 00:32:59 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:32:59 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/0627dc52-eca1-48b3-ab8c-c612629a1db2/console.log" append="off"/>
Aug 15 00:32:59 user nova-compute[73010]:     </serial>
Aug 15 00:32:59 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:32:59 user nova-compute[73010]:     <video>
Aug 15 00:32:59 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:32:59 user nova-compute[73010]:     </video>
Aug 15 00:32:59 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:32:59 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:32:59 user nova-compute[73010]:     </rng>
Aug 15 00:32:59 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:32:59 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:32:59 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:32:59 user nova-compute[73010]:     </memballoon>
Aug 15 00:32:59 user nova-compute[73010]:   </devices>
Aug 15 00:32:59 user nova-compute[73010]: </domain>
Aug 15 00:32:59 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1635998963',display_name='tempest-VolumesActionsTest-instance-1635998963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1635998963',id=8,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa034555126d4d708c936d814907d3e5',ramdisk_id='',reservation_id='r-eesihso1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-258940867',owner_user_name='tempest-VolumesActionsTest-258940867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:32:58Z,user_data=None,user_id='bbd8d398678a4209b631a1f7efb26052',uuid=0627dc52-eca1-48b3-ab8c-c612629a1db2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40", "address": "fa:16:3e:42:ed:c2", "network": {"id": "284020d9-9139-4ae6-b9d5-423309aecbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1943154676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa034555126d4d708c936d814907d3e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c9fd2-b1", "ovs_interfaceid": "a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Converting VIF {"id": "a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40", "address": "fa:16:3e:42:ed:c2", "network": {"id": "284020d9-9139-4ae6-b9d5-423309aecbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1943154676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa034555126d4d708c936d814907d3e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c9fd2-b1", "ovs_interfaceid": "a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:ed:c2,bridge_name='br-int',has_traffic_filtering=True,id=a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40,network=Network(284020d9-9139-4ae6-b9d5-423309aecbb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa90c9fd2-b1') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG os_vif [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:ed:c2,bridge_name='br-int',has_traffic_filtering=True,id=a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40,network=Network(284020d9-9139-4ae6-b9d5-423309aecbb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa90c9fd2-b1') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa90c9fd2-b1, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa90c9fd2-b1, col_values=(('external_ids', {'iface-id': 'a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:ed:c2', 'vm-uuid': '0627dc52-eca1-48b3-ab8c-c612629a1db2'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:32:59 user nova-compute[73010]: INFO os_vif [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:ed:c2,bridge_name='br-int',has_traffic_filtering=True,id=a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40,network=Network(284020d9-9139-4ae6-b9d5-423309aecbb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa90c9fd2-b1')
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:32:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] No VIF found with MAC fa:16:3e:42:ed:c2, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:33:00 user nova-compute[73010]: DEBUG nova.network.neutron [req-5d51b1f2-cd0a-465f-8c11-8feb013d0fcf req-e316b826-29c4-4eff-a9e2-1b09f81badc5 service nova] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Updated VIF entry in instance network info cache for port a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:33:00 user nova-compute[73010]: DEBUG nova.network.neutron [req-5d51b1f2-cd0a-465f-8c11-8feb013d0fcf req-e316b826-29c4-4eff-a9e2-1b09f81badc5 service nova] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Updating instance_info_cache with network_info: [{"id": "a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40", "address": "fa:16:3e:42:ed:c2", "network": {"id": "284020d9-9139-4ae6-b9d5-423309aecbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1943154676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa034555126d4d708c936d814907d3e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c9fd2-b1", "ovs_interfaceid": "a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:33:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5d51b1f2-cd0a-465f-8c11-8feb013d0fcf req-e316b826-29c4-4eff-a9e2-1b09f81badc5 service nova] Releasing lock "refresh_cache-0627dc52-eca1-48b3-ab8c-c612629a1db2" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:33:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:01 user nova-compute[73010]: DEBUG nova.compute.manager [req-8a001f3d-5dda-4108-b9d6-210f9c3190f9 req-80866930-72ff-46b1-9486-347fa900203a service nova] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Received event network-vif-plugged-a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-8a001f3d-5dda-4108-b9d6-210f9c3190f9 req-80866930-72ff-46b1-9486-347fa900203a service nova] Acquiring lock "0627dc52-eca1-48b3-ab8c-c612629a1db2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-8a001f3d-5dda-4108-b9d6-210f9c3190f9 req-80866930-72ff-46b1-9486-347fa900203a service nova] Lock "0627dc52-eca1-48b3-ab8c-c612629a1db2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-8a001f3d-5dda-4108-b9d6-210f9c3190f9 req-80866930-72ff-46b1-9486-347fa900203a service nova] Lock "0627dc52-eca1-48b3-ab8c-c612629a1db2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:01 user nova-compute[73010]: DEBUG nova.compute.manager [req-8a001f3d-5dda-4108-b9d6-210f9c3190f9 req-80866930-72ff-46b1-9486-347fa900203a service nova] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] No waiting events found dispatching network-vif-plugged-a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:33:01 user nova-compute[73010]: WARNING nova.compute.manager [req-8a001f3d-5dda-4108-b9d6-210f9c3190f9 req-80866930-72ff-46b1-9486-347fa900203a service nova] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Received unexpected event network-vif-plugged-a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40 for instance with vm_state building and task_state spawning.
Aug 15 00:33:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:03 user nova-compute[73010]: DEBUG nova.compute.manager [req-4c52dd7e-b431-43ea-8012-d8eaf6680dc6 req-7f19c2ba-ef68-4621-81bf-80de4b50750e service nova] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Received event network-vif-plugged-a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4c52dd7e-b431-43ea-8012-d8eaf6680dc6 req-7f19c2ba-ef68-4621-81bf-80de4b50750e service nova] Acquiring lock "0627dc52-eca1-48b3-ab8c-c612629a1db2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4c52dd7e-b431-43ea-8012-d8eaf6680dc6 req-7f19c2ba-ef68-4621-81bf-80de4b50750e service nova] Lock "0627dc52-eca1-48b3-ab8c-c612629a1db2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4c52dd7e-b431-43ea-8012-d8eaf6680dc6 req-7f19c2ba-ef68-4621-81bf-80de4b50750e service nova] Lock "0627dc52-eca1-48b3-ab8c-c612629a1db2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:03 user nova-compute[73010]: DEBUG nova.compute.manager [req-4c52dd7e-b431-43ea-8012-d8eaf6680dc6 req-7f19c2ba-ef68-4621-81bf-80de4b50750e service nova] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] No waiting events found dispatching network-vif-plugged-a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:33:03 user nova-compute[73010]: WARNING nova.compute.manager [req-4c52dd7e-b431-43ea-8012-d8eaf6680dc6 req-7f19c2ba-ef68-4621-81bf-80de4b50750e service nova] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Received unexpected event network-vif-plugged-a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40 for instance with vm_state building and task_state spawning.
Aug 15 00:33:03 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059583.8636367, 0627dc52-eca1-48b3-ab8c-c612629a1db2 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:33:03 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] VM Resumed (Lifecycle Event)
Aug 15 00:33:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:33:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:33:03 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Instance spawned successfully.
Aug 15 00:33:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:33:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:33:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:33:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:33:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:33:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:33:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:33:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:33:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:33:03 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:33:03 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059583.8643806, 0627dc52-eca1-48b3-ab8c-c612629a1db2 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:33:03 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] VM Started (Lifecycle Event)
Aug 15 00:33:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:33:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:33:04 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:33:04 user nova-compute[73010]: INFO nova.compute.manager [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Took 6.45 seconds to spawn the instance on the hypervisor.
Aug 15 00:33:04 user nova-compute[73010]: DEBUG nova.compute.manager [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:33:04 user nova-compute[73010]: INFO nova.compute.manager [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Took 7.56 seconds to build instance.
Aug 15 00:33:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b287b6e2-632d-4949-b2fd-f1480cb67552 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Lock "0627dc52-eca1-48b3-ab8c-c612629a1db2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.721s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:17 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:33:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:17 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:33:17 user nova-compute[73010]: INFO nova.compute.claims [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Claim successful on node user
Aug 15 00:33:18 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:33:18 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:33:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:33:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:33:18 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:33:18 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:33:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:33:18 user nova-compute[73010]: INFO nova.virt.block_device [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Booting with volume 9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 at /dev/vda
Aug 15 00:33:18 user nova-compute[73010]: DEBUG os_brick.utils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:33:18 user nova-compute[73010]: INFO oslo.privsep.daemon [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp3y6axy0h/privsep.sock']
Aug 15 00:33:18 user sudo[84077]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp3y6axy0h/privsep.sock
Aug 15 00:33:18 user sudo[84077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 00:33:18 user nova-compute[73010]: DEBUG nova.policy [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7e247179e3845708d8d9565cfe5f472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40820fcd77f4dbc8532e4090dd2ca0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:33:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:20 user sudo[84077]: pam_unix(sudo:session): session closed for user root
Aug 15 00:33:20 user nova-compute[73010]: INFO oslo.privsep.daemon [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Spawned new privsep daemon via rootwrap
Aug 15 00:33:20 user nova-compute[73010]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 00:33:20 user nova-compute[73010]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 00:33:20 user nova-compute[73010]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 15 00:33:20 user nova-compute[73010]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84080
Aug 15 00:33:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[91639f66-a8d7-480a-a3ed-10a3d629b823]: (2,) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:20 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Successfully created port: 4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:33:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bddc44-402a-4243-abe9-09135a0e9018]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:20 user nova-compute[73010]: WARNING os_brick.initiator.connectors.nvmeof [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 15 00:33:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be35bcf-a061-42db-bb81-f2f30edfc1ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d05379-2995-4642-b256-0b5c3d9f0b86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2746dd-990f-48fe-a409-ed35f959d0c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:33:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:33:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:33:20 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:33:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[386e9c95-7897-4514-bfda-6e59c6d0fe96]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:33:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:33:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:33:20 user nova-compute[73010]: DEBUG os_brick.utils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] <== get_connector_properties: return (2185ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:33:20 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Updating existing volume attachment record: e18171fc-ec33-417d-a56b-65ffbb1ce33c {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:33:21 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Successfully created port: 6a7825db-198c-48a3-a587-07e565e7f151 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:33:21 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Successfully created port: c0a7a8fb-96d7-4d75-9c81-bebe9861874d {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:33:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:21 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:33:22 user nova-compute[73010]: INFO nova.compute.claims [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Claim successful on node user
Aug 15 00:33:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Successfully created port: bcef2b29-872a-4cb1-9d3d-80fc04ee8254 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:33:22 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:33:22 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:33:22 user nova-compute[73010]: INFO nova.virt.block_device [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Booting with volume 8d30d7ee-53a5-48d3-8113-a5172c87455b at /dev/vda
Aug 15 00:33:22 user nova-compute[73010]: DEBUG os_brick.utils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc12607-98d5-42fa-b257-2d5f39aed0fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef34e631-d89a-49cb-9623-8511d01fa78b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3b9910-23d4-44ea-9669-7e32bdca014a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3be88ca-39df-4771-8da9-da375449ba02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:33:22 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:33:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebd51ec-8045-43e9-9a7d-4609dba52489]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG os_brick.utils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:33:22 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Updating existing volume attachment record: bac5f138-82df-46a5-98b4-1386599ede33 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:33:23 user nova-compute[73010]: DEBUG nova.policy [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61d907257ede4c1eb8a426a90b81abe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097516b3ada04de28f172aa5c3ff679f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:33:23 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Successfully created port: 592d1e12-5844-4034-bd24-c5882b4be109 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:33:24 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Successfully created port: 96202dd8-f6e5-436d-b8e7-1db0469cf513 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:33:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:25 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Successfully updated port: 4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:33:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-61855557-f222-46f2-ae73-87c681442a4c req-59939229-2adc-4e61-9c99-0d435bade7ca service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-changed-4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-61855557-f222-46f2-ae73-87c681442a4c req-59939229-2adc-4e61-9c99-0d435bade7ca service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Refreshing instance network info cache due to event network-changed-4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:33:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-61855557-f222-46f2-ae73-87c681442a4c req-59939229-2adc-4e61-9c99-0d435bade7ca service nova] Acquiring lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:33:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-61855557-f222-46f2-ae73-87c681442a4c req-59939229-2adc-4e61-9c99-0d435bade7ca service nova] Acquired lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:33:25 user nova-compute[73010]: DEBUG nova.network.neutron [req-61855557-f222-46f2-ae73-87c681442a4c req-59939229-2adc-4e61-9c99-0d435bade7ca service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Refreshing network info cache for port 4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:33:25 user nova-compute[73010]: DEBUG nova.network.neutron [req-61855557-f222-46f2-ae73-87c681442a4c req-59939229-2adc-4e61-9c99-0d435bade7ca service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:33:26 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Successfully created port: 03a34cb5-4d57-4c59-ba58-b162bf49daa3 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:33:26 user nova-compute[73010]: DEBUG nova.network.neutron [req-61855557-f222-46f2-ae73-87c681442a4c req-59939229-2adc-4e61-9c99-0d435bade7ca service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:33:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-61855557-f222-46f2-ae73-87c681442a4c req-59939229-2adc-4e61-9c99-0d435bade7ca service nova] Releasing lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:33:27 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Successfully updated port: 21837e06-6627-4156-8b30-7b1499f01b5d {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:33:27 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Successfully created port: fd5ce0a2-ca8e-422d-b36a-64006d1e8217 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:33:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-50524270-763c-407f-9877-4e3d035e17ee req-46c14242-7d36-4be5-845f-91e5fdeb49cc service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-changed-21837e06-6627-4156-8b30-7b1499f01b5d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-50524270-763c-407f-9877-4e3d035e17ee req-46c14242-7d36-4be5-845f-91e5fdeb49cc service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Refreshing instance network info cache due to event network-changed-21837e06-6627-4156-8b30-7b1499f01b5d. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:33:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-50524270-763c-407f-9877-4e3d035e17ee req-46c14242-7d36-4be5-845f-91e5fdeb49cc service nova] Acquiring lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:33:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-50524270-763c-407f-9877-4e3d035e17ee req-46c14242-7d36-4be5-845f-91e5fdeb49cc service nova] Acquired lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:33:28 user nova-compute[73010]: DEBUG nova.network.neutron [req-50524270-763c-407f-9877-4e3d035e17ee req-46c14242-7d36-4be5-845f-91e5fdeb49cc service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Refreshing network info cache for port 21837e06-6627-4156-8b30-7b1499f01b5d {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:33:28 user nova-compute[73010]: DEBUG nova.network.neutron [req-50524270-763c-407f-9877-4e3d035e17ee req-46c14242-7d36-4be5-845f-91e5fdeb49cc service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:33:28 user nova-compute[73010]: DEBUG nova.network.neutron [req-50524270-763c-407f-9877-4e3d035e17ee req-46c14242-7d36-4be5-845f-91e5fdeb49cc service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:33:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-50524270-763c-407f-9877-4e3d035e17ee req-46c14242-7d36-4be5-845f-91e5fdeb49cc service nova] Releasing lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:33:29 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Successfully created port: dc702c0a-c79d-48b8-8cc0-7bb18931b11d {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:33:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:29 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Successfully updated port: e45de596-2e5e-4306-a083-181d25a33abd {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:33:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:30 user nova-compute[73010]: INFO nova.virt.block_device [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Booting with volume 53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 at /dev/vdb
Aug 15 00:33:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-08cfc1c4-5580-4ee1-a37d-898e92609a15 req-7b2b7f33-7b03-465d-92bb-730146135759 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-changed-e45de596-2e5e-4306-a083-181d25a33abd {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-08cfc1c4-5580-4ee1-a37d-898e92609a15 req-7b2b7f33-7b03-465d-92bb-730146135759 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Refreshing instance network info cache due to event network-changed-e45de596-2e5e-4306-a083-181d25a33abd. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-08cfc1c4-5580-4ee1-a37d-898e92609a15 req-7b2b7f33-7b03-465d-92bb-730146135759 service nova] Acquiring lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-08cfc1c4-5580-4ee1-a37d-898e92609a15 req-7b2b7f33-7b03-465d-92bb-730146135759 service nova] Acquired lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG nova.network.neutron [req-08cfc1c4-5580-4ee1-a37d-898e92609a15 req-7b2b7f33-7b03-465d-92bb-730146135759 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Refreshing network info cache for port e45de596-2e5e-4306-a083-181d25a33abd {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG os_brick.utils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d8c003-194d-4501-bb78-92f88c428e5c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdeb0d08-3070-48af-8bdd-614c26f32a6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4db42c-db26-49f7-9b73-a11c7e9f3e93]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[25001312-541a-4803-b7de-ec0437f4be4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG nova.network.neutron [req-08cfc1c4-5580-4ee1-a37d-898e92609a15 req-7b2b7f33-7b03-465d-92bb-730146135759 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:33:30 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:33:30 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[96faad73-4d05-4ae4-83c6-6ecc30290a23]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG os_brick.utils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Updating existing volume attachment record: f2547c34-e0af-4a06-b21d-693ded7b9622 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:33:30 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Successfully created port: df67aaef-5bdd-4a5a-816b-c34392983877 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:33:31 user nova-compute[73010]: DEBUG nova.network.neutron [req-08cfc1c4-5580-4ee1-a37d-898e92609a15 req-7b2b7f33-7b03-465d-92bb-730146135759 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:33:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-08cfc1c4-5580-4ee1-a37d-898e92609a15 req-7b2b7f33-7b03-465d-92bb-730146135759 service nova] Releasing lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:33:31 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Successfully updated port: 6a7825db-198c-48a3-a587-07e565e7f151 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:33:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:32 user nova-compute[73010]: DEBUG nova.compute.manager [req-f80dd952-1234-46d8-8ddd-45c3b54ea45e req-73e39ec5-355e-4cd4-b759-6c4e7dfc7825 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-changed-6a7825db-198c-48a3-a587-07e565e7f151 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:32 user nova-compute[73010]: DEBUG nova.compute.manager [req-f80dd952-1234-46d8-8ddd-45c3b54ea45e req-73e39ec5-355e-4cd4-b759-6c4e7dfc7825 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Refreshing instance network info cache due to event network-changed-6a7825db-198c-48a3-a587-07e565e7f151. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:33:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f80dd952-1234-46d8-8ddd-45c3b54ea45e req-73e39ec5-355e-4cd4-b759-6c4e7dfc7825 service nova] Acquiring lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:33:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f80dd952-1234-46d8-8ddd-45c3b54ea45e req-73e39ec5-355e-4cd4-b759-6c4e7dfc7825 service nova] Acquired lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:33:32 user nova-compute[73010]: DEBUG nova.network.neutron [req-f80dd952-1234-46d8-8ddd-45c3b54ea45e req-73e39ec5-355e-4cd4-b759-6c4e7dfc7825 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Refreshing network info cache for port 6a7825db-198c-48a3-a587-07e565e7f151 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:33:32 user nova-compute[73010]: INFO nova.virt.block_device [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Booting with volume 6127b0fe-bc91-438d-8e0f-b465b3a2e246 at /dev/vdb
Aug 15 00:33:32 user nova-compute[73010]: DEBUG os_brick.utils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:33:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:32 user nova-compute[73010]: DEBUG nova.network.neutron [req-f80dd952-1234-46d8-8ddd-45c3b54ea45e req-73e39ec5-355e-4cd4-b759-6c4e7dfc7825 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:33:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ea9cd5-230a-45d1-a532-b57513290d99]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[66987e50-9854-42fb-8627-a64db745aa1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:33 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Successfully updated port: 96202dd8-f6e5-436d-b8e7-1db0469cf513 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:33:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:33 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f36492-cbed-4514-9a0f-468d7369ed39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:33 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[55284a7d-c2e1-455c-b6de-6caaf61e469e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:33:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:33:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:33:33 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:33:33 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e36c62e-0711-4052-8496-86f1812c1619]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:33:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:33:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:33:33 user nova-compute[73010]: DEBUG os_brick.utils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:33:33 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Updating existing volume attachment record: a66fe266-df58-4e63-b80c-1dc178eb1c9d {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:33:33 user nova-compute[73010]: DEBUG nova.network.neutron [req-f80dd952-1234-46d8-8ddd-45c3b54ea45e req-73e39ec5-355e-4cd4-b759-6c4e7dfc7825 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:33:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f80dd952-1234-46d8-8ddd-45c3b54ea45e req-73e39ec5-355e-4cd4-b759-6c4e7dfc7825 service nova] Releasing lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:33:33 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Successfully updated port: c0a7a8fb-96d7-4d75-9c81-bebe9861874d {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:33:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:34 user nova-compute[73010]: DEBUG nova.compute.manager [req-084deb9a-9b10-4804-afad-dca8f1024a23 req-37543fe6-ac6e-4534-ac2e-6c963eb70a58 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-changed-96202dd8-f6e5-436d-b8e7-1db0469cf513 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:34 user nova-compute[73010]: DEBUG nova.compute.manager [req-084deb9a-9b10-4804-afad-dca8f1024a23 req-37543fe6-ac6e-4534-ac2e-6c963eb70a58 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Refreshing instance network info cache due to event network-changed-96202dd8-f6e5-436d-b8e7-1db0469cf513. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:33:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-084deb9a-9b10-4804-afad-dca8f1024a23 req-37543fe6-ac6e-4534-ac2e-6c963eb70a58 service nova] Acquiring lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:33:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-084deb9a-9b10-4804-afad-dca8f1024a23 req-37543fe6-ac6e-4534-ac2e-6c963eb70a58 service nova] Acquired lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:33:34 user nova-compute[73010]: DEBUG nova.network.neutron [req-084deb9a-9b10-4804-afad-dca8f1024a23 req-37543fe6-ac6e-4534-ac2e-6c963eb70a58 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Refreshing network info cache for port 96202dd8-f6e5-436d-b8e7-1db0469cf513 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:33:34 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Successfully updated port: fb7932f3-05b0-4f25-b8f2-38cd50b29fd9 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:33:34 user nova-compute[73010]: DEBUG nova.network.neutron [req-084deb9a-9b10-4804-afad-dca8f1024a23 req-37543fe6-ac6e-4534-ac2e-6c963eb70a58 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:33:35 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Successfully updated port: bcef2b29-872a-4cb1-9d3d-80fc04ee8254 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:33:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:35 user nova-compute[73010]: DEBUG nova.network.neutron [req-084deb9a-9b10-4804-afad-dca8f1024a23 req-37543fe6-ac6e-4534-ac2e-6c963eb70a58 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:33:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-084deb9a-9b10-4804-afad-dca8f1024a23 req-37543fe6-ac6e-4534-ac2e-6c963eb70a58 service nova] Releasing lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:33:35 user nova-compute[73010]: DEBUG nova.compute.manager [req-084deb9a-9b10-4804-afad-dca8f1024a23 req-37543fe6-ac6e-4534-ac2e-6c963eb70a58 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-changed-c0a7a8fb-96d7-4d75-9c81-bebe9861874d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:35 user nova-compute[73010]: DEBUG nova.compute.manager [req-084deb9a-9b10-4804-afad-dca8f1024a23 req-37543fe6-ac6e-4534-ac2e-6c963eb70a58 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Refreshing instance network info cache due to event network-changed-c0a7a8fb-96d7-4d75-9c81-bebe9861874d. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:33:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-084deb9a-9b10-4804-afad-dca8f1024a23 req-37543fe6-ac6e-4534-ac2e-6c963eb70a58 service nova] Acquiring lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:33:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-084deb9a-9b10-4804-afad-dca8f1024a23 req-37543fe6-ac6e-4534-ac2e-6c963eb70a58 service nova] Acquired lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:33:35 user nova-compute[73010]: DEBUG nova.network.neutron [req-084deb9a-9b10-4804-afad-dca8f1024a23 req-37543fe6-ac6e-4534-ac2e-6c963eb70a58 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Refreshing network info cache for port c0a7a8fb-96d7-4d75-9c81-bebe9861874d {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:33:35 user nova-compute[73010]: DEBUG nova.network.neutron [req-084deb9a-9b10-4804-afad-dca8f1024a23 req-37543fe6-ac6e-4534-ac2e-6c963eb70a58 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:33:36 user nova-compute[73010]: DEBUG nova.network.neutron [req-084deb9a-9b10-4804-afad-dca8f1024a23 req-37543fe6-ac6e-4534-ac2e-6c963eb70a58 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:33:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-084deb9a-9b10-4804-afad-dca8f1024a23 req-37543fe6-ac6e-4534-ac2e-6c963eb70a58 service nova] Releasing lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:33:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:36 user nova-compute[73010]: DEBUG nova.compute.manager [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:33:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:36 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:33:36 user nova-compute[73010]: INFO nova.compute.claims [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Claim successful on node user
Aug 15 00:33:37 user nova-compute[73010]: DEBUG nova.compute.manager [req-e028660a-8e13-47e9-85a8-2cef1beaefc1 req-c057330c-f76e-441f-ac31-8c441cc19d8a service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-changed-fb7932f3-05b0-4f25-b8f2-38cd50b29fd9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG nova.compute.manager [req-e028660a-8e13-47e9-85a8-2cef1beaefc1 req-c057330c-f76e-441f-ac31-8c441cc19d8a service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Refreshing instance network info cache due to event network-changed-fb7932f3-05b0-4f25-b8f2-38cd50b29fd9. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e028660a-8e13-47e9-85a8-2cef1beaefc1 req-c057330c-f76e-441f-ac31-8c441cc19d8a service nova] Acquiring lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e028660a-8e13-47e9-85a8-2cef1beaefc1 req-c057330c-f76e-441f-ac31-8c441cc19d8a service nova] Acquired lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG nova.network.neutron [req-e028660a-8e13-47e9-85a8-2cef1beaefc1 req-c057330c-f76e-441f-ac31-8c441cc19d8a service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Refreshing network info cache for port fb7932f3-05b0-4f25-b8f2-38cd50b29fd9 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Successfully updated port: 1ba8ecd1-f3a8-460d-9f61-b15d9319d83f {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG nova.network.neutron [req-e028660a-8e13-47e9-85a8-2cef1beaefc1 req-c057330c-f76e-441f-ac31-8c441cc19d8a service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.615s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Successfully updated port: 592d1e12-5844-4034-bd24-c5882b4be109 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Acquiring lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Acquired lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG nova.network.neutron [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:33:37 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:33:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:33:37 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Creating image(s)
Aug 15 00:33:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "/opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "/opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG nova.network.neutron [req-e028660a-8e13-47e9-85a8-2cef1beaefc1 req-c057330c-f76e-441f-ac31-8c441cc19d8a service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG nova.policy [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '456d295a0dfd4e96848eb4e0ce9e5604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f162c9493416db7cfab122c4050af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e028660a-8e13-47e9-85a8-2cef1beaefc1 req-c057330c-f76e-441f-ac31-8c441cc19d8a service nova] Releasing lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG nova.compute.manager [req-e028660a-8e13-47e9-85a8-2cef1beaefc1 req-c057330c-f76e-441f-ac31-8c441cc19d8a service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-changed-bcef2b29-872a-4cb1-9d3d-80fc04ee8254 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG nova.compute.manager [req-e028660a-8e13-47e9-85a8-2cef1beaefc1 req-c057330c-f76e-441f-ac31-8c441cc19d8a service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Refreshing instance network info cache due to event network-changed-bcef2b29-872a-4cb1-9d3d-80fc04ee8254. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e028660a-8e13-47e9-85a8-2cef1beaefc1 req-c057330c-f76e-441f-ac31-8c441cc19d8a service nova] Acquiring lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.185s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.180s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk 1073741824" returned: 0 in 0.063s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.178s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:38 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:33:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:38 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Cannot resize image /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:33:38 user nova-compute[73010]: DEBUG nova.objects.instance [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lazy-loading 'migration_context' on Instance uuid e2410ee7-7351-460a-8d9c-47fe54e08c8b {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:33:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:33:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Ensure instance console log exists: /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:33:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:38 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Successfully updated port: 03a34cb5-4d57-4c59-ba58-b162bf49daa3 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:33:38 user nova-compute[73010]: DEBUG nova.network.neutron [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Successfully created port: 1ba74d11-2708-46c3-b73c-def3200202e4 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:33:39 user nova-compute[73010]: DEBUG nova.compute.manager [req-3d88c302-a88a-47ee-8a1f-37231de23b57 req-73d635b2-83bf-4380-8bd0-27cb7f018009 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-changed-1ba8ecd1-f3a8-460d-9f61-b15d9319d83f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:39 user nova-compute[73010]: DEBUG nova.compute.manager [req-3d88c302-a88a-47ee-8a1f-37231de23b57 req-73d635b2-83bf-4380-8bd0-27cb7f018009 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Refreshing instance network info cache due to event network-changed-1ba8ecd1-f3a8-460d-9f61-b15d9319d83f. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:33:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3d88c302-a88a-47ee-8a1f-37231de23b57 req-73d635b2-83bf-4380-8bd0-27cb7f018009 service nova] Acquiring lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:33:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3d88c302-a88a-47ee-8a1f-37231de23b57 req-73d635b2-83bf-4380-8bd0-27cb7f018009 service nova] Acquired lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:33:39 user nova-compute[73010]: DEBUG nova.network.neutron [req-3d88c302-a88a-47ee-8a1f-37231de23b57 req-73d635b2-83bf-4380-8bd0-27cb7f018009 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Refreshing network info cache for port 1ba8ecd1-f3a8-460d-9f61-b15d9319d83f {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:33:39 user nova-compute[73010]: DEBUG nova.network.neutron [req-3d88c302-a88a-47ee-8a1f-37231de23b57 req-73d635b2-83bf-4380-8bd0-27cb7f018009 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:33:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:39 user nova-compute[73010]: DEBUG nova.network.neutron [req-3d88c302-a88a-47ee-8a1f-37231de23b57 req-73d635b2-83bf-4380-8bd0-27cb7f018009 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:33:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3d88c302-a88a-47ee-8a1f-37231de23b57 req-73d635b2-83bf-4380-8bd0-27cb7f018009 service nova] Releasing lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:33:39 user nova-compute[73010]: DEBUG nova.compute.manager [req-3d88c302-a88a-47ee-8a1f-37231de23b57 req-73d635b2-83bf-4380-8bd0-27cb7f018009 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-changed-592d1e12-5844-4034-bd24-c5882b4be109 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:39 user nova-compute[73010]: DEBUG nova.compute.manager [req-3d88c302-a88a-47ee-8a1f-37231de23b57 req-73d635b2-83bf-4380-8bd0-27cb7f018009 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Refreshing instance network info cache due to event network-changed-592d1e12-5844-4034-bd24-c5882b4be109. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:33:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3d88c302-a88a-47ee-8a1f-37231de23b57 req-73d635b2-83bf-4380-8bd0-27cb7f018009 service nova] Acquiring lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:33:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.network.neutron [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Successfully updated port: 1ba74d11-2708-46c3-b73c-def3200202e4 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "refresh_cache-e2410ee7-7351-460a-8d9c-47fe54e08c8b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquired lock "refresh_cache-e2410ee7-7351-460a-8d9c-47fe54e08c8b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.network.neutron [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.compute.manager [req-41522925-599b-43f5-9d44-91a04528745b req-c3b06a1e-1d73-4372-9efe-778d7cc21e1e service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Received event network-changed-1ba74d11-2708-46c3-b73c-def3200202e4 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.compute.manager [req-41522925-599b-43f5-9d44-91a04528745b req-c3b06a1e-1d73-4372-9efe-778d7cc21e1e service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Refreshing instance network info cache due to event network-changed-1ba74d11-2708-46c3-b73c-def3200202e4. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-41522925-599b-43f5-9d44-91a04528745b req-c3b06a1e-1d73-4372-9efe-778d7cc21e1e service nova] Acquiring lock "refresh_cache-e2410ee7-7351-460a-8d9c-47fe54e08c8b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.network.neutron [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:40 user nova-compute[73010]: INFO nova.virt.block_device [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Booting with volume 10d37848-d45f-4801-ba89-4bff1ae2e44e at /dev/vdc
Aug 15 00:33:40 user nova-compute[73010]: DEBUG os_brick.utils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e63fb8-32a0-409a-8f9e-f0144d256c90]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb8675f-64bc-42c7-9996-1dbc00c3c2d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5274f805-0319-45fa-9303-9f30f349ece8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[df61149b-da18-47fc-902e-c8da4953e088]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:33:40 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:33:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce5a0c2-11ab-4df3-9ddb-f3a54b0eee91]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG os_brick.utils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Updating existing volume attachment record: 0d3861f9-7c73-4ff6-90d7-eebf3da28bff {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.network.neutron [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Updating instance_info_cache with network_info: [{"id": "1ba74d11-2708-46c3-b73c-def3200202e4", "address": "fa:16:3e:c5:b2:68", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba74d11-27", "ovs_interfaceid": "1ba74d11-2708-46c3-b73c-def3200202e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Releasing lock "refresh_cache-e2410ee7-7351-460a-8d9c-47fe54e08c8b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.compute.manager [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Instance network_info: |[{"id": "1ba74d11-2708-46c3-b73c-def3200202e4", "address": "fa:16:3e:c5:b2:68", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba74d11-27", "ovs_interfaceid": "1ba74d11-2708-46c3-b73c-def3200202e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-41522925-599b-43f5-9d44-91a04528745b req-c3b06a1e-1d73-4372-9efe-778d7cc21e1e service nova] Acquired lock "refresh_cache-e2410ee7-7351-460a-8d9c-47fe54e08c8b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.network.neutron [req-41522925-599b-43f5-9d44-91a04528745b req-c3b06a1e-1d73-4372-9efe-778d7cc21e1e service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Refreshing network info cache for port 1ba74d11-2708-46c3-b73c-def3200202e4 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Start _get_guest_xml network_info=[{"id": "1ba74d11-2708-46c3-b73c-def3200202e4", "address": "fa:16:3e:c5:b2:68", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba74d11-27", "ovs_interfaceid": "1ba74d11-2708-46c3-b73c-def3200202e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:33:40 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:33:40 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-94659044',display_name='tempest-TestStampPattern-server-94659044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-94659044',id=11,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrgFYRcqv6WgRdkBOunRQ1m/LgpwWxam7rDA0+KqfC3W5QB65YWRrvkhgBL/Sf+IJhFzjvTZJIwpzP4EtbE6dhqqF6WJsQneEfsmdXlIDI2l5CiQq/L0gFEvj2zfmLvMA==',key_name='tempest-TestStampPattern-362830252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d0f162c9493416db7cfab122c4050af',ramdisk_id='',reservation_id='r-clyy18qi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1617621274',owner_user_name='tempest-TestStampPattern-1617621274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:37Z,user_data=None,user_id='456d295a0dfd4e96848eb4e0ce9e5604',uuid=e2410ee7-7351-460a-8d9c-47fe54e08c8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ba74d11-2708-46c3-b73c-def3200202e4", "address": "fa:16:3e:c5:b2:68", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba74d11-27", "ovs_interfaceid": "1ba74d11-2708-46c3-b73c-def3200202e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Converting VIF {"id": "1ba74d11-2708-46c3-b73c-def3200202e4", "address": "fa:16:3e:c5:b2:68", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba74d11-27", "ovs_interfaceid": "1ba74d11-2708-46c3-b73c-def3200202e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:b2:68,bridge_name='br-int',has_traffic_filtering=True,id=1ba74d11-2708-46c3-b73c-def3200202e4,network=Network(a0e0995e-1753-4a7a-825f-76c1938b2d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ba74d11-27') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.objects.instance [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lazy-loading 'pci_devices' on Instance uuid e2410ee7-7351-460a-8d9c-47fe54e08c8b {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:33:40 user nova-compute[73010]:   <uuid>e2410ee7-7351-460a-8d9c-47fe54e08c8b</uuid>
Aug 15 00:33:40 user nova-compute[73010]:   <name>instance-0000000b</name>
Aug 15 00:33:40 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:33:40 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:33:40 user nova-compute[73010]:   <metadata>
Aug 15 00:33:40 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:33:40 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:33:40 user nova-compute[73010]:       <nova:name>tempest-TestStampPattern-server-94659044</nova:name>
Aug 15 00:33:40 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:33:40</nova:creationTime>
Aug 15 00:33:40 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:33:40 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:33:40 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:33:40 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:33:40 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:33:40 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:33:40 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:33:40 user nova-compute[73010]:       <nova:owner>
Aug 15 00:33:40 user nova-compute[73010]:         <nova:user uuid="456d295a0dfd4e96848eb4e0ce9e5604">tempest-TestStampPattern-1617621274-project-member</nova:user>
Aug 15 00:33:40 user nova-compute[73010]:         <nova:project uuid="9d0f162c9493416db7cfab122c4050af">tempest-TestStampPattern-1617621274</nova:project>
Aug 15 00:33:40 user nova-compute[73010]:       </nova:owner>
Aug 15 00:33:40 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:33:40 user nova-compute[73010]:       <nova:ports>
Aug 15 00:33:40 user nova-compute[73010]:         <nova:port uuid="1ba74d11-2708-46c3-b73c-def3200202e4">
Aug 15 00:33:40 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 00:33:40 user nova-compute[73010]:         </nova:port>
Aug 15 00:33:40 user nova-compute[73010]:       </nova:ports>
Aug 15 00:33:40 user nova-compute[73010]:     </nova:instance>
Aug 15 00:33:40 user nova-compute[73010]:   </metadata>
Aug 15 00:33:40 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:33:40 user nova-compute[73010]:     <system>
Aug 15 00:33:40 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:33:40 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:33:40 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:33:40 user nova-compute[73010]:       <entry name="serial">e2410ee7-7351-460a-8d9c-47fe54e08c8b</entry>
Aug 15 00:33:40 user nova-compute[73010]:       <entry name="uuid">e2410ee7-7351-460a-8d9c-47fe54e08c8b</entry>
Aug 15 00:33:40 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:33:40 user nova-compute[73010]:     </system>
Aug 15 00:33:40 user nova-compute[73010]:   </sysinfo>
Aug 15 00:33:40 user nova-compute[73010]:   <os>
Aug 15 00:33:40 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:33:40 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:33:40 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:33:40 user nova-compute[73010]:   </os>
Aug 15 00:33:40 user nova-compute[73010]:   <features>
Aug 15 00:33:40 user nova-compute[73010]:     <acpi/>
Aug 15 00:33:40 user nova-compute[73010]:     <apic/>
Aug 15 00:33:40 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:33:40 user nova-compute[73010]:   </features>
Aug 15 00:33:40 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:33:40 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:33:40 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:33:40 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:33:40 user nova-compute[73010]:   </clock>
Aug 15 00:33:40 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:33:40 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:33:40 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:33:40 user nova-compute[73010]:   </cpu>
Aug 15 00:33:40 user nova-compute[73010]:   <devices>
Aug 15 00:33:40 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:33:40 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:33:40 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk"/>
Aug 15 00:33:40 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:33:40 user nova-compute[73010]:     </disk>
Aug 15 00:33:40 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:33:40 user nova-compute[73010]:       <mac address="fa:16:3e:c5:b2:68"/>
Aug 15 00:33:40 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:33:40 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:33:40 user nova-compute[73010]:       <target dev="tap1ba74d11-27"/>
Aug 15 00:33:40 user nova-compute[73010]:     </interface>
Aug 15 00:33:40 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:33:40 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/console.log" append="off"/>
Aug 15 00:33:40 user nova-compute[73010]:     </serial>
Aug 15 00:33:40 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:33:40 user nova-compute[73010]:     <video>
Aug 15 00:33:40 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:33:40 user nova-compute[73010]:     </video>
Aug 15 00:33:40 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:33:40 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:33:40 user nova-compute[73010]:     </rng>
Aug 15 00:33:40 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:33:40 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:33:40 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:33:40 user nova-compute[73010]:     </memballoon>
Aug 15 00:33:40 user nova-compute[73010]:   </devices>
Aug 15 00:33:40 user nova-compute[73010]: </domain>
Aug 15 00:33:40 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-94659044',display_name='tempest-TestStampPattern-server-94659044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-94659044',id=11,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrgFYRcqv6WgRdkBOunRQ1m/LgpwWxam7rDA0+KqfC3W5QB65YWRrvkhgBL/Sf+IJhFzjvTZJIwpzP4EtbE6dhqqF6WJsQneEfsmdXlIDI2l5CiQq/L0gFEvj2zfmLvMA==',key_name='tempest-TestStampPattern-362830252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d0f162c9493416db7cfab122c4050af',ramdisk_id='',reservation_id='r-clyy18qi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1617621274',owner_user_name='tempest-TestStampPattern-1617621274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:37Z,user_data=None,user_id='456d295a0dfd4e96848eb4e0ce9e5604',uuid=e2410ee7-7351-460a-8d9c-47fe54e08c8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ba74d11-2708-46c3-b73c-def3200202e4", "address": "fa:16:3e:c5:b2:68", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba74d11-27", "ovs_interfaceid": "1ba74d11-2708-46c3-b73c-def3200202e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Converting VIF {"id": "1ba74d11-2708-46c3-b73c-def3200202e4", "address": "fa:16:3e:c5:b2:68", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba74d11-27", "ovs_interfaceid": "1ba74d11-2708-46c3-b73c-def3200202e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:b2:68,bridge_name='br-int',has_traffic_filtering=True,id=1ba74d11-2708-46c3-b73c-def3200202e4,network=Network(a0e0995e-1753-4a7a-825f-76c1938b2d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ba74d11-27') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG os_vif [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:b2:68,bridge_name='br-int',has_traffic_filtering=True,id=1ba74d11-2708-46c3-b73c-def3200202e4,network=Network(a0e0995e-1753-4a7a-825f-76c1938b2d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ba74d11-27') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ba74d11-27, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ba74d11-27, col_values=(('external_ids', {'iface-id': '1ba74d11-2708-46c3-b73c-def3200202e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:b2:68', 'vm-uuid': 'e2410ee7-7351-460a-8d9c-47fe54e08c8b'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:33:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:40 user nova-compute[73010]: INFO os_vif [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:b2:68,bridge_name='br-int',has_traffic_filtering=True,id=1ba74d11-2708-46c3-b73c-def3200202e4,network=Network(a0e0995e-1753-4a7a-825f-76c1938b2d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ba74d11-27')
Aug 15 00:33:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:33:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] No VIF found with MAC fa:16:3e:c5:b2:68, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:33:41 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Successfully updated port: fd5ce0a2-ca8e-422d-b36a-64006d1e8217 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:33:41 user nova-compute[73010]: DEBUG nova.network.neutron [req-41522925-599b-43f5-9d44-91a04528745b req-c3b06a1e-1d73-4372-9efe-778d7cc21e1e service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Updated VIF entry in instance network info cache for port 1ba74d11-2708-46c3-b73c-def3200202e4. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:33:41 user nova-compute[73010]: DEBUG nova.network.neutron [req-41522925-599b-43f5-9d44-91a04528745b req-c3b06a1e-1d73-4372-9efe-778d7cc21e1e service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Updating instance_info_cache with network_info: [{"id": "1ba74d11-2708-46c3-b73c-def3200202e4", "address": "fa:16:3e:c5:b2:68", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba74d11-27", "ovs_interfaceid": "1ba74d11-2708-46c3-b73c-def3200202e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:33:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-e5a5ac0e-f97c-4965-8aab-4dad4ba89e82 req-58990f59-e599-479f-93cc-87cc0c189d64 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-changed-fd5ce0a2-ca8e-422d-b36a-64006d1e8217 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-e5a5ac0e-f97c-4965-8aab-4dad4ba89e82 req-58990f59-e599-479f-93cc-87cc0c189d64 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Refreshing instance network info cache due to event network-changed-fd5ce0a2-ca8e-422d-b36a-64006d1e8217. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:33:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e5a5ac0e-f97c-4965-8aab-4dad4ba89e82 req-58990f59-e599-479f-93cc-87cc0c189d64 service nova] Acquiring lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:33:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e5a5ac0e-f97c-4965-8aab-4dad4ba89e82 req-58990f59-e599-479f-93cc-87cc0c189d64 service nova] Acquired lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:33:41 user nova-compute[73010]: DEBUG nova.network.neutron [req-e5a5ac0e-f97c-4965-8aab-4dad4ba89e82 req-58990f59-e599-479f-93cc-87cc0c189d64 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Refreshing network info cache for port fd5ce0a2-ca8e-422d-b36a-64006d1e8217 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:33:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-41522925-599b-43f5-9d44-91a04528745b req-c3b06a1e-1d73-4372-9efe-778d7cc21e1e service nova] Releasing lock "refresh_cache-e2410ee7-7351-460a-8d9c-47fe54e08c8b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:33:41 user nova-compute[73010]: DEBUG nova.network.neutron [req-e5a5ac0e-f97c-4965-8aab-4dad4ba89e82 req-58990f59-e599-479f-93cc-87cc0c189d64 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:33:41 user nova-compute[73010]: DEBUG nova.network.neutron [req-e5a5ac0e-f97c-4965-8aab-4dad4ba89e82 req-58990f59-e599-479f-93cc-87cc0c189d64 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:33:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e5a5ac0e-f97c-4965-8aab-4dad4ba89e82 req-58990f59-e599-479f-93cc-87cc0c189d64 service nova] Releasing lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:33:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:42 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Updating instance_info_cache with network_info: [{"id": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "address": "fa:16:3e:b2:cf:d1", "network": {"id": "fb9d1b69-d351-4867-b15a-09c90bf7c5e4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934474624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe2f2c5-f6", "ovs_interfaceid": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21837e06-6627-4156-8b30-7b1499f01b5d", "address": "fa:16:3e:0a:9f:40", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21837e06-66", "ovs_interfaceid": "21837e06-6627-4156-8b30-7b1499f01b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e45de596-2e5e-4306-a083-181d25a33abd", "address": "fa:16:3e:cb:9c:b6", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45de596-2e", "ovs_interfaceid": "e45de596-2e5e-4306-a083-181d25a33abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a7825db-198c-48a3-a587-07e565e7f151", "address": "fa:16:3e:38:fe:95", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7825db-19", "ovs_interfaceid": "6a7825db-198c-48a3-a587-07e565e7f151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "address": "fa:16:3e:4b:5b:ed", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a7a8fb-96", "ovs_interfaceid": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "address": "fa:16:3e:20:58:5d", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcef2b29-87", "ovs_interfaceid": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "592d1e12-5844-4034-bd24-c5882b4be109", "address": "fa:16:3e:c2:dd:0f", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592d1e12-58", "ovs_interfaceid": "592d1e12-5844-4034-bd24-c5882b4be109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:33:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Releasing lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:33:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Instance network_info: |[{"id": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "address": "fa:16:3e:b2:cf:d1", "network": {"id": "fb9d1b69-d351-4867-b15a-09c90bf7c5e4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934474624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe2f2c5-f6", "ovs_interfaceid": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21837e06-6627-4156-8b30-7b1499f01b5d", "address": "fa:16:3e:0a:9f:40", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21837e06-66", "ovs_interfaceid": "21837e06-6627-4156-8b30-7b1499f01b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e45de596-2e5e-4306-a083-181d25a33abd", "address": "fa:16:3e:cb:9c:b6", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45de596-2e", "ovs_interfaceid": "e45de596-2e5e-4306-a083-181d25a33abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a7825db-198c-48a3-a587-07e565e7f151", "address": "fa:16:3e:38:fe:95", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7825db-19", "ovs_interfaceid": "6a7825db-198c-48a3-a587-07e565e7f151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "address": "fa:16:3e:4b:5b:ed", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a7a8fb-96", "ovs_interfaceid": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "address": "fa:16:3e:20:58:5d", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcef2b29-87", "ovs_interfaceid": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "592d1e12-5844-4034-bd24-c5882b4be109", "address": "fa:16:3e:c2:dd:0f", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592d1e12-58", "ovs_interfaceid": "592d1e12-5844-4034-bd24-c5882b4be109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:33:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e028660a-8e13-47e9-85a8-2cef1beaefc1 req-c057330c-f76e-441f-ac31-8c441cc19d8a service nova] Acquired lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:33:42 user nova-compute[73010]: DEBUG nova.network.neutron [req-e028660a-8e13-47e9-85a8-2cef1beaefc1 req-c057330c-f76e-441f-ac31-8c441cc19d8a service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Refreshing network info cache for port bcef2b29-872a-4cb1-9d3d-80fc04ee8254 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:33:42 user nova-compute[73010]: DEBUG nova.compute.manager [req-458da914-3324-4056-8aaa-5ff7e55ee51c req-3fe4535b-d91b-49c8-b695-65e6460d7368 service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Received event network-vif-plugged-1ba74d11-2708-46c3-b73c-def3200202e4 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-458da914-3324-4056-8aaa-5ff7e55ee51c req-3fe4535b-d91b-49c8-b695-65e6460d7368 service nova] Acquiring lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-458da914-3324-4056-8aaa-5ff7e55ee51c req-3fe4535b-d91b-49c8-b695-65e6460d7368 service nova] Lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-458da914-3324-4056-8aaa-5ff7e55ee51c req-3fe4535b-d91b-49c8-b695-65e6460d7368 service nova] Lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:42 user nova-compute[73010]: DEBUG nova.compute.manager [req-458da914-3324-4056-8aaa-5ff7e55ee51c req-3fe4535b-d91b-49c8-b695-65e6460d7368 service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] No waiting events found dispatching network-vif-plugged-1ba74d11-2708-46c3-b73c-def3200202e4 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:33:42 user nova-compute[73010]: WARNING nova.compute.manager [req-458da914-3324-4056-8aaa-5ff7e55ee51c req-3fe4535b-d91b-49c8-b695-65e6460d7368 service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Received unexpected event network-vif-plugged-1ba74d11-2708-46c3-b73c-def3200202e4 for instance with vm_state building and task_state spawning.
Aug 15 00:33:42 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Successfully updated port: dc702c0a-c79d-48b8-8cc0-7bb18931b11d {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:33:43 user nova-compute[73010]: INFO nova.virt.block_device [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Booting with volume 57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f at /dev/vdc
Aug 15 00:33:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG os_brick.utils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d085052-c1d9-49cd-bbdb-8b0392e48bb2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[459764a5-addd-4146-bcc7-9c0afba306bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef05293a-b420-47fa-9086-38f4d4fd5858]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7aa64b-7bfb-4fac-a4c2-ac63f3a2c70f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG nova.network.neutron [req-e028660a-8e13-47e9-85a8-2cef1beaefc1 req-c057330c-f76e-441f-ac31-8c441cc19d8a service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Updated VIF entry in instance network info cache for port bcef2b29-872a-4cb1-9d3d-80fc04ee8254. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG nova.network.neutron [req-e028660a-8e13-47e9-85a8-2cef1beaefc1 req-c057330c-f76e-441f-ac31-8c441cc19d8a service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Updating instance_info_cache with network_info: [{"id": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "address": "fa:16:3e:b2:cf:d1", "network": {"id": "fb9d1b69-d351-4867-b15a-09c90bf7c5e4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934474624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe2f2c5-f6", "ovs_interfaceid": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21837e06-6627-4156-8b30-7b1499f01b5d", "address": "fa:16:3e:0a:9f:40", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21837e06-66", "ovs_interfaceid": "21837e06-6627-4156-8b30-7b1499f01b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e45de596-2e5e-4306-a083-181d25a33abd", "address": "fa:16:3e:cb:9c:b6", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45de596-2e", "ovs_interfaceid": "e45de596-2e5e-4306-a083-181d25a33abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a7825db-198c-48a3-a587-07e565e7f151", "address": "fa:16:3e:38:fe:95", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7825db-19", "ovs_interfaceid": "6a7825db-198c-48a3-a587-07e565e7f151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "address": "fa:16:3e:4b:5b:ed", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a7a8fb-96", "ovs_interfaceid": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "address": "fa:16:3e:20:58:5d", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcef2b29-87", "ovs_interfaceid": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "592d1e12-5844-4034-bd24-c5882b4be109", "address": "fa:16:3e:c2:dd:0f", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592d1e12-58", "ovs_interfaceid": "592d1e12-5844-4034-bd24-c5882b4be109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:33:43 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:33:43 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a61335-ff2f-4986-ad28-56e6dd108730]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG os_brick.utils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Updating existing volume attachment record: d2f14494-05e3-4f7b-9746-bc4bc14786c0 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e028660a-8e13-47e9-85a8-2cef1beaefc1 req-c057330c-f76e-441f-ac31-8c441cc19d8a service nova] Releasing lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3d88c302-a88a-47ee-8a1f-37231de23b57 req-73d635b2-83bf-4380-8bd0-27cb7f018009 service nova] Acquired lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG nova.network.neutron [req-3d88c302-a88a-47ee-8a1f-37231de23b57 req-73d635b2-83bf-4380-8bd0-27cb7f018009 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Refreshing network info cache for port 592d1e12-5844-4034-bd24-c5882b4be109 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG nova.compute.manager [req-02c72157-48bb-4481-90e8-376c7e7c1bad req-712de58e-b23e-4e80-b87d-2b9ae2eede9a service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-changed-dc702c0a-c79d-48b8-8cc0-7bb18931b11d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG nova.compute.manager [req-02c72157-48bb-4481-90e8-376c7e7c1bad req-712de58e-b23e-4e80-b87d-2b9ae2eede9a service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Refreshing instance network info cache due to event network-changed-dc702c0a-c79d-48b8-8cc0-7bb18931b11d. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-02c72157-48bb-4481-90e8-376c7e7c1bad req-712de58e-b23e-4e80-b87d-2b9ae2eede9a service nova] Acquiring lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-02c72157-48bb-4481-90e8-376c7e7c1bad req-712de58e-b23e-4e80-b87d-2b9ae2eede9a service nova] Acquired lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG nova.network.neutron [req-02c72157-48bb-4481-90e8-376c7e7c1bad req-712de58e-b23e-4e80-b87d-2b9ae2eede9a service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Refreshing network info cache for port dc702c0a-c79d-48b8-8cc0-7bb18931b11d {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG nova.network.neutron [req-02c72157-48bb-4481-90e8-376c7e7c1bad req-712de58e-b23e-4e80-b87d-2b9ae2eede9a service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG nova.network.neutron [req-02c72157-48bb-4481-90e8-376c7e7c1bad req-712de58e-b23e-4e80-b87d-2b9ae2eede9a service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:33:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-02c72157-48bb-4481-90e8-376c7e7c1bad req-712de58e-b23e-4e80-b87d-2b9ae2eede9a service nova] Releasing lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.network.neutron [req-3d88c302-a88a-47ee-8a1f-37231de23b57 req-73d635b2-83bf-4380-8bd0-27cb7f018009 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Updated VIF entry in instance network info cache for port 592d1e12-5844-4034-bd24-c5882b4be109. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.network.neutron [req-3d88c302-a88a-47ee-8a1f-37231de23b57 req-73d635b2-83bf-4380-8bd0-27cb7f018009 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Updating instance_info_cache with network_info: [{"id": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "address": "fa:16:3e:b2:cf:d1", "network": {"id": "fb9d1b69-d351-4867-b15a-09c90bf7c5e4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934474624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe2f2c5-f6", "ovs_interfaceid": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21837e06-6627-4156-8b30-7b1499f01b5d", "address": "fa:16:3e:0a:9f:40", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21837e06-66", "ovs_interfaceid": "21837e06-6627-4156-8b30-7b1499f01b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e45de596-2e5e-4306-a083-181d25a33abd", "address": "fa:16:3e:cb:9c:b6", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45de596-2e", "ovs_interfaceid": "e45de596-2e5e-4306-a083-181d25a33abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a7825db-198c-48a3-a587-07e565e7f151", "address": "fa:16:3e:38:fe:95", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7825db-19", "ovs_interfaceid": "6a7825db-198c-48a3-a587-07e565e7f151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "address": "fa:16:3e:4b:5b:ed", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a7a8fb-96", "ovs_interfaceid": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "address": "fa:16:3e:20:58:5d", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcef2b29-87", "ovs_interfaceid": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "592d1e12-5844-4034-bd24-c5882b4be109", "address": "fa:16:3e:c2:dd:0f", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592d1e12-58", "ovs_interfaceid": "592d1e12-5844-4034-bd24-c5882b4be109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3d88c302-a88a-47ee-8a1f-37231de23b57 req-73d635b2-83bf-4380-8bd0-27cb7f018009 service nova] Releasing lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.compute.manager [req-3d88c302-a88a-47ee-8a1f-37231de23b57 req-73d635b2-83bf-4380-8bd0-27cb7f018009 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-changed-03a34cb5-4d57-4c59-ba58-b162bf49daa3 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.compute.manager [req-3d88c302-a88a-47ee-8a1f-37231de23b57 req-73d635b2-83bf-4380-8bd0-27cb7f018009 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Refreshing instance network info cache due to event network-changed-03a34cb5-4d57-4c59-ba58-b162bf49daa3. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3d88c302-a88a-47ee-8a1f-37231de23b57 req-73d635b2-83bf-4380-8bd0-27cb7f018009 service nova] Acquiring lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3d88c302-a88a-47ee-8a1f-37231de23b57 req-73d635b2-83bf-4380-8bd0-27cb7f018009 service nova] Acquired lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.network.neutron [req-3d88c302-a88a-47ee-8a1f-37231de23b57 req-73d635b2-83bf-4380-8bd0-27cb7f018009 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Refreshing network info cache for port 03a34cb5-4d57-4c59-ba58-b162bf49daa3 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.network.neutron [req-3d88c302-a88a-47ee-8a1f-37231de23b57 req-73d635b2-83bf-4380-8bd0-27cb7f018009 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059624.6669319, e2410ee7-7351-460a-8d9c-47fe54e08c8b => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:33:44 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] VM Resumed (Lifecycle Event)
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.compute.manager [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:33:44 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Instance spawned successfully.
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:33:44 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059624.6848466, e2410ee7-7351-460a-8d9c-47fe54e08c8b => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:33:44 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] VM Started (Lifecycle Event)
Aug 15 00:33:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba131ea-c646-4719-b85a-5fc021555fcc/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.compute.manager [req-3f4642c3-d22c-45af-a407-ff5357ff2396 req-8934cf7d-2b92-4c33-ad23-355bca02d470 service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Received event network-vif-plugged-1ba74d11-2708-46c3-b73c-def3200202e4 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3f4642c3-d22c-45af-a407-ff5357ff2396 req-8934cf7d-2b92-4c33-ad23-355bca02d470 service nova] Acquiring lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3f4642c3-d22c-45af-a407-ff5357ff2396 req-8934cf7d-2b92-4c33-ad23-355bca02d470 service nova] Lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3f4642c3-d22c-45af-a407-ff5357ff2396 req-8934cf7d-2b92-4c33-ad23-355bca02d470 service nova] Lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.compute.manager [req-3f4642c3-d22c-45af-a407-ff5357ff2396 req-8934cf7d-2b92-4c33-ad23-355bca02d470 service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] No waiting events found dispatching network-vif-plugged-1ba74d11-2708-46c3-b73c-def3200202e4 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:33:44 user nova-compute[73010]: WARNING nova.compute.manager [req-3f4642c3-d22c-45af-a407-ff5357ff2396 req-8934cf7d-2b92-4c33-ad23-355bca02d470 service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Received unexpected event network-vif-plugged-1ba74d11-2708-46c3-b73c-def3200202e4 for instance with vm_state building and task_state spawning.
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Successfully updated port: df67aaef-5bdd-4a5a-816b-c34392983877 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:33:44 user nova-compute[73010]: INFO nova.compute.manager [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Took 7.37 seconds to spawn the instance on the hypervisor.
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.compute.manager [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Acquiring lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:33:44 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:33:44 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:33:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba131ea-c646-4719-b85a-5fc021555fcc/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:44 user nova-compute[73010]: INFO nova.compute.manager [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Took 8.37 seconds to build instance.
Aug 15 00:33:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba131ea-c646-4719-b85a-5fc021555fcc/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e06012f5-6b05-4129-9f3b-b6093b2bea64 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.513s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:45 user nova-compute[73010]: DEBUG nova.network.neutron [req-3d88c302-a88a-47ee-8a1f-37231de23b57 req-73d635b2-83bf-4380-8bd0-27cb7f018009 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:33:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3d88c302-a88a-47ee-8a1f-37231de23b57 req-73d635b2-83bf-4380-8bd0-27cb7f018009 service nova] Releasing lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:33:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Acquired lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:33:45 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:33:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba131ea-c646-4719-b85a-5fc021555fcc/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:45 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:33:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0627dc52-eca1-48b3-ab8c-c612629a1db2/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:45 user nova-compute[73010]: DEBUG nova.compute.manager [req-6ec82fe4-d785-45f4-b2a3-f08756fbb352 req-c41e5e5a-595e-4635-af4a-f6b31d35dce0 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-changed-df67aaef-5bdd-4a5a-816b-c34392983877 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:45 user nova-compute[73010]: DEBUG nova.compute.manager [req-6ec82fe4-d785-45f4-b2a3-f08756fbb352 req-c41e5e5a-595e-4635-af4a-f6b31d35dce0 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Refreshing instance network info cache due to event network-changed-df67aaef-5bdd-4a5a-816b-c34392983877. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:33:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6ec82fe4-d785-45f4-b2a3-f08756fbb352 req-c41e5e5a-595e-4635-af4a-f6b31d35dce0 service nova] Acquiring lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:33:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0627dc52-eca1-48b3-ab8c-c612629a1db2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0627dc52-eca1-48b3-ab8c-c612629a1db2/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0627dc52-eca1-48b3-ab8c-c612629a1db2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:48 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Updating instance_info_cache with network_info: [{"id": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "address": "fa:16:3e:c8:c9:ad", "network": {"id": "7cec561d-d6de-48e3-ab40-d9bff06a031e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1980904641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96202dd8-f6", "ovs_interfaceid": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "address": "fa:16:3e:ee:92:2f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7932f3-05", "ovs_interfaceid": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "address": "fa:16:3e:b7:0b:5e", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba8ecd1-f3", "ovs_interfaceid": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "address": "fa:16:3e:f8:e5:9f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34cb5-4d", "ovs_interfaceid": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd5ce0a2-ca8e-422d-b36a-64006d1e8217", "address": "fa:16:3e:8d:8b:3f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5ce0a2-ca", "ovs_interfaceid": "fd5ce0a2-ca8e-422d-b36a-64006d1e8217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc702c0a-c79d-48b8-8cc0-7bb18931b11d", "address": "fa:16:3e:69:12:14", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc702c0a-c7", "ovs_interfaceid": "dc702c0a-c79d-48b8-8cc0-7bb18931b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df67aaef-5bdd-4a5a-816b-c34392983877", "address": "fa:16:3e:cb:39:d3", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf67aaef-5b", "ovs_interfaceid": "df67aaef-5bdd-4a5a-816b-c34392983877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:33:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Releasing lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:33:48 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Instance network_info: |[{"id": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "address": "fa:16:3e:c8:c9:ad", "network": {"id": "7cec561d-d6de-48e3-ab40-d9bff06a031e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1980904641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96202dd8-f6", "ovs_interfaceid": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "address": "fa:16:3e:ee:92:2f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7932f3-05", "ovs_interfaceid": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "address": "fa:16:3e:b7:0b:5e", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba8ecd1-f3", "ovs_interfaceid": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "address": "fa:16:3e:f8:e5:9f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34cb5-4d", "ovs_interfaceid": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd5ce0a2-ca8e-422d-b36a-64006d1e8217", "address": "fa:16:3e:8d:8b:3f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5ce0a2-ca", "ovs_interfaceid": "fd5ce0a2-ca8e-422d-b36a-64006d1e8217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc702c0a-c79d-48b8-8cc0-7bb18931b11d", "address": "fa:16:3e:69:12:14", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc702c0a-c7", "ovs_interfaceid": "dc702c0a-c79d-48b8-8cc0-7bb18931b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df67aaef-5bdd-4a5a-816b-c34392983877", "address": "fa:16:3e:cb:39:d3", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf67aaef-5b", "ovs_interfaceid": "df67aaef-5bdd-4a5a-816b-c34392983877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:33:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6ec82fe4-d785-45f4-b2a3-f08756fbb352 req-c41e5e5a-595e-4635-af4a-f6b31d35dce0 service nova] Acquired lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:33:48 user nova-compute[73010]: DEBUG nova.network.neutron [req-6ec82fe4-d785-45f4-b2a3-f08756fbb352 req-c41e5e5a-595e-4635-af4a-f6b31d35dce0 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Refreshing network info cache for port df67aaef-5bdd-4a5a-816b-c34392983877 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:33:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:49 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:33:49 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:33:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=7120MB free_disk=25.860774993896484GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:33:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 1ba131ea-c646-4719-b85a-5fc021555fcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:33:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 983577b5-4abb-4280-b8e8-a63f42d8f796 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:33:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance afcd0a05-e035-492e-9fbe-cd63f4c3ea42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:33:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 0588a46c-2314-47e3-b984-1e04518e8a63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:33:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance eabef054-b50f-4a34-a501-eb1b991d76af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:33:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance de9297d8-10e8-4244-b25d-54d4c2a83aea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:33:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance b1d5a938-3f1e-4e8c-bdda-0786d4e27d98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:33:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 0627dc52-eca1-48b3-ab8c-c612629a1db2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:33:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 17237e56-67eb-4a05-b004-d27dacc8e04b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:33:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:33:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance e2410ee7-7351-460a-8d9c-47fe54e08c8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:33:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:33:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:33:49 user nova-compute[73010]: DEBUG nova.network.neutron [req-6ec82fe4-d785-45f4-b2a3-f08756fbb352 req-c41e5e5a-595e-4635-af4a-f6b31d35dce0 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Updated VIF entry in instance network info cache for port df67aaef-5bdd-4a5a-816b-c34392983877. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:33:49 user nova-compute[73010]: DEBUG nova.network.neutron [req-6ec82fe4-d785-45f4-b2a3-f08756fbb352 req-c41e5e5a-595e-4635-af4a-f6b31d35dce0 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Updating instance_info_cache with network_info: [{"id": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "address": "fa:16:3e:c8:c9:ad", "network": {"id": "7cec561d-d6de-48e3-ab40-d9bff06a031e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1980904641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96202dd8-f6", "ovs_interfaceid": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "address": "fa:16:3e:ee:92:2f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7932f3-05", "ovs_interfaceid": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "address": "fa:16:3e:b7:0b:5e", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba8ecd1-f3", "ovs_interfaceid": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "address": "fa:16:3e:f8:e5:9f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34cb5-4d", "ovs_interfaceid": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd5ce0a2-ca8e-422d-b36a-64006d1e8217", "address": "fa:16:3e:8d:8b:3f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5ce0a2-ca", "ovs_interfaceid": "fd5ce0a2-ca8e-422d-b36a-64006d1e8217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc702c0a-c79d-48b8-8cc0-7bb18931b11d", "address": "fa:16:3e:69:12:14", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc702c0a-c7", "ovs_interfaceid": "dc702c0a-c79d-48b8-8cc0-7bb18931b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df67aaef-5bdd-4a5a-816b-c34392983877", "address": "fa:16:3e:cb:39:d3", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf67aaef-5b", "ovs_interfaceid": "df67aaef-5bdd-4a5a-816b-c34392983877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:33:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6ec82fe4-d785-45f4-b2a3-f08756fbb352 req-c41e5e5a-595e-4635-af4a-f6b31d35dce0 service nova] Releasing lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:33:49 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:33:49 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:33:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:33:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.708s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Acquiring lock "da32613e-b1a9-4733-831f-e4fb1f34995f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:50 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:33:50 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:33:50 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:33:50 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:33:50 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:33:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:50 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:33:50 user nova-compute[73010]: INFO nova.compute.claims [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Claim successful on node user
Aug 15 00:33:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:33:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:33:50 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:33:51 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Creating image(s)
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Did not create local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Ensure instance console log exists: /opt/stack/data/nova/instances/17237e56-67eb-4a05-b004-d27dacc8e04b/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Start _get_guest_xml network_info=[{"id": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "address": "fa:16:3e:b2:cf:d1", "network": {"id": "fb9d1b69-d351-4867-b15a-09c90bf7c5e4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934474624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe2f2c5-f6", "ovs_interfaceid": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21837e06-6627-4156-8b30-7b1499f01b5d", "address": "fa:16:3e:0a:9f:40", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21837e06-66", "ovs_interfaceid": "21837e06-6627-4156-8b30-7b1499f01b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e45de596-2e5e-4306-a083-181d25a33abd", "address": "fa:16:3e:cb:9c:b6", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45de596-2e", "ovs_interfaceid": "e45de596-2e5e-4306-a083-181d25a33abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a7825db-198c-48a3-a587-07e565e7f151", "address": "fa:16:3e:38:fe:95", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7825db-19", "ovs_interfaceid": "6a7825db-198c-48a3-a587-07e565e7f151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "address": "fa:16:3e:4b:5b:ed", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a7a8fb-96", "ovs_interfaceid": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "address": "fa:16:3e:20:58:5d", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcef2b29-87", "ovs_interfaceid": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "592d1e12-5844-4034-bd24-c5882b4be109", "address": "fa:16:3e:c2:dd:0f", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592d1e12-58", "ovs_interfaceid": "592d1e12-5844-4034-bd24-c5882b4be109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xuecXCgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '17237e56-67eb-4a05-b004-d27dacc8e04b', 'attached_at': '', 'detached_at': '', 'volume_id': '9672cd95-fa0a-4c35-b73a-04cb3cfc60e0', 'serial': '9672cd95-fa0a-4c35-b73a-04cb3cfc60e0'}, 'disk_bus': 'virtio', 'attachment_id': 'e18171fc-ec33-417d-a56b-65ffbb1ce33c', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QNJEkPgt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '17237e56-67eb-4a05-b004-d27dacc8e04b', 'attached_at': '', 'detached_at': '', 'volume_id': '53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5', 'serial': '53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5'}, 'disk_bus': 'virtio', 'attachment_id': 'f2547c34-e0af-4a06-b21d-693ded7b9622', 'delete_on_termination': False, 'boot_index': 1, 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HLYogrpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '17237e56-67eb-4a05-b004-d27dacc8e04b', 'attached_at': '', 'detached_at': '', 'volume_id': '10d37848-d45f-4801-ba89-4bff1ae2e44e', 'serial': '10d37848-d45f-4801-ba89-4bff1ae2e44e'}, 'disk_bus': 'virtio', 'attachment_id': '0d3861f9-7c73-4ff6-90d7-eebf3da28bff', 'delete_on_termination': False, 'boot_index': 2, 'mount_device': '/dev/vdc', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:33:51 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:33:51 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG os_brick.initiator.connector [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Factory for ISCSI on None {{(pid=73010) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xuecXCgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:33:51 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:33:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:33:51 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:33:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:33:51 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Updating instance_info_cache with network_info: [{"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.network.neutron [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:33:51 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c6aa05-8ee5-4f98-801a-d7675fc72927]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:33:51 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76deb67-2e28-404b-8846-409ef0794f86]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0] added
Aug 15 00:33:51 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbf0b5c-8ba1-4a8f-a3ba-eb1859967367]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[756742e7-6e66-40b4-9eea-0c0edb6029d1]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xuecXCgO {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.policy [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3feadea26619474b8bb0a5d9bea7c9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb4bd98cbb410d81ae8a21d01056fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xuecXCgO" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2161f93c-cd3b-480e-be32-eb63780e979a]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xuecXCgO'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c7a0d2-456f-4b1d-b955-8ccae530e57e]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:33:51 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Creating image(s)
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Acquiring lock "/opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "/opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "/opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3fd87f-766b-4969-b978-d9f6dc1aeff9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 00:33:51 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 00:33:51 user nova-compute[73010]:  {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:33:51 user nova-compute[73010]: WARNING os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 00:33:51 user nova-compute[73010]: 
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c570f7f-1488-4401-bbc7-a70e2bc5b3e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0, portal: 172.16.0.220,3260]
Aug 15 00:33:51 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0, portal: 172.16.0.220,3260] successful.
Aug 15 00:33:51 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a74c524-28bd-4c70-967c-9e79509557b0]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbca29a2-3293-49d1-812a-3126528fb6df]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:33:51 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:33:51 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4190c10-156a-44ff-868a-e15e8bf6d08f]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xuecXCgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.215s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.215s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk 1073741824" returned: 0 in 0.061s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.202s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG nova.network.neutron [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Successfully created port: 0c7bfe51-bb5e-4147-8013-a2f175ac4e26 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Cannot resize image /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG nova.objects.instance [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lazy-loading 'migration_context' on Instance uuid da32613e-b1a9-4733-831f-e4fb1f34995f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Ensure instance console log exists: /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG nova.compute.manager [req-dc818d70-486d-4c95-a916-125ec24b4fed req-31e9a416-5c7d-4287-91ae-bc861f20b1f6 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received event network-changed-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG nova.compute.manager [req-dc818d70-486d-4c95-a916-125ec24b4fed req-31e9a416-5c7d-4287-91ae-bc861f20b1f6 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Refreshing instance network info cache due to event network-changed-ba4444c9-ca0d-4265-a567-f931f42b3115. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dc818d70-486d-4c95-a916-125ec24b4fed req-31e9a416-5c7d-4287-91ae-bc861f20b1f6 service nova] Acquiring lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dc818d70-486d-4c95-a916-125ec24b4fed req-31e9a416-5c7d-4287-91ae-bc861f20b1f6 service nova] Acquired lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG nova.network.neutron [req-dc818d70-486d-4c95-a916-125ec24b4fed req-31e9a416-5c7d-4287-91ae-bc861f20b1f6 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Refreshing network info cache for port ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23161663166333065', 'path': '/dev/sdb'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161663166333065', 'path': '/dev/sdb'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QNJEkPgt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:33:52 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:33:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:33:52 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:33:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:33:52 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:33:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e8cfe6-c775-48a0-9177-013695300ca8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:33:52 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9b6fba-76a9-4d07-b25f-087af287b14b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5] added
Aug 15 00:33:52 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c84ecf-0aa6-439a-bc53-c5d48711397e]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60f6e5b-d146-4504-af35-a32e631fb748]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QNJEkPgt {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QNJEkPgt" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29dd504-a2e3-43a9-885e-cc389673fe5b]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QNJEkPgt'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6eed092-aebb-4b91-a22e-dd915ca67b13]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[06604d54-b300-4b96-a9c2-7a0b55ff0fad]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:33:53 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:33:53 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb9b81d-57b2-4b69-b3b9-0efbfeac2536]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5, portal: 172.16.0.220,3260]
Aug 15 00:33:53 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5, portal: 172.16.0.220,3260] successful.
Aug 15 00:33:53 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4711879c-d8f2-45d4-956d-f565493e178e]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d20aacb-d540-453d-9e0f-6ed779ea0657]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:33:53 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:33:53 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:33:53 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:33:53 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[90690a64-41e5-4b1d-a04d-4c982391acf8]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QNJEkPgt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:33:53 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Creating image(s)
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Did not create local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Ensure instance console log exists: /opt/stack/data/nova/instances/4c37ecd1-7a9b-4c77-8a52-c81f56321ca3/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Start _get_guest_xml network_info=[{"id": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "address": "fa:16:3e:c8:c9:ad", "network": {"id": "7cec561d-d6de-48e3-ab40-d9bff06a031e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1980904641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96202dd8-f6", "ovs_interfaceid": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "address": "fa:16:3e:ee:92:2f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7932f3-05", "ovs_interfaceid": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "address": "fa:16:3e:b7:0b:5e", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba8ecd1-f3", "ovs_interfaceid": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "address": "fa:16:3e:f8:e5:9f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34cb5-4d", "ovs_interfaceid": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd5ce0a2-ca8e-422d-b36a-64006d1e8217", "address": "fa:16:3e:8d:8b:3f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5ce0a2-ca", "ovs_interfaceid": "fd5ce0a2-ca8e-422d-b36a-64006d1e8217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc702c0a-c79d-48b8-8cc0-7bb18931b11d", "address": "fa:16:3e:69:12:14", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc702c0a-c7", "ovs_interfaceid": "dc702c0a-c79d-48b8-8cc0-7bb18931b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df67aaef-5bdd-4a5a-816b-c34392983877", "address": "fa:16:3e:cb:39:d3", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf67aaef-5b", "ovs_interfaceid": "df67aaef-5bdd-4a5a-816b-c34392983877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MeEwJqdh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4c37ecd1-7a9b-4c77-8a52-c81f56321ca3', 'attached_at': '', 'detached_at': '', 'volume_id': '8d30d7ee-53a5-48d3-8113-a5172c87455b', 'serial': '8d30d7ee-53a5-48d3-8113-a5172c87455b'}, 'disk_bus': 'virtio', 'attachment_id': 'bac5f138-82df-46a5-98b4-1386599ede33', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iouBVYMd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4c37ecd1-7a9b-4c77-8a52-c81f56321ca3', 'attached_at': '', 'detached_at': '', 'volume_id': '6127b0fe-bc91-438d-8e0f-b465b3a2e246', 'serial': '6127b0fe-bc91-438d-8e0f-b465b3a2e246'}, 'disk_bus': 'virtio', 'attachment_id': 'a66fe266-df58-4e63-b80c-1dc178eb1c9d', 'delete_on_termination': False, 'boot_index': 1, 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hIaUewYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4c37ecd1-7a9b-4c77-8a52-c81f56321ca3', 'attached_at': '', 'detached_at': '', 'volume_id': '57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f', 'serial': '57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f'}, 'disk_bus': 'virtio', 'attachment_id': 'd2f14494-05e3-4f7b-9746-bc4bc14786c0', 'delete_on_termination': False, 'boot_index': 2, 'mount_device': '/dev/vdc', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:33:53 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:33:53 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MeEwJqdh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:33:53 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:33:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.network.neutron [req-dc818d70-486d-4c95-a916-125ec24b4fed req-31e9a416-5c7d-4287-91ae-bc861f20b1f6 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Updated VIF entry in instance network info cache for port ba4444c9-ca0d-4265-a567-f931f42b3115. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.network.neutron [req-dc818d70-486d-4c95-a916-125ec24b4fed req-31e9a416-5c7d-4287-91ae-bc861f20b1f6 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Updating instance_info_cache with network_info: [{"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dc818d70-486d-4c95-a916-125ec24b4fed req-31e9a416-5c7d-4287-91ae-bc861f20b1f6 service nova] Releasing lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:33:53 user nova-compute[73010]: DEBUG nova.network.neutron [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Successfully updated port: 0c7bfe51-bb5e-4147-8013-a2f175ac4e26 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Acquiring lock "refresh_cache-da32613e-b1a9-4733-831f-e4fb1f34995f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Acquired lock "refresh_cache-da32613e-b1a9-4733-831f-e4fb1f34995f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.network.neutron [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.compute.manager [req-550320fb-580a-4e91-bdd0-7a328734bf1f req-ff4739ef-23ed-44a6-9188-383acc4e3c12 service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Received event network-changed-0c7bfe51-bb5e-4147-8013-a2f175ac4e26 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.compute.manager [req-550320fb-580a-4e91-bdd0-7a328734bf1f req-ff4739ef-23ed-44a6-9188-383acc4e3c12 service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Refreshing instance network info cache due to event network-changed-0c7bfe51-bb5e-4147-8013-a2f175ac4e26. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-550320fb-580a-4e91-bdd0-7a328734bf1f req-ff4739ef-23ed-44a6-9188-383acc4e3c12 service nova] Acquiring lock "refresh_cache-da32613e-b1a9-4733-831f-e4fb1f34995f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.network.neutron [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26162653934313931', 'path': '/dev/sdc'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162653934313931', 'path': '/dev/sdc'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.466s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:33:54 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:33:54 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c378ee-f733-48ae-9bf0-bad1a9cdffdc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:33:54 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HLYogrpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:33:54 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.network.neutron [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Updating instance_info_cache with network_info: [{"id": "0c7bfe51-bb5e-4147-8013-a2f175ac4e26", "address": "fa:16:3e:5a:3b:0f", "network": {"id": "830487d5-0366-4d38-a7f2-10c0c754c6df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1078972361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eb4bd98cbb410d81ae8a21d01056fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7bfe51-bb", "ovs_interfaceid": "0c7bfe51-bb5e-4147-8013-a2f175ac4e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9554ca3-067a-4f13-9329-163baa3536e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b] added
Aug 15 00:33:54 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Releasing lock "refresh_cache-da32613e-b1a9-4733-831f-e4fb1f34995f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Instance network_info: |[{"id": "0c7bfe51-bb5e-4147-8013-a2f175ac4e26", "address": "fa:16:3e:5a:3b:0f", "network": {"id": "830487d5-0366-4d38-a7f2-10c0c754c6df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1078972361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eb4bd98cbb410d81ae8a21d01056fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7bfe51-bb", "ovs_interfaceid": "0c7bfe51-bb5e-4147-8013-a2f175ac4e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-550320fb-580a-4e91-bdd0-7a328734bf1f req-ff4739ef-23ed-44a6-9188-383acc4e3c12 service nova] Acquired lock "refresh_cache-da32613e-b1a9-4733-831f-e4fb1f34995f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.network.neutron [req-550320fb-580a-4e91-bdd0-7a328734bf1f req-ff4739ef-23ed-44a6-9188-383acc4e3c12 service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Refreshing network info cache for port 0c7bfe51-bb5e-4147-8013-a2f175ac4e26 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Start _get_guest_xml network_info=[{"id": "0c7bfe51-bb5e-4147-8013-a2f175ac4e26", "address": "fa:16:3e:5a:3b:0f", "network": {"id": "830487d5-0366-4d38-a7f2-10c0c754c6df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1078972361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eb4bd98cbb410d81ae8a21d01056fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7bfe51-bb", "ovs_interfaceid": "0c7bfe51-bb5e-4147-8013-a2f175ac4e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:54 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:33:54 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef9b454-f729-43be-83aa-96bbf1264917]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:33:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-531470164',display_name='tempest-TestServerVolumeAttachmentScenario-server-531470164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-531470164',id=12,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWXVbtC7rbFKH9QYL0TO5ogfzTkB1eHPcN6Fh0UPB2QEa6wWQnw6/XDLmu3UF5gK817DgglsdwJtlFj2ZGo+yI1E4dUtaJrT81Q/3NpIc1tCwpjJtN6ualkFB04ZKO3Jw==',key_name='tempest-keypair-1207935503',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6eb4bd98cbb410d81ae8a21d01056fc',ramdisk_id='',reservation_id='r-tirqejy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-724413436',owner_user_name='tempest-TestServerVolumeAttachmentScenario-724413436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3feadea26619474b8bb0a5d9bea7c9ef',uuid=da32613e-b1a9-4733-831f-e4fb1f34995f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c7bfe51-bb5e-4147-8013-a2f175ac4e26", "address": "fa:16:3e:5a:3b:0f", "network": {"id": "830487d5-0366-4d38-a7f2-10c0c754c6df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1078972361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eb4bd98cbb410d81ae8a21d01056fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7bfe51-bb", "ovs_interfaceid": "0c7bfe51-bb5e-4147-8013-a2f175ac4e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Converting VIF {"id": "0c7bfe51-bb5e-4147-8013-a2f175ac4e26", "address": "fa:16:3e:5a:3b:0f", "network": {"id": "830487d5-0366-4d38-a7f2-10c0c754c6df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1078972361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eb4bd98cbb410d81ae8a21d01056fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7bfe51-bb", "ovs_interfaceid": "0c7bfe51-bb5e-4147-8013-a2f175ac4e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:3b:0f,bridge_name='br-int',has_traffic_filtering=True,id=0c7bfe51-bb5e-4147-8013-a2f175ac4e26,network=Network(830487d5-0366-4d38-a7f2-10c0c754c6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c7bfe51-bb') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.objects.instance [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lazy-loading 'pci_devices' on Instance uuid da32613e-b1a9-4733-831f-e4fb1f34995f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd97e34c-39e2-415c-8ed1-0b44e69da529]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MeEwJqdh {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:33:54 user nova-compute[73010]:   <uuid>da32613e-b1a9-4733-831f-e4fb1f34995f</uuid>
Aug 15 00:33:54 user nova-compute[73010]:   <name>instance-0000000c</name>
Aug 15 00:33:54 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:33:54 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:33:54 user nova-compute[73010]:   <metadata>
Aug 15 00:33:54 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:33:54 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:33:54 user nova-compute[73010]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-531470164</nova:name>
Aug 15 00:33:54 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:33:54</nova:creationTime>
Aug 15 00:33:54 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:33:54 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:33:54 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:33:54 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:33:54 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:33:54 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:33:54 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:33:54 user nova-compute[73010]:       <nova:owner>
Aug 15 00:33:54 user nova-compute[73010]:         <nova:user uuid="3feadea26619474b8bb0a5d9bea7c9ef">tempest-TestServerVolumeAttachmentScenario-724413436-project-member</nova:user>
Aug 15 00:33:54 user nova-compute[73010]:         <nova:project uuid="c6eb4bd98cbb410d81ae8a21d01056fc">tempest-TestServerVolumeAttachmentScenario-724413436</nova:project>
Aug 15 00:33:54 user nova-compute[73010]:       </nova:owner>
Aug 15 00:33:54 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:33:54 user nova-compute[73010]:       <nova:ports>
Aug 15 00:33:54 user nova-compute[73010]:         <nova:port uuid="0c7bfe51-bb5e-4147-8013-a2f175ac4e26">
Aug 15 00:33:54 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 00:33:54 user nova-compute[73010]:         </nova:port>
Aug 15 00:33:54 user nova-compute[73010]:       </nova:ports>
Aug 15 00:33:54 user nova-compute[73010]:     </nova:instance>
Aug 15 00:33:54 user nova-compute[73010]:   </metadata>
Aug 15 00:33:54 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:33:54 user nova-compute[73010]:     <system>
Aug 15 00:33:54 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:33:54 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:33:54 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:33:54 user nova-compute[73010]:       <entry name="serial">da32613e-b1a9-4733-831f-e4fb1f34995f</entry>
Aug 15 00:33:54 user nova-compute[73010]:       <entry name="uuid">da32613e-b1a9-4733-831f-e4fb1f34995f</entry>
Aug 15 00:33:54 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:33:54 user nova-compute[73010]:     </system>
Aug 15 00:33:54 user nova-compute[73010]:   </sysinfo>
Aug 15 00:33:54 user nova-compute[73010]:   <os>
Aug 15 00:33:54 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:33:54 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:33:54 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:33:54 user nova-compute[73010]:   </os>
Aug 15 00:33:54 user nova-compute[73010]:   <features>
Aug 15 00:33:54 user nova-compute[73010]:     <acpi/>
Aug 15 00:33:54 user nova-compute[73010]:     <apic/>
Aug 15 00:33:54 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:33:54 user nova-compute[73010]:   </features>
Aug 15 00:33:54 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:33:54 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:33:54 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:33:54 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:33:54 user nova-compute[73010]:   </clock>
Aug 15 00:33:54 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:33:54 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:33:54 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:33:54 user nova-compute[73010]:   </cpu>
Aug 15 00:33:54 user nova-compute[73010]:   <devices>
Aug 15 00:33:54 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:33:54 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:33:54 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk"/>
Aug 15 00:33:54 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:33:54 user nova-compute[73010]:     </disk>
Aug 15 00:33:54 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:33:54 user nova-compute[73010]:       <mac address="fa:16:3e:5a:3b:0f"/>
Aug 15 00:33:54 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:33:54 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:33:54 user nova-compute[73010]:       <target dev="tap0c7bfe51-bb"/>
Aug 15 00:33:54 user nova-compute[73010]:     </interface>
Aug 15 00:33:54 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:33:54 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/console.log" append="off"/>
Aug 15 00:33:54 user nova-compute[73010]:     </serial>
Aug 15 00:33:54 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:33:54 user nova-compute[73010]:     <video>
Aug 15 00:33:54 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:33:54 user nova-compute[73010]:     </video>
Aug 15 00:33:54 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:33:54 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:33:54 user nova-compute[73010]:     </rng>
Aug 15 00:33:54 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:33:54 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:33:54 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:33:54 user nova-compute[73010]:     </memballoon>
Aug 15 00:33:54 user nova-compute[73010]:   </devices>
Aug 15 00:33:54 user nova-compute[73010]: </domain>
Aug 15 00:33:54 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:33:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-531470164',display_name='tempest-TestServerVolumeAttachmentScenario-server-531470164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-531470164',id=12,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWXVbtC7rbFKH9QYL0TO5ogfzTkB1eHPcN6Fh0UPB2QEa6wWQnw6/XDLmu3UF5gK817DgglsdwJtlFj2ZGo+yI1E4dUtaJrT81Q/3NpIc1tCwpjJtN6ualkFB04ZKO3Jw==',key_name='tempest-keypair-1207935503',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6eb4bd98cbb410d81ae8a21d01056fc',ramdisk_id='',reservation_id='r-tirqejy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-724413436',owner_user_name='tempest-TestServerVolumeAttachmentScenario-724413436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3feadea26619474b8bb0a5d9bea7c9ef',uuid=da32613e-b1a9-4733-831f-e4fb1f34995f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c7bfe51-bb5e-4147-8013-a2f175ac4e26", "address": "fa:16:3e:5a:3b:0f", "network": {"id": "830487d5-0366-4d38-a7f2-10c0c754c6df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1078972361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eb4bd98cbb410d81ae8a21d01056fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7bfe51-bb", "ovs_interfaceid": "0c7bfe51-bb5e-4147-8013-a2f175ac4e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Converting VIF {"id": "0c7bfe51-bb5e-4147-8013-a2f175ac4e26", "address": "fa:16:3e:5a:3b:0f", "network": {"id": "830487d5-0366-4d38-a7f2-10c0c754c6df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1078972361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eb4bd98cbb410d81ae8a21d01056fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7bfe51-bb", "ovs_interfaceid": "0c7bfe51-bb5e-4147-8013-a2f175ac4e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:3b:0f,bridge_name='br-int',has_traffic_filtering=True,id=0c7bfe51-bb5e-4147-8013-a2f175ac4e26,network=Network(830487d5-0366-4d38-a7f2-10c0c754c6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c7bfe51-bb') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_vif [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:3b:0f,bridge_name='br-int',has_traffic_filtering=True,id=0c7bfe51-bb5e-4147-8013-a2f175ac4e26,network=Network(830487d5-0366-4d38-a7f2-10c0c754c6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c7bfe51-bb') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c7bfe51-bb, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0c7bfe51-bb, col_values=(('external_ids', {'iface-id': '0c7bfe51-bb5e-4147-8013-a2f175ac4e26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:3b:0f', 'vm-uuid': 'da32613e-b1a9-4733-831f-e4fb1f34995f'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MeEwJqdh" returned: 0 in 0.029s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc59f6bc-eb5f-4163-af3e-cc56b90060dc]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MeEwJqdh'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:54 user nova-compute[73010]: INFO os_vif [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:3b:0f,bridge_name='br-int',has_traffic_filtering=True,id=0c7bfe51-bb5e-4147-8013-a2f175ac4e26,network=Network(830487d5-0366-4d38-a7f2-10c0c754c6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c7bfe51-bb')
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Acquiring lock "1ba131ea-c646-4719-b85a-5fc021555fcc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "1ba131ea-c646-4719-b85a-5fc021555fcc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.objects.instance [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lazy-loading 'flavor' on Instance uuid 1ba131ea-c646-4719-b85a-5fc021555fcc {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a9da8e-7b8f-45af-b54d-a76420621c09]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c74e8da-2389-40e6-a3cf-cdbfdbd2761a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:33:54 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:33:54 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:33:54 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:33:54 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] No VIF found with MAC fa:16:3e:5a:3b:0f, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "1ba131ea-c646-4719-b85a-5fc021555fcc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.123s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[088e5ce3-5f22-4121-b1a4-2a14889f98a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b, portal: 172.16.0.220,3260]
Aug 15 00:33:54 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b, portal: 172.16.0.220,3260] successful.
Aug 15 00:33:54 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[561c868f-5cba-4966-a9c1-4c3b3c6af094]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da1525f-a7a7-44fa-8ace-ba1d21c196b7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:33:54 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:33:54 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:33:54 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:33:54 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:33:54 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:33:54 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[96738d2e-c549-4332-96f6-81f510aed85f]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MeEwJqdh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.compute.manager [req-0f93926a-7bfd-4054-8d2f-eee4c38f07f7 req-3a5e7287-852e-474c-a70d-effe84e71988 service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received event network-changed-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.compute.manager [req-0f93926a-7bfd-4054-8d2f-eee4c38f07f7 req-3a5e7287-852e-474c-a70d-effe84e71988 service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Refreshing instance network info cache due to event network-changed-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0f93926a-7bfd-4054-8d2f-eee4c38f07f7 req-3a5e7287-852e-474c-a70d-effe84e71988 service nova] Acquiring lock "refresh_cache-afcd0a05-e035-492e-9fbe-cd63f4c3ea42" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0f93926a-7bfd-4054-8d2f-eee4c38f07f7 req-3a5e7287-852e-474c-a70d-effe84e71988 service nova] Acquired lock "refresh_cache-afcd0a05-e035-492e-9fbe-cd63f4c3ea42" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.network.neutron [req-0f93926a-7bfd-4054-8d2f-eee4c38f07f7 req-3a5e7287-852e-474c-a70d-effe84e71988 service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Refreshing network info cache for port 2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Acquiring lock "1ba131ea-c646-4719-b85a-5fc021555fcc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "1ba131ea-c646-4719-b85a-5fc021555fcc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:54 user nova-compute[73010]: INFO nova.compute.manager [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Attaching volume 696c44d8-7402-414a-9fba-38968c2c4e87 to /dev/vdb
Aug 15 00:33:54 user nova-compute[73010]: DEBUG os_brick.utils [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98efa3c-6054-4740-9f30-427b50ebd2e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3096e0ca-820c-4abc-9342-f262b7a2d527]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:54 user nova-compute[73010]: DEBUG nova.network.neutron [req-550320fb-580a-4e91-bdd0-7a328734bf1f req-ff4739ef-23ed-44a6-9188-383acc4e3c12 service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Updated VIF entry in instance network info cache for port 0c7bfe51-bb5e-4147-8013-a2f175ac4e26. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG nova.network.neutron [req-550320fb-580a-4e91-bdd0-7a328734bf1f req-ff4739ef-23ed-44a6-9188-383acc4e3c12 service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Updating instance_info_cache with network_info: [{"id": "0c7bfe51-bb5e-4147-8013-a2f175ac4e26", "address": "fa:16:3e:5a:3b:0f", "network": {"id": "830487d5-0366-4d38-a7f2-10c0c754c6df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1078972361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eb4bd98cbb410d81ae8a21d01056fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7bfe51-bb", "ovs_interfaceid": "0c7bfe51-bb5e-4147-8013-a2f175ac4e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5925f2f-ebf1-48fc-aae2-84d73d6554d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[203490b9-9587-4205-9aec-a0ebb72f0c20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-550320fb-580a-4e91-bdd0-7a328734bf1f req-ff4739ef-23ed-44a6-9188-383acc4e3c12 service nova] Releasing lock "refresh_cache-da32613e-b1a9-4733-831f-e4fb1f34995f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:33:55 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6545b0ce-8bb1-44c5-b671-65e9316bc615]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG os_brick.utils [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Updating existing volume attachment record: 51055398-d958-4640-b5c8-5a5f08f982ac {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG nova.network.neutron [req-0f93926a-7bfd-4054-8d2f-eee4c38f07f7 req-3a5e7287-852e-474c-a70d-effe84e71988 service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Updated VIF entry in instance network info cache for port 2f2b345b-67b5-4d95-bbd3-3fe48aafaee5. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG nova.network.neutron [req-0f93926a-7bfd-4054-8d2f-eee4c38f07f7 req-3a5e7287-852e-474c-a70d-effe84e71988 service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Updating instance_info_cache with network_info: [{"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0f93926a-7bfd-4054-8d2f-eee4c38f07f7 req-3a5e7287-852e-474c-a70d-effe84e71988 service nova] Releasing lock "refresh_cache-afcd0a05-e035-492e-9fbe-cd63f4c3ea42" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] <== connect_volume: return (1907ms) {'type': 'block', 'scsi_wwn': '23332326261623433', 'path': '/dev/sdd'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332326261623433', 'path': '/dev/sdd'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.405s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:33:55 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:33:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:33:55 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed670fd0-6ba5-485f-974f-3a87b37f19bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:33:55 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a395e044-11a8-4dda-9da8-c6d1f9bb9c60]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e] added
Aug 15 00:33:55 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iouBVYMd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:33:55 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:33:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a09c36-4e7d-4acd-8fa5-ef2d36ef28c8]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f07ec36-7667-4bca-8bfd-49e6a3371668]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HLYogrpw {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HLYogrpw" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b306c791-c7f4-4d0d-816f-a02ea1e53080]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HLYogrpw'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2786ef-deb6-4d7f-9cab-7f92b5003b51]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c0aff6-3c1a-43ea-8e5b-701e488cf53f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:33:55 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:33:55 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:33:55 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:33:55 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:33:55 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:33:55 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cdc0b0-3734-4940-ad41-2980fb73fe2e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e, portal: 172.16.0.220,3260]
Aug 15 00:33:56 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e, portal: 172.16.0.220,3260] successful.
Aug 15 00:33:56 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0a3969-fdf1-430e-be91-79e4c4b32f1c]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c4cb8f-42cd-4b48-908f-5cb6112590fc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:33:56 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:33:56 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:33:56 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:33:56 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:33:56 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:33:56 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:33:56 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:33:56 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.109s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab11d558-ccb6-4718-a217-ea7f3ff6a562]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HLYogrpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG nova.compute.manager [req-0266fb9d-7026-4ef8-93dc-d154446125c2 req-d73c3516-e6e5-419a-8b9f-414d9a20e9aa service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Received event network-vif-plugged-0c7bfe51-bb5e-4147-8013-a2f175ac4e26 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0266fb9d-7026-4ef8-93dc-d154446125c2 req-d73c3516-e6e5-419a-8b9f-414d9a20e9aa service nova] Acquiring lock "da32613e-b1a9-4733-831f-e4fb1f34995f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0266fb9d-7026-4ef8-93dc-d154446125c2 req-d73c3516-e6e5-419a-8b9f-414d9a20e9aa service nova] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0266fb9d-7026-4ef8-93dc-d154446125c2 req-d73c3516-e6e5-419a-8b9f-414d9a20e9aa service nova] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG nova.compute.manager [req-0266fb9d-7026-4ef8-93dc-d154446125c2 req-d73c3516-e6e5-419a-8b9f-414d9a20e9aa service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] No waiting events found dispatching network-vif-plugged-0c7bfe51-bb5e-4147-8013-a2f175ac4e26 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:33:56 user nova-compute[73010]: WARNING nova.compute.manager [req-0266fb9d-7026-4ef8-93dc-d154446125c2 req-d73c3516-e6e5-419a-8b9f-414d9a20e9aa service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Received unexpected event network-vif-plugged-0c7bfe51-bb5e-4147-8013-a2f175ac4e26 for instance with vm_state building and task_state spawning.
Aug 15 00:33:56 user nova-compute[73010]: DEBUG nova.compute.manager [req-0266fb9d-7026-4ef8-93dc-d154446125c2 req-d73c3516-e6e5-419a-8b9f-414d9a20e9aa service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Received event network-vif-plugged-0c7bfe51-bb5e-4147-8013-a2f175ac4e26 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0266fb9d-7026-4ef8-93dc-d154446125c2 req-d73c3516-e6e5-419a-8b9f-414d9a20e9aa service nova] Acquiring lock "da32613e-b1a9-4733-831f-e4fb1f34995f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0266fb9d-7026-4ef8-93dc-d154446125c2 req-d73c3516-e6e5-419a-8b9f-414d9a20e9aa service nova] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0266fb9d-7026-4ef8-93dc-d154446125c2 req-d73c3516-e6e5-419a-8b9f-414d9a20e9aa service nova] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:56 user nova-compute[73010]: DEBUG nova.compute.manager [req-0266fb9d-7026-4ef8-93dc-d154446125c2 req-d73c3516-e6e5-419a-8b9f-414d9a20e9aa service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] No waiting events found dispatching network-vif-plugged-0c7bfe51-bb5e-4147-8013-a2f175ac4e26 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:33:56 user nova-compute[73010]: WARNING nova.compute.manager [req-0266fb9d-7026-4ef8-93dc-d154446125c2 req-d73c3516-e6e5-419a-8b9f-414d9a20e9aa service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Received unexpected event network-vif-plugged-0c7bfe51-bb5e-4147-8013-a2f175ac4e26 for instance with vm_state building and task_state spawning.
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.497s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] <== connect_volume: return (2902ms) {'type': 'block', 'scsi_wwn': '26130656461383236', 'path': '/dev/sde'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130656461383236', 'path': '/dev/sde'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.448s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:33:57 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:33:57 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1967307702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1967307702',id=9,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb77Tq+A5224r5Krpcf49lfSYOhZYyRwgIvnPx0qjf9uFvGCcyIpUtEgHDjrpNXhairuoL+2ujo9E/dynuHIAklLETDvUdq2ij5w/N0YGRhmy64ulbPiiJ0JESPY0Sz8Q==',key_name='tempest-keypair-1553316417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40820fcd77f4dbc8532e4090dd2ca0b',ramdisk_id='',reservation_id='r-rg5wt6cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-488812863',owner_user_name='tempest-TaggedBootDevicesTest_v242-488812863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7e247179e3845708d8d9565cfe5f472',uuid=17237e56-67eb-4a05-b004-d27dacc8e04b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "address": "fa:16:3e:b2:cf:d1", "network": {"id": "fb9d1b69-d351-4867-b15a-09c90bf7c5e4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934474624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe2f2c5-f6", "ovs_interfaceid": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converting VIF {"id": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "address": "fa:16:3e:b2:cf:d1", "network": {"id": "fb9d1b69-d351-4867-b15a-09c90bf7c5e4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934474624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe2f2c5-f6", "ovs_interfaceid": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:cf:d1,bridge_name='br-int',has_traffic_filtering=True,id=4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589,network=Network(fb9d1b69-d351-4867-b15a-09c90bf7c5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe2f2c5-f6') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1967307702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1967307702',id=9,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb77Tq+A5224r5Krpcf49lfSYOhZYyRwgIvnPx0qjf9uFvGCcyIpUtEgHDjrpNXhairuoL+2ujo9E/dynuHIAklLETDvUdq2ij5w/N0YGRhmy64ulbPiiJ0JESPY0Sz8Q==',key_name='tempest-keypair-1553316417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40820fcd77f4dbc8532e4090dd2ca0b',ramdisk_id='',reservation_id='r-rg5wt6cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-488812863',owner_user_name='tempest-TaggedBootDevicesTest_v242-488812863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7e247179e3845708d8d9565cfe5f472',uuid=17237e56-67eb-4a05-b004-d27dacc8e04b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21837e06-6627-4156-8b30-7b1499f01b5d", "address": "fa:16:3e:0a:9f:40", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21837e06-66", "ovs_interfaceid": "21837e06-6627-4156-8b30-7b1499f01b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converting VIF {"id": "21837e06-6627-4156-8b30-7b1499f01b5d", "address": "fa:16:3e:0a:9f:40", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21837e06-66", "ovs_interfaceid": "21837e06-6627-4156-8b30-7b1499f01b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:9f:40,bridge_name='br-int',has_traffic_filtering=True,id=21837e06-6627-4156-8b30-7b1499f01b5d,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21837e06-66') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1967307702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1967307702',id=9,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb77Tq+A5224r5Krpcf49lfSYOhZYyRwgIvnPx0qjf9uFvGCcyIpUtEgHDjrpNXhairuoL+2ujo9E/dynuHIAklLETDvUdq2ij5w/N0YGRhmy64ulbPiiJ0JESPY0Sz8Q==',key_name='tempest-keypair-1553316417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40820fcd77f4dbc8532e4090dd2ca0b',ramdisk_id='',reservation_id='r-rg5wt6cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-488812863',owner_user_name='tempest-TaggedBootDevicesTest_v242-488812863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7e247179e3845708d8d9565cfe5f472',uuid=17237e56-67eb-4a05-b004-d27dacc8e04b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e45de596-2e5e-4306-a083-181d25a33abd", "address": "fa:16:3e:cb:9c:b6", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45de596-2e", "ovs_interfaceid": "e45de596-2e5e-4306-a083-181d25a33abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converting VIF {"id": "e45de596-2e5e-4306-a083-181d25a33abd", "address": "fa:16:3e:cb:9c:b6", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45de596-2e", "ovs_interfaceid": "e45de596-2e5e-4306-a083-181d25a33abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:9c:b6,bridge_name='br-int',has_traffic_filtering=True,id=e45de596-2e5e-4306-a083-181d25a33abd,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape45de596-2e') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1967307702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1967307702',id=9,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb77Tq+A5224r5Krpcf49lfSYOhZYyRwgIvnPx0qjf9uFvGCcyIpUtEgHDjrpNXhairuoL+2ujo9E/dynuHIAklLETDvUdq2ij5w/N0YGRhmy64ulbPiiJ0JESPY0Sz8Q==',key_name='tempest-keypair-1553316417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40820fcd77f4dbc8532e4090dd2ca0b',ramdisk_id='',reservation_id='r-rg5wt6cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-488812863',owner_user_name='tempest-TaggedBootDevicesTest_v242-488812863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7e247179e3845708d8d9565cfe5f472',uuid=17237e56-67eb-4a05-b004-d27dacc8e04b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a7825db-198c-48a3-a587-07e565e7f151", "address": "fa:16:3e:38:fe:95", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7825db-19", "ovs_interfaceid": "6a7825db-198c-48a3-a587-07e565e7f151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converting VIF {"id": "6a7825db-198c-48a3-a587-07e565e7f151", "address": "fa:16:3e:38:fe:95", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7825db-19", "ovs_interfaceid": "6a7825db-198c-48a3-a587-07e565e7f151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=6a7825db-198c-48a3-a587-07e565e7f151,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7825db-19') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1967307702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1967307702',id=9,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb77Tq+A5224r5Krpcf49lfSYOhZYyRwgIvnPx0qjf9uFvGCcyIpUtEgHDjrpNXhairuoL+2ujo9E/dynuHIAklLETDvUdq2ij5w/N0YGRhmy64ulbPiiJ0JESPY0Sz8Q==',key_name='tempest-keypair-1553316417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40820fcd77f4dbc8532e4090dd2ca0b',ramdisk_id='',reservation_id='r-rg5wt6cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-488812863',owner_user_name='tempest-TaggedBootDevicesTest_v242-488812863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7e247179e3845708d8d9565cfe5f472',uuid=17237e56-67eb-4a05-b004-d27dacc8e04b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "address": "fa:16:3e:4b:5b:ed", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a7a8fb-96", "ovs_interfaceid": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converting VIF {"id": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "address": "fa:16:3e:4b:5b:ed", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a7a8fb-96", "ovs_interfaceid": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:5b:ed,bridge_name='br-int',has_traffic_filtering=True,id=c0a7a8fb-96d7-4d75-9c81-bebe9861874d,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a7a8fb-96') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1967307702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1967307702',id=9,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb77Tq+A5224r5Krpcf49lfSYOhZYyRwgIvnPx0qjf9uFvGCcyIpUtEgHDjrpNXhairuoL+2ujo9E/dynuHIAklLETDvUdq2ij5w/N0YGRhmy64ulbPiiJ0JESPY0Sz8Q==',key_name='tempest-keypair-1553316417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40820fcd77f4dbc8532e4090dd2ca0b',ramdisk_id='',reservation_id='r-rg5wt6cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-488812863',owner_user_name='tempest-TaggedBootDevicesTest_v242-488812863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7e247179e3845708d8d9565cfe5f472',uuid=17237e56-67eb-4a05-b004-d27dacc8e04b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "address": "fa:16:3e:20:58:5d", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcef2b29-87", "ovs_interfaceid": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converting VIF {"id": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "address": "fa:16:3e:20:58:5d", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcef2b29-87", "ovs_interfaceid": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:58:5d,bridge_name='br-int',has_traffic_filtering=True,id=bcef2b29-872a-4cb1-9d3d-80fc04ee8254,network=Network(4548537a-5eaf-4db4-8e88-179973e7b956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcef2b29-87') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1967307702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1967307702',id=9,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb77Tq+A5224r5Krpcf49lfSYOhZYyRwgIvnPx0qjf9uFvGCcyIpUtEgHDjrpNXhairuoL+2ujo9E/dynuHIAklLETDvUdq2ij5w/N0YGRhmy64ulbPiiJ0JESPY0Sz8Q==',key_name='tempest-keypair-1553316417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40820fcd77f4dbc8532e4090dd2ca0b',ramdisk_id='',reservation_id='r-rg5wt6cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-488812863',owner_user_name='tempest-TaggedBootDevicesTest_v242-488812863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7e247179e3845708d8d9565cfe5f472',uuid=17237e56-67eb-4a05-b004-d27dacc8e04b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "592d1e12-5844-4034-bd24-c5882b4be109", "address": "fa:16:3e:c2:dd:0f", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592d1e12-58", "ovs_interfaceid": "592d1e12-5844-4034-bd24-c5882b4be109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converting VIF {"id": "592d1e12-5844-4034-bd24-c5882b4be109", "address": "fa:16:3e:c2:dd:0f", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592d1e12-58", "ovs_interfaceid": "592d1e12-5844-4034-bd24-c5882b4be109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:dd:0f,bridge_name='br-int',has_traffic_filtering=True,id=592d1e12-5844-4034-bd24-c5882b4be109,network=Network(4548537a-5eaf-4db4-8e88-179973e7b956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592d1e12-58') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lazy-loading 'pci_devices' on Instance uuid 17237e56-67eb-4a05-b004-d27dacc8e04b {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[023a5c3c-2df9-4f46-99e4-860961b91091]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:33:57 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:33:57 user nova-compute[73010]:   <uuid>17237e56-67eb-4a05-b004-d27dacc8e04b</uuid>
Aug 15 00:33:57 user nova-compute[73010]:   <name>instance-00000009</name>
Aug 15 00:33:57 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:33:57 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:33:57 user nova-compute[73010]:   <metadata>
Aug 15 00:33:57 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:33:57 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:33:57 user nova-compute[73010]:       <nova:name>tempest-device-tagging-server-1967307702</nova:name>
Aug 15 00:33:57 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:33:51</nova:creationTime>
Aug 15 00:33:57 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:33:57 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:33:57 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:33:57 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:33:57 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:33:57 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:33:57 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:33:57 user nova-compute[73010]:       <nova:owner>
Aug 15 00:33:57 user nova-compute[73010]:         <nova:user uuid="e7e247179e3845708d8d9565cfe5f472">tempest-TaggedBootDevicesTest_v242-488812863-project-member</nova:user>
Aug 15 00:33:57 user nova-compute[73010]:         <nova:project uuid="c40820fcd77f4dbc8532e4090dd2ca0b">tempest-TaggedBootDevicesTest_v242-488812863</nova:project>
Aug 15 00:33:57 user nova-compute[73010]:       </nova:owner>
Aug 15 00:33:57 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:33:57 user nova-compute[73010]:       <nova:ports>
Aug 15 00:33:57 user nova-compute[73010]:         <nova:port uuid="4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589">
Aug 15 00:33:57 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 00:33:57 user nova-compute[73010]:         </nova:port>
Aug 15 00:33:57 user nova-compute[73010]:         <nova:port uuid="21837e06-6627-4156-8b30-7b1499f01b5d">
Aug 15 00:33:57 user nova-compute[73010]:           <nova:ip type="fixed" address="10.1.1.228" ipVersion="4"/>
Aug 15 00:33:57 user nova-compute[73010]:         </nova:port>
Aug 15 00:33:57 user nova-compute[73010]:         <nova:port uuid="e45de596-2e5e-4306-a083-181d25a33abd">
Aug 15 00:33:57 user nova-compute[73010]:           <nova:ip type="fixed" address="10.1.1.108" ipVersion="4"/>
Aug 15 00:33:57 user nova-compute[73010]:         </nova:port>
Aug 15 00:33:57 user nova-compute[73010]:         <nova:port uuid="6a7825db-198c-48a3-a587-07e565e7f151">
Aug 15 00:33:57 user nova-compute[73010]:           <nova:ip type="fixed" address="10.1.1.249" ipVersion="4"/>
Aug 15 00:33:57 user nova-compute[73010]:         </nova:port>
Aug 15 00:33:57 user nova-compute[73010]:         <nova:port uuid="c0a7a8fb-96d7-4d75-9c81-bebe9861874d">
Aug 15 00:33:57 user nova-compute[73010]:           <nova:ip type="fixed" address="10.1.1.113" ipVersion="4"/>
Aug 15 00:33:57 user nova-compute[73010]:         </nova:port>
Aug 15 00:33:57 user nova-compute[73010]:         <nova:port uuid="bcef2b29-872a-4cb1-9d3d-80fc04ee8254">
Aug 15 00:33:57 user nova-compute[73010]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 15 00:33:57 user nova-compute[73010]:         </nova:port>
Aug 15 00:33:57 user nova-compute[73010]:         <nova:port uuid="592d1e12-5844-4034-bd24-c5882b4be109">
Aug 15 00:33:57 user nova-compute[73010]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 15 00:33:57 user nova-compute[73010]:         </nova:port>
Aug 15 00:33:57 user nova-compute[73010]:       </nova:ports>
Aug 15 00:33:57 user nova-compute[73010]:     </nova:instance>
Aug 15 00:33:57 user nova-compute[73010]:   </metadata>
Aug 15 00:33:57 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:33:57 user nova-compute[73010]:     <system>
Aug 15 00:33:57 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:33:57 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:33:57 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:33:57 user nova-compute[73010]:       <entry name="serial">17237e56-67eb-4a05-b004-d27dacc8e04b</entry>
Aug 15 00:33:57 user nova-compute[73010]:       <entry name="uuid">17237e56-67eb-4a05-b004-d27dacc8e04b</entry>
Aug 15 00:33:57 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:33:57 user nova-compute[73010]:     </system>
Aug 15 00:33:57 user nova-compute[73010]:   </sysinfo>
Aug 15 00:33:57 user nova-compute[73010]:   <os>
Aug 15 00:33:57 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:33:57 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:33:57 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:33:57 user nova-compute[73010]:   </os>
Aug 15 00:33:57 user nova-compute[73010]:   <features>
Aug 15 00:33:57 user nova-compute[73010]:     <acpi/>
Aug 15 00:33:57 user nova-compute[73010]:     <apic/>
Aug 15 00:33:57 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:33:57 user nova-compute[73010]:   </features>
Aug 15 00:33:57 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:33:57 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:33:57 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:33:57 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:33:57 user nova-compute[73010]:   </clock>
Aug 15 00:33:57 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:33:57 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:33:57 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:33:57 user nova-compute[73010]:   </cpu>
Aug 15 00:33:57 user nova-compute[73010]:   <devices>
Aug 15 00:33:57 user nova-compute[73010]:     <disk type="file" device="cdrom">
Aug 15 00:33:57 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 00:33:57 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/17237e56-67eb-4a05-b004-d27dacc8e04b/disk.config"/>
Aug 15 00:33:57 user nova-compute[73010]:       <target dev="hda" bus="ide"/>
Aug 15 00:33:57 user nova-compute[73010]:     </disk>
Aug 15 00:33:57 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 00:33:57 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:33:57 user nova-compute[73010]:       <source dev="/dev/sdb"/>
Aug 15 00:33:57 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:33:57 user nova-compute[73010]:       <serial>9672cd95-fa0a-4c35-b73a-04cb3cfc60e0</serial>
Aug 15 00:33:57 user nova-compute[73010]:     </disk>
Aug 15 00:33:57 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 00:33:57 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:33:57 user nova-compute[73010]:       <source dev="/dev/sdc"/>
Aug 15 00:33:57 user nova-compute[73010]:       <target dev="vdb" bus="virtio"/>
Aug 15 00:33:57 user nova-compute[73010]:       <serial>53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5</serial>
Aug 15 00:33:57 user nova-compute[73010]:     </disk>
Aug 15 00:33:57 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 00:33:57 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:33:57 user nova-compute[73010]:       <source dev="/dev/sde"/>
Aug 15 00:33:57 user nova-compute[73010]:       <target dev="vdc" bus="virtio"/>
Aug 15 00:33:57 user nova-compute[73010]:       <serial>10d37848-d45f-4801-ba89-4bff1ae2e44e</serial>
Aug 15 00:33:57 user nova-compute[73010]:     </disk>
Aug 15 00:33:57 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:33:57 user nova-compute[73010]:       <mac address="fa:16:3e:b2:cf:d1"/>
Aug 15 00:33:57 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:33:57 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:33:57 user nova-compute[73010]:       <target dev="tap4fe2f2c5-f6"/>
Aug 15 00:33:57 user nova-compute[73010]:     </interface>
Aug 15 00:33:57 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:33:57 user nova-compute[73010]:       <mac address="fa:16:3e:0a:9f:40"/>
Aug 15 00:33:57 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:33:57 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:33:57 user nova-compute[73010]:       <target dev="tap21837e06-66"/>
Aug 15 00:33:57 user nova-compute[73010]:     </interface>
Aug 15 00:33:57 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:33:57 user nova-compute[73010]:       <mac address="fa:16:3e:cb:9c:b6"/>
Aug 15 00:33:57 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:33:57 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:33:57 user nova-compute[73010]:       <target dev="tape45de596-2e"/>
Aug 15 00:33:57 user nova-compute[73010]:     </interface>
Aug 15 00:33:57 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:33:57 user nova-compute[73010]:       <mac address="fa:16:3e:38:fe:95"/>
Aug 15 00:33:57 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:33:57 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:33:57 user nova-compute[73010]:       <target dev="tap6a7825db-19"/>
Aug 15 00:33:57 user nova-compute[73010]:     </interface>
Aug 15 00:33:57 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:33:57 user nova-compute[73010]:       <mac address="fa:16:3e:4b:5b:ed"/>
Aug 15 00:33:57 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:33:57 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:33:57 user nova-compute[73010]:       <target dev="tapc0a7a8fb-96"/>
Aug 15 00:33:57 user nova-compute[73010]:     </interface>
Aug 15 00:33:57 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:33:57 user nova-compute[73010]:       <mac address="fa:16:3e:20:58:5d"/>
Aug 15 00:33:57 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:33:57 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:33:57 user nova-compute[73010]:       <target dev="tapbcef2b29-87"/>
Aug 15 00:33:57 user nova-compute[73010]:     </interface>
Aug 15 00:33:57 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:33:57 user nova-compute[73010]:       <mac address="fa:16:3e:c2:dd:0f"/>
Aug 15 00:33:57 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:33:57 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:33:57 user nova-compute[73010]:       <target dev="tap592d1e12-58"/>
Aug 15 00:33:57 user nova-compute[73010]:     </interface>
Aug 15 00:33:57 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:33:57 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/17237e56-67eb-4a05-b004-d27dacc8e04b/console.log" append="off"/>
Aug 15 00:33:57 user nova-compute[73010]:     </serial>
Aug 15 00:33:57 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:33:57 user nova-compute[73010]:     <video>
Aug 15 00:33:57 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:33:57 user nova-compute[73010]:     </video>
Aug 15 00:33:57 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:33:57 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:33:57 user nova-compute[73010]:     </rng>
Aug 15 00:33:57 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:33:57 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:33:57 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:33:57 user nova-compute[73010]:     </memballoon>
Aug 15 00:33:57 user nova-compute[73010]:   </devices>
Aug 15 00:33:57 user nova-compute[73010]: </domain>
Aug 15 00:33:57 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1967307702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1967307702',id=9,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb77Tq+A5224r5Krpcf49lfSYOhZYyRwgIvnPx0qjf9uFvGCcyIpUtEgHDjrpNXhairuoL+2ujo9E/dynuHIAklLETDvUdq2ij5w/N0YGRhmy64ulbPiiJ0JESPY0Sz8Q==',key_name='tempest-keypair-1553316417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40820fcd77f4dbc8532e4090dd2ca0b',ramdisk_id='',reservation_id='r-rg5wt6cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-488812863',owner_user_name='tempest-TaggedBootDevicesTest_v242-488812863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7e247179e3845708d8d9565cfe5f472',uuid=17237e56-67eb-4a05-b004-d27dacc8e04b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "address": "fa:16:3e:b2:cf:d1", "network": {"id": "fb9d1b69-d351-4867-b15a-09c90bf7c5e4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934474624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe2f2c5-f6", "ovs_interfaceid": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converting VIF {"id": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "address": "fa:16:3e:b2:cf:d1", "network": {"id": "fb9d1b69-d351-4867-b15a-09c90bf7c5e4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934474624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe2f2c5-f6", "ovs_interfaceid": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:cf:d1,bridge_name='br-int',has_traffic_filtering=True,id=4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589,network=Network(fb9d1b69-d351-4867-b15a-09c90bf7c5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe2f2c5-f6') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:cf:d1,bridge_name='br-int',has_traffic_filtering=True,id=4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589,network=Network(fb9d1b69-d351-4867-b15a-09c90bf7c5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe2f2c5-f6') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fe2f2c5-f6, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4fe2f2c5-f6, col_values=(('external_ids', {'iface-id': '4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:cf:d1', 'vm-uuid': '17237e56-67eb-4a05-b004-d27dacc8e04b'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ae0f70-4b3a-4bb8-b222-5f7f2b89a9bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246] added
Aug 15 00:33:57 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: INFO os_vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:cf:d1,bridge_name='br-int',has_traffic_filtering=True,id=4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589,network=Network(fb9d1b69-d351-4867-b15a-09c90bf7c5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe2f2c5-f6')
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1967307702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1967307702',id=9,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb77Tq+A5224r5Krpcf49lfSYOhZYyRwgIvnPx0qjf9uFvGCcyIpUtEgHDjrpNXhairuoL+2ujo9E/dynuHIAklLETDvUdq2ij5w/N0YGRhmy64ulbPiiJ0JESPY0Sz8Q==',key_name='tempest-keypair-1553316417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40820fcd77f4dbc8532e4090dd2ca0b',ramdisk_id='',reservation_id='r-rg5wt6cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-488812863',owner_user_name='tempest-TaggedBootDevicesTest_v242-488812863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7e247179e3845708d8d9565cfe5f472',uuid=17237e56-67eb-4a05-b004-d27dacc8e04b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21837e06-6627-4156-8b30-7b1499f01b5d", "address": "fa:16:3e:0a:9f:40", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21837e06-66", "ovs_interfaceid": "21837e06-6627-4156-8b30-7b1499f01b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converting VIF {"id": "21837e06-6627-4156-8b30-7b1499f01b5d", "address": "fa:16:3e:0a:9f:40", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21837e06-66", "ovs_interfaceid": "21837e06-6627-4156-8b30-7b1499f01b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:9f:40,bridge_name='br-int',has_traffic_filtering=True,id=21837e06-6627-4156-8b30-7b1499f01b5d,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21837e06-66') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:9f:40,bridge_name='br-int',has_traffic_filtering=True,id=21837e06-6627-4156-8b30-7b1499f01b5d,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21837e06-66') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21837e06-66, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap21837e06-66, col_values=(('external_ids', {'iface-id': '21837e06-6627-4156-8b30-7b1499f01b5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:9f:40', 'vm-uuid': '17237e56-67eb-4a05-b004-d27dacc8e04b'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2f38d3-5567-443b-8b90-4309c655c699]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: INFO os_vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:9f:40,bridge_name='br-int',has_traffic_filtering=True,id=21837e06-6627-4156-8b30-7b1499f01b5d,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21837e06-66')
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1967307702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1967307702',id=9,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb77Tq+A5224r5Krpcf49lfSYOhZYyRwgIvnPx0qjf9uFvGCcyIpUtEgHDjrpNXhairuoL+2ujo9E/dynuHIAklLETDvUdq2ij5w/N0YGRhmy64ulbPiiJ0JESPY0Sz8Q==',key_name='tempest-keypair-1553316417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40820fcd77f4dbc8532e4090dd2ca0b',ramdisk_id='',reservation_id='r-rg5wt6cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-488812863',owner_user_name='tempest-TaggedBootDevicesTest_v242-488812863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7e247179e3845708d8d9565cfe5f472',uuid=17237e56-67eb-4a05-b004-d27dacc8e04b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e45de596-2e5e-4306-a083-181d25a33abd", "address": "fa:16:3e:cb:9c:b6", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45de596-2e", "ovs_interfaceid": "e45de596-2e5e-4306-a083-181d25a33abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converting VIF {"id": "e45de596-2e5e-4306-a083-181d25a33abd", "address": "fa:16:3e:cb:9c:b6", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45de596-2e", "ovs_interfaceid": "e45de596-2e5e-4306-a083-181d25a33abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:9c:b6,bridge_name='br-int',has_traffic_filtering=True,id=e45de596-2e5e-4306-a083-181d25a33abd,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape45de596-2e') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:9c:b6,bridge_name='br-int',has_traffic_filtering=True,id=e45de596-2e5e-4306-a083-181d25a33abd,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape45de596-2e') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa690886-0fef-4706-a91d-e4c1fee28811]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iouBVYMd {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape45de596-2e, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape45de596-2e, col_values=(('external_ids', {'iface-id': 'e45de596-2e5e-4306-a083-181d25a33abd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:9c:b6', 'vm-uuid': '17237e56-67eb-4a05-b004-d27dacc8e04b'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iouBVYMd" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[011968eb-38ba-46ac-bc39-8e6f594bd4bd]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iouBVYMd'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: INFO os_vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:9c:b6,bridge_name='br-int',has_traffic_filtering=True,id=e45de596-2e5e-4306-a083-181d25a33abd,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape45de596-2e')
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1967307702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1967307702',id=9,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb77Tq+A5224r5Krpcf49lfSYOhZYyRwgIvnPx0qjf9uFvGCcyIpUtEgHDjrpNXhairuoL+2ujo9E/dynuHIAklLETDvUdq2ij5w/N0YGRhmy64ulbPiiJ0JESPY0Sz8Q==',key_name='tempest-keypair-1553316417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40820fcd77f4dbc8532e4090dd2ca0b',ramdisk_id='',reservation_id='r-rg5wt6cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-488812863',owner_user_name='tempest-TaggedBootDevicesTest_v242-488812863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7e247179e3845708d8d9565cfe5f472',uuid=17237e56-67eb-4a05-b004-d27dacc8e04b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a7825db-198c-48a3-a587-07e565e7f151", "address": "fa:16:3e:38:fe:95", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7825db-19", "ovs_interfaceid": "6a7825db-198c-48a3-a587-07e565e7f151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converting VIF {"id": "6a7825db-198c-48a3-a587-07e565e7f151", "address": "fa:16:3e:38:fe:95", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7825db-19", "ovs_interfaceid": "6a7825db-198c-48a3-a587-07e565e7f151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=6a7825db-198c-48a3-a587-07e565e7f151,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7825db-19') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=6a7825db-198c-48a3-a587-07e565e7f151,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7825db-19') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a7825db-19, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6a7825db-19, col_values=(('external_ids', {'iface-id': '6a7825db-198c-48a3-a587-07e565e7f151', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:fe:95', 'vm-uuid': '17237e56-67eb-4a05-b004-d27dacc8e04b'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c2219d-5406-4774-9973-74a68f39fb3f]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d553ff43-444f-47a4-bb9f-63d5b006883b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:33:57 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:33:57 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:33:57 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:33:57 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:33:57 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:33:57 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:33:57 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:33:57 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: INFO os_vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=6a7825db-198c-48a3-a587-07e565e7f151,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7825db-19')
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1967307702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1967307702',id=9,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb77Tq+A5224r5Krpcf49lfSYOhZYyRwgIvnPx0qjf9uFvGCcyIpUtEgHDjrpNXhairuoL+2ujo9E/dynuHIAklLETDvUdq2ij5w/N0YGRhmy64ulbPiiJ0JESPY0Sz8Q==',key_name='tempest-keypair-1553316417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40820fcd77f4dbc8532e4090dd2ca0b',ramdisk_id='',reservation_id='r-rg5wt6cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-488812863',owner_user_name='tempest-TaggedBootDevicesTest_v242-488812863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7e247179e3845708d8d9565cfe5f472',uuid=17237e56-67eb-4a05-b004-d27dacc8e04b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "address": "fa:16:3e:4b:5b:ed", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a7a8fb-96", "ovs_interfaceid": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converting VIF {"id": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "address": "fa:16:3e:4b:5b:ed", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a7a8fb-96", "ovs_interfaceid": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:5b:ed,bridge_name='br-int',has_traffic_filtering=True,id=c0a7a8fb-96d7-4d75-9c81-bebe9861874d,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a7a8fb-96') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:5b:ed,bridge_name='br-int',has_traffic_filtering=True,id=c0a7a8fb-96d7-4d75-9c81-bebe9861874d,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a7a8fb-96') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0a7a8fb-96, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc0a7a8fb-96, col_values=(('external_ids', {'iface-id': 'c0a7a8fb-96d7-4d75-9c81-bebe9861874d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:5b:ed', 'vm-uuid': '17237e56-67eb-4a05-b004-d27dacc8e04b'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: INFO os_vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:5b:ed,bridge_name='br-int',has_traffic_filtering=True,id=c0a7a8fb-96d7-4d75-9c81-bebe9861874d,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a7a8fb-96')
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1967307702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1967307702',id=9,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb77Tq+A5224r5Krpcf49lfSYOhZYyRwgIvnPx0qjf9uFvGCcyIpUtEgHDjrpNXhairuoL+2ujo9E/dynuHIAklLETDvUdq2ij5w/N0YGRhmy64ulbPiiJ0JESPY0Sz8Q==',key_name='tempest-keypair-1553316417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40820fcd77f4dbc8532e4090dd2ca0b',ramdisk_id='',reservation_id='r-rg5wt6cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-488812863',owner_user_name='tempest-TaggedBootDevicesTest_v242-488812863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7e247179e3845708d8d9565cfe5f472',uuid=17237e56-67eb-4a05-b004-d27dacc8e04b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "address": "fa:16:3e:20:58:5d", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcef2b29-87", "ovs_interfaceid": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converting VIF {"id": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "address": "fa:16:3e:20:58:5d", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcef2b29-87", "ovs_interfaceid": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:58:5d,bridge_name='br-int',has_traffic_filtering=True,id=bcef2b29-872a-4cb1-9d3d-80fc04ee8254,network=Network(4548537a-5eaf-4db4-8e88-179973e7b956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcef2b29-87') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:58:5d,bridge_name='br-int',has_traffic_filtering=True,id=bcef2b29-872a-4cb1-9d3d-80fc04ee8254,network=Network(4548537a-5eaf-4db4-8e88-179973e7b956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcef2b29-87') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcef2b29-87, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbcef2b29-87, col_values=(('external_ids', {'iface-id': 'bcef2b29-872a-4cb1-9d3d-80fc04ee8254', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:58:5d', 'vm-uuid': '17237e56-67eb-4a05-b004-d27dacc8e04b'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0363550-7b2d-4604-aa41-2fe2fd25eaa4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246, portal: 172.16.0.220,3260]
Aug 15 00:33:57 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246, portal: 172.16.0.220,3260] successful.
Aug 15 00:33:57 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e903abca-474f-4484-a318-54b346e33cbb]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f190b6-c00f-4c96-9822-d73c7f4af4b5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:33:57 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:33:57 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:33:57 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:33:57 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:33:57 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:33:57 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:33:57 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:33:57 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:33:57 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:33:57 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: INFO os_vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:58:5d,bridge_name='br-int',has_traffic_filtering=True,id=bcef2b29-872a-4cb1-9d3d-80fc04ee8254,network=Network(4548537a-5eaf-4db4-8e88-179973e7b956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcef2b29-87')
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1967307702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1967307702',id=9,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb77Tq+A5224r5Krpcf49lfSYOhZYyRwgIvnPx0qjf9uFvGCcyIpUtEgHDjrpNXhairuoL+2ujo9E/dynuHIAklLETDvUdq2ij5w/N0YGRhmy64ulbPiiJ0JESPY0Sz8Q==',key_name='tempest-keypair-1553316417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40820fcd77f4dbc8532e4090dd2ca0b',ramdisk_id='',reservation_id='r-rg5wt6cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-488812863',owner_user_name='tempest-TaggedBootDevicesTest_v242-488812863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7e247179e3845708d8d9565cfe5f472',uuid=17237e56-67eb-4a05-b004-d27dacc8e04b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "592d1e12-5844-4034-bd24-c5882b4be109", "address": "fa:16:3e:c2:dd:0f", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592d1e12-58", "ovs_interfaceid": "592d1e12-5844-4034-bd24-c5882b4be109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converting VIF {"id": "592d1e12-5844-4034-bd24-c5882b4be109", "address": "fa:16:3e:c2:dd:0f", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592d1e12-58", "ovs_interfaceid": "592d1e12-5844-4034-bd24-c5882b4be109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:dd:0f,bridge_name='br-int',has_traffic_filtering=True,id=592d1e12-5844-4034-bd24-c5882b4be109,network=Network(4548537a-5eaf-4db4-8e88-179973e7b956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592d1e12-58') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:dd:0f,bridge_name='br-int',has_traffic_filtering=True,id=592d1e12-5844-4034-bd24-c5882b4be109,network=Network(4548537a-5eaf-4db4-8e88-179973e7b956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592d1e12-58') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap592d1e12-58, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap592d1e12-58, col_values=(('external_ids', {'iface-id': '592d1e12-5844-4034-bd24-c5882b4be109', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:dd:0f', 'vm-uuid': '17237e56-67eb-4a05-b004-d27dacc8e04b'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[873102b4-5161-483f-a1ca-1e2d5fe0da2b]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iouBVYMd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:57 user nova-compute[73010]: INFO os_vif [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:dd:0f,bridge_name='br-int',has_traffic_filtering=True,id=592d1e12-5844-4034-bd24-c5882b4be109,network=Network(4548537a-5eaf-4db4-8e88-179973e7b956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592d1e12-58')
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] No BDM found with device name hda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] No VIF found with MAC fa:16:3e:b2:cf:d1, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:33:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] No VIF found with MAC fa:16:3e:4b:5b:ed, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:33:57 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Using config drive
Aug 15 00:33:57 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Creating config drive at /opt/stack/data/nova/instances/17237e56-67eb-4a05-b004-d27dacc8e04b/disk.config
Aug 15 00:33:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/17237e56-67eb-4a05-b004-d27dacc8e04b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpw95u097x {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/17237e56-67eb-4a05-b004-d27dacc8e04b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpw95u097x" returned: 0 in 0.128s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059638.2771287, da32613e-b1a9-4733-831f-e4fb1f34995f => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:33:58 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] VM Resumed (Lifecycle Event)
Aug 15 00:33:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Instance spawned successfully.
Aug 15 00:33:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:33:58 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:33:58 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059638.2774556, da32613e-b1a9-4733-831f-e4fb1f34995f => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:33:58 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] VM Started (Lifecycle Event)
Aug 15 00:33:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:33:58 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:33:58 user nova-compute[73010]: INFO nova.compute.manager [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Took 6.71 seconds to spawn the instance on the hypervisor.
Aug 15 00:33:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:33:58 user nova-compute[73010]: INFO nova.compute.manager [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Took 7.61 seconds to build instance.
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8fc97540-a26d-46da-a3cc-03b539c7c52d tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.735s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] <== connect_volume: return (2878ms) {'type': 'block', 'scsi_wwn': '26261636134363565', 'path': '/dev/sdf'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261636134363565', 'path': '/dev/sdf'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hIaUewYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:33:58 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:33:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:33:58 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:33:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:33:58 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[056d7462-edea-4e23-81b9-03b6beeb869e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:33:58 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4b8576-3468-47e6-9845-647ac3b34a27]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f] added
Aug 15 00:33:58 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[78358863-6189-47e2-b54e-4719e529a507]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b6475d-d6c1-4868-bc84-6852d279aa86]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hIaUewYq {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hIaUewYq" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcad97a-2af6-4ec7-bf41-9a32e733b9f9]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hIaUewYq'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4ce8e2-7ca0-4d23-85ff-609cecf5a45e]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fa63a6-3061-484b-bed0-aa7f5529c865]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:33:58 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:33:58 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:33:58 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:33:58 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:33:58 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:33:58 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:33:58 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:33:58 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:33:58 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:33:58 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd39b8e-c08d-49da-a313-bca0d741b8e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f, portal: 172.16.0.220,3260]
Aug 15 00:33:58 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f, portal: 172.16.0.220,3260] successful.
Aug 15 00:33:58 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad66891-14e8-475b-8afc-91abe7177d3e]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:33:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ba233f-07c7-49ff-8024-997e7c971d3e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:33:59 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:33:59 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:33:59 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:33:59 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:33:59 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:33:59 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:33:59 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:33:59 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:33:59 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:33:59 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:33:59 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:33:59 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[63459fbe-4550-413e-88f3-0393a45ec37d]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hIaUewYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG nova.objects.instance [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'flavor' on Instance uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:59 user nova-compute[73010]: INFO nova.compute.manager [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Attaching volume 4b15bb6b-3a19-4857-b779-8264e831296c to /dev/vdb
Aug 15 00:33:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG os_brick.utils [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[793d99ea-2d04-423e-aeed-b9d638338e66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[be753a3c-1f0a-4ae2-8529-61ee2e97b539]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f322a522-8d24-4b58-8243-f745e872bc6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb58fc6c-5a92-4064-868c-40d2e54ef777]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:33:59 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[50503a04-0286-4e85-8c40-0d5f1d2a3b34]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG os_brick.utils [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Updating existing volume attachment record: 003e98d1-db2c-4c3b-817b-cd700878d40f {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-61214f8f-1014-4a7e-ad2b-a7f70ab015ff req-d36a86df-b61b-4abd-9ad8-3fa6c50c8b0e service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-plugged-4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-61214f8f-1014-4a7e-ad2b-a7f70ab015ff req-d36a86df-b61b-4abd-9ad8-3fa6c50c8b0e service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-61214f8f-1014-4a7e-ad2b-a7f70ab015ff req-d36a86df-b61b-4abd-9ad8-3fa6c50c8b0e service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-61214f8f-1014-4a7e-ad2b-a7f70ab015ff req-d36a86df-b61b-4abd-9ad8-3fa6c50c8b0e service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:33:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-61214f8f-1014-4a7e-ad2b-a7f70ab015ff req-d36a86df-b61b-4abd-9ad8-3fa6c50c8b0e service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-plugged-4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:33:59 user nova-compute[73010]: WARNING nova.compute.manager [req-61214f8f-1014-4a7e-ad2b-a7f70ab015ff req-d36a86df-b61b-4abd-9ad8-3fa6c50c8b0e service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received unexpected event network-vif-plugged-4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589 for instance with vm_state building and task_state spawning.
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23265626533396234', 'path': '/dev/sdg'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265626533396234', 'path': '/dev/sdg'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309960876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309960876',id=10,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaElAIGo4Bm7GMTjcj3kUyyF4uXCbPJ11OmUatZA3IqbJCewyAirchbAEmc/yMHGA7E1Vppk2rnG29ulZ0YrZY4bYepg512jiGaRtJsEaQvL3cbLMjpmsAkpK/8OJFTng==',key_name='tempest-keypair-786142666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097516b3ada04de28f172aa5c3ff679f',ramdisk_id='',reservation_id='r-kuh2cgmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1736972663',owner_user_name='tempest-TaggedBootDevicesTest-1736972663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61d907257ede4c1eb8a426a90b81abe6',uuid=4c37ecd1-7a9b-4c77-8a52-c81f56321ca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "address": "fa:16:3e:c8:c9:ad", "network": {"id": "7cec561d-d6de-48e3-ab40-d9bff06a031e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1980904641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96202dd8-f6", "ovs_interfaceid": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converting VIF {"id": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "address": "fa:16:3e:c8:c9:ad", "network": {"id": "7cec561d-d6de-48e3-ab40-d9bff06a031e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1980904641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96202dd8-f6", "ovs_interfaceid": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:c9:ad,bridge_name='br-int',has_traffic_filtering=True,id=96202dd8-f6e5-436d-b8e7-1db0469cf513,network=Network(7cec561d-d6de-48e3-ab40-d9bff06a031e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96202dd8-f6') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309960876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309960876',id=10,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaElAIGo4Bm7GMTjcj3kUyyF4uXCbPJ11OmUatZA3IqbJCewyAirchbAEmc/yMHGA7E1Vppk2rnG29ulZ0YrZY4bYepg512jiGaRtJsEaQvL3cbLMjpmsAkpK/8OJFTng==',key_name='tempest-keypair-786142666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097516b3ada04de28f172aa5c3ff679f',ramdisk_id='',reservation_id='r-kuh2cgmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1736972663',owner_user_name='tempest-TaggedBootDevicesTest-1736972663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61d907257ede4c1eb8a426a90b81abe6',uuid=4c37ecd1-7a9b-4c77-8a52-c81f56321ca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "address": "fa:16:3e:ee:92:2f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7932f3-05", "ovs_interfaceid": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converting VIF {"id": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "address": "fa:16:3e:ee:92:2f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7932f3-05", "ovs_interfaceid": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:92:2f,bridge_name='br-int',has_traffic_filtering=True,id=fb7932f3-05b0-4f25-b8f2-38cd50b29fd9,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfb7932f3-05') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309960876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309960876',id=10,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaElAIGo4Bm7GMTjcj3kUyyF4uXCbPJ11OmUatZA3IqbJCewyAirchbAEmc/yMHGA7E1Vppk2rnG29ulZ0YrZY4bYepg512jiGaRtJsEaQvL3cbLMjpmsAkpK/8OJFTng==',key_name='tempest-keypair-786142666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097516b3ada04de28f172aa5c3ff679f',ramdisk_id='',reservation_id='r-kuh2cgmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1736972663',owner_user_name='tempest-TaggedBootDevicesTest-1736972663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61d907257ede4c1eb8a426a90b81abe6',uuid=4c37ecd1-7a9b-4c77-8a52-c81f56321ca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "address": "fa:16:3e:b7:0b:5e", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba8ecd1-f3", "ovs_interfaceid": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converting VIF {"id": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "address": "fa:16:3e:b7:0b:5e", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba8ecd1-f3", "ovs_interfaceid": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0b:5e,bridge_name='br-int',has_traffic_filtering=True,id=1ba8ecd1-f3a8-460d-9f61-b15d9319d83f,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1ba8ecd1-f3') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309960876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309960876',id=10,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaElAIGo4Bm7GMTjcj3kUyyF4uXCbPJ11OmUatZA3IqbJCewyAirchbAEmc/yMHGA7E1Vppk2rnG29ulZ0YrZY4bYepg512jiGaRtJsEaQvL3cbLMjpmsAkpK/8OJFTng==',key_name='tempest-keypair-786142666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097516b3ada04de28f172aa5c3ff679f',ramdisk_id='',reservation_id='r-kuh2cgmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1736972663',owner_user_name='tempest-TaggedBootDevicesTest-1736972663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61d907257ede4c1eb8a426a90b81abe6',uuid=4c37ecd1-7a9b-4c77-8a52-c81f56321ca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "address": "fa:16:3e:f8:e5:9f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34cb5-4d", "ovs_interfaceid": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converting VIF {"id": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "address": "fa:16:3e:f8:e5:9f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34cb5-4d", "ovs_interfaceid": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e5:9f,bridge_name='br-int',has_traffic_filtering=True,id=03a34cb5-4d57-4c59-ba58-b162bf49daa3,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a34cb5-4d') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309960876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309960876',id=10,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaElAIGo4Bm7GMTjcj3kUyyF4uXCbPJ11OmUatZA3IqbJCewyAirchbAEmc/yMHGA7E1Vppk2rnG29ulZ0YrZY4bYepg512jiGaRtJsEaQvL3cbLMjpmsAkpK/8OJFTng==',key_name='tempest-keypair-786142666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097516b3ada04de28f172aa5c3ff679f',ramdisk_id='',reservation_id='r-kuh2cgmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1736972663',owner_user_name='tempest-TaggedBootDevicesTest-1736972663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61d907257ede4c1eb8a426a90b81abe6',uuid=4c37ecd1-7a9b-4c77-8a52-c81f56321ca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd5ce0a2-ca8e-422d-b36a-64006d1e8217", "address": "fa:16:3e:8d:8b:3f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5ce0a2-ca", "ovs_interfaceid": "fd5ce0a2-ca8e-422d-b36a-64006d1e8217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converting VIF {"id": "fd5ce0a2-ca8e-422d-b36a-64006d1e8217", "address": "fa:16:3e:8d:8b:3f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5ce0a2-ca", "ovs_interfaceid": "fd5ce0a2-ca8e-422d-b36a-64006d1e8217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=fd5ce0a2-ca8e-422d-b36a-64006d1e8217,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5ce0a2-ca') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309960876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309960876',id=10,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaElAIGo4Bm7GMTjcj3kUyyF4uXCbPJ11OmUatZA3IqbJCewyAirchbAEmc/yMHGA7E1Vppk2rnG29ulZ0YrZY4bYepg512jiGaRtJsEaQvL3cbLMjpmsAkpK/8OJFTng==',key_name='tempest-keypair-786142666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097516b3ada04de28f172aa5c3ff679f',ramdisk_id='',reservation_id='r-kuh2cgmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1736972663',owner_user_name='tempest-TaggedBootDevicesTest-1736972663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61d907257ede4c1eb8a426a90b81abe6',uuid=4c37ecd1-7a9b-4c77-8a52-c81f56321ca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc702c0a-c79d-48b8-8cc0-7bb18931b11d", "address": "fa:16:3e:69:12:14", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc702c0a-c7", "ovs_interfaceid": "dc702c0a-c79d-48b8-8cc0-7bb18931b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converting VIF {"id": "dc702c0a-c79d-48b8-8cc0-7bb18931b11d", "address": "fa:16:3e:69:12:14", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc702c0a-c7", "ovs_interfaceid": "dc702c0a-c79d-48b8-8cc0-7bb18931b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:12:14,bridge_name='br-int',has_traffic_filtering=True,id=dc702c0a-c79d-48b8-8cc0-7bb18931b11d,network=Network(10ff1ca5-f22f-4571-bf99-edcc3ed43828),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc702c0a-c7') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309960876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309960876',id=10,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaElAIGo4Bm7GMTjcj3kUyyF4uXCbPJ11OmUatZA3IqbJCewyAirchbAEmc/yMHGA7E1Vppk2rnG29ulZ0YrZY4bYepg512jiGaRtJsEaQvL3cbLMjpmsAkpK/8OJFTng==',key_name='tempest-keypair-786142666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097516b3ada04de28f172aa5c3ff679f',ramdisk_id='',reservation_id='r-kuh2cgmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1736972663',owner_user_name='tempest-TaggedBootDevicesTest-1736972663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61d907257ede4c1eb8a426a90b81abe6',uuid=4c37ecd1-7a9b-4c77-8a52-c81f56321ca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df67aaef-5bdd-4a5a-816b-c34392983877", "address": "fa:16:3e:cb:39:d3", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf67aaef-5b", "ovs_interfaceid": "df67aaef-5bdd-4a5a-816b-c34392983877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converting VIF {"id": "df67aaef-5bdd-4a5a-816b-c34392983877", "address": "fa:16:3e:cb:39:d3", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf67aaef-5b", "ovs_interfaceid": "df67aaef-5bdd-4a5a-816b-c34392983877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:39:d3,bridge_name='br-int',has_traffic_filtering=True,id=df67aaef-5bdd-4a5a-816b-c34392983877,network=Network(10ff1ca5-f22f-4571-bf99-edcc3ed43828),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf67aaef-5b') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.objects.instance [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:34:00 user nova-compute[73010]:   <uuid>4c37ecd1-7a9b-4c77-8a52-c81f56321ca3</uuid>
Aug 15 00:34:00 user nova-compute[73010]:   <name>instance-0000000a</name>
Aug 15 00:34:00 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:34:00 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:34:00 user nova-compute[73010]:   <metadata>
Aug 15 00:34:00 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:34:00 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:34:00 user nova-compute[73010]:       <nova:name>tempest-device-tagging-server-309960876</nova:name>
Aug 15 00:34:00 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:33:53</nova:creationTime>
Aug 15 00:34:00 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:34:00 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:34:00 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:34:00 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:34:00 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:34:00 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:34:00 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:34:00 user nova-compute[73010]:       <nova:owner>
Aug 15 00:34:00 user nova-compute[73010]:         <nova:user uuid="61d907257ede4c1eb8a426a90b81abe6">tempest-TaggedBootDevicesTest-1736972663-project-member</nova:user>
Aug 15 00:34:00 user nova-compute[73010]:         <nova:project uuid="097516b3ada04de28f172aa5c3ff679f">tempest-TaggedBootDevicesTest-1736972663</nova:project>
Aug 15 00:34:00 user nova-compute[73010]:       </nova:owner>
Aug 15 00:34:00 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:34:00 user nova-compute[73010]:       <nova:ports>
Aug 15 00:34:00 user nova-compute[73010]:         <nova:port uuid="96202dd8-f6e5-436d-b8e7-1db0469cf513">
Aug 15 00:34:00 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 00:34:00 user nova-compute[73010]:         </nova:port>
Aug 15 00:34:00 user nova-compute[73010]:         <nova:port uuid="fb7932f3-05b0-4f25-b8f2-38cd50b29fd9">
Aug 15 00:34:00 user nova-compute[73010]:           <nova:ip type="fixed" address="10.1.1.87" ipVersion="4"/>
Aug 15 00:34:00 user nova-compute[73010]:         </nova:port>
Aug 15 00:34:00 user nova-compute[73010]:         <nova:port uuid="1ba8ecd1-f3a8-460d-9f61-b15d9319d83f">
Aug 15 00:34:00 user nova-compute[73010]:           <nova:ip type="fixed" address="10.1.1.113" ipVersion="4"/>
Aug 15 00:34:00 user nova-compute[73010]:         </nova:port>
Aug 15 00:34:00 user nova-compute[73010]:         <nova:port uuid="03a34cb5-4d57-4c59-ba58-b162bf49daa3">
Aug 15 00:34:00 user nova-compute[73010]:           <nova:ip type="fixed" address="10.1.1.210" ipVersion="4"/>
Aug 15 00:34:00 user nova-compute[73010]:         </nova:port>
Aug 15 00:34:00 user nova-compute[73010]:         <nova:port uuid="fd5ce0a2-ca8e-422d-b36a-64006d1e8217">
Aug 15 00:34:00 user nova-compute[73010]:           <nova:ip type="fixed" address="10.1.1.129" ipVersion="4"/>
Aug 15 00:34:00 user nova-compute[73010]:         </nova:port>
Aug 15 00:34:00 user nova-compute[73010]:         <nova:port uuid="dc702c0a-c79d-48b8-8cc0-7bb18931b11d">
Aug 15 00:34:00 user nova-compute[73010]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 15 00:34:00 user nova-compute[73010]:         </nova:port>
Aug 15 00:34:00 user nova-compute[73010]:         <nova:port uuid="df67aaef-5bdd-4a5a-816b-c34392983877">
Aug 15 00:34:00 user nova-compute[73010]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 15 00:34:00 user nova-compute[73010]:         </nova:port>
Aug 15 00:34:00 user nova-compute[73010]:       </nova:ports>
Aug 15 00:34:00 user nova-compute[73010]:     </nova:instance>
Aug 15 00:34:00 user nova-compute[73010]:   </metadata>
Aug 15 00:34:00 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:34:00 user nova-compute[73010]:     <system>
Aug 15 00:34:00 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:34:00 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:34:00 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:34:00 user nova-compute[73010]:       <entry name="serial">4c37ecd1-7a9b-4c77-8a52-c81f56321ca3</entry>
Aug 15 00:34:00 user nova-compute[73010]:       <entry name="uuid">4c37ecd1-7a9b-4c77-8a52-c81f56321ca3</entry>
Aug 15 00:34:00 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:34:00 user nova-compute[73010]:     </system>
Aug 15 00:34:00 user nova-compute[73010]:   </sysinfo>
Aug 15 00:34:00 user nova-compute[73010]:   <os>
Aug 15 00:34:00 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:34:00 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:34:00 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:34:00 user nova-compute[73010]:   </os>
Aug 15 00:34:00 user nova-compute[73010]:   <features>
Aug 15 00:34:00 user nova-compute[73010]:     <acpi/>
Aug 15 00:34:00 user nova-compute[73010]:     <apic/>
Aug 15 00:34:00 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:34:00 user nova-compute[73010]:   </features>
Aug 15 00:34:00 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:34:00 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:34:00 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:34:00 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:34:00 user nova-compute[73010]:   </clock>
Aug 15 00:34:00 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:34:00 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:34:00 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:34:00 user nova-compute[73010]:   </cpu>
Aug 15 00:34:00 user nova-compute[73010]:   <devices>
Aug 15 00:34:00 user nova-compute[73010]:     <disk type="file" device="cdrom">
Aug 15 00:34:00 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 00:34:00 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/4c37ecd1-7a9b-4c77-8a52-c81f56321ca3/disk.config"/>
Aug 15 00:34:00 user nova-compute[73010]:       <target dev="hda" bus="ide"/>
Aug 15 00:34:00 user nova-compute[73010]:     </disk>
Aug 15 00:34:00 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 00:34:00 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:34:00 user nova-compute[73010]:       <source dev="/dev/sdd"/>
Aug 15 00:34:00 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:34:00 user nova-compute[73010]:       <serial>8d30d7ee-53a5-48d3-8113-a5172c87455b</serial>
Aug 15 00:34:00 user nova-compute[73010]:     </disk>
Aug 15 00:34:00 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 00:34:00 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:34:00 user nova-compute[73010]:       <source dev="/dev/sdf"/>
Aug 15 00:34:00 user nova-compute[73010]:       <target dev="vdb" bus="virtio"/>
Aug 15 00:34:00 user nova-compute[73010]:       <serial>6127b0fe-bc91-438d-8e0f-b465b3a2e246</serial>
Aug 15 00:34:00 user nova-compute[73010]:     </disk>
Aug 15 00:34:00 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 00:34:00 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:34:00 user nova-compute[73010]:       <source dev="/dev/sdg"/>
Aug 15 00:34:00 user nova-compute[73010]:       <target dev="vdc" bus="virtio"/>
Aug 15 00:34:00 user nova-compute[73010]:       <serial>57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f</serial>
Aug 15 00:34:00 user nova-compute[73010]:     </disk>
Aug 15 00:34:00 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:34:00 user nova-compute[73010]:       <mac address="fa:16:3e:c8:c9:ad"/>
Aug 15 00:34:00 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:34:00 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:34:00 user nova-compute[73010]:       <target dev="tap96202dd8-f6"/>
Aug 15 00:34:00 user nova-compute[73010]:     </interface>
Aug 15 00:34:00 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:34:00 user nova-compute[73010]:       <mac address="fa:16:3e:ee:92:2f"/>
Aug 15 00:34:00 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:34:00 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:34:00 user nova-compute[73010]:       <target dev="tapfb7932f3-05"/>
Aug 15 00:34:00 user nova-compute[73010]:     </interface>
Aug 15 00:34:00 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:34:00 user nova-compute[73010]:       <mac address="fa:16:3e:b7:0b:5e"/>
Aug 15 00:34:00 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:34:00 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:34:00 user nova-compute[73010]:       <target dev="tap1ba8ecd1-f3"/>
Aug 15 00:34:00 user nova-compute[73010]:     </interface>
Aug 15 00:34:00 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:34:00 user nova-compute[73010]:       <mac address="fa:16:3e:f8:e5:9f"/>
Aug 15 00:34:00 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:34:00 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:34:00 user nova-compute[73010]:       <target dev="tap03a34cb5-4d"/>
Aug 15 00:34:00 user nova-compute[73010]:     </interface>
Aug 15 00:34:00 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:34:00 user nova-compute[73010]:       <mac address="fa:16:3e:8d:8b:3f"/>
Aug 15 00:34:00 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:34:00 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:34:00 user nova-compute[73010]:       <target dev="tapfd5ce0a2-ca"/>
Aug 15 00:34:00 user nova-compute[73010]:     </interface>
Aug 15 00:34:00 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:34:00 user nova-compute[73010]:       <mac address="fa:16:3e:69:12:14"/>
Aug 15 00:34:00 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:34:00 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:34:00 user nova-compute[73010]:       <target dev="tapdc702c0a-c7"/>
Aug 15 00:34:00 user nova-compute[73010]:     </interface>
Aug 15 00:34:00 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:34:00 user nova-compute[73010]:       <mac address="fa:16:3e:cb:39:d3"/>
Aug 15 00:34:00 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:34:00 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:34:00 user nova-compute[73010]:       <target dev="tapdf67aaef-5b"/>
Aug 15 00:34:00 user nova-compute[73010]:     </interface>
Aug 15 00:34:00 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:34:00 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/4c37ecd1-7a9b-4c77-8a52-c81f56321ca3/console.log" append="off"/>
Aug 15 00:34:00 user nova-compute[73010]:     </serial>
Aug 15 00:34:00 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:34:00 user nova-compute[73010]:     <video>
Aug 15 00:34:00 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:34:00 user nova-compute[73010]:     </video>
Aug 15 00:34:00 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:34:00 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:34:00 user nova-compute[73010]:     </rng>
Aug 15 00:34:00 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:34:00 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:34:00 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:34:00 user nova-compute[73010]:     </memballoon>
Aug 15 00:34:00 user nova-compute[73010]:   </devices>
Aug 15 00:34:00 user nova-compute[73010]: </domain>
Aug 15 00:34:00 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309960876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309960876',id=10,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaElAIGo4Bm7GMTjcj3kUyyF4uXCbPJ11OmUatZA3IqbJCewyAirchbAEmc/yMHGA7E1Vppk2rnG29ulZ0YrZY4bYepg512jiGaRtJsEaQvL3cbLMjpmsAkpK/8OJFTng==',key_name='tempest-keypair-786142666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097516b3ada04de28f172aa5c3ff679f',ramdisk_id='',reservation_id='r-kuh2cgmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1736972663',owner_user_name='tempest-TaggedBootDevicesTest-1736972663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61d907257ede4c1eb8a426a90b81abe6',uuid=4c37ecd1-7a9b-4c77-8a52-c81f56321ca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "address": "fa:16:3e:c8:c9:ad", "network": {"id": "7cec561d-d6de-48e3-ab40-d9bff06a031e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1980904641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96202dd8-f6", "ovs_interfaceid": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converting VIF {"id": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "address": "fa:16:3e:c8:c9:ad", "network": {"id": "7cec561d-d6de-48e3-ab40-d9bff06a031e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1980904641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96202dd8-f6", "ovs_interfaceid": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:c9:ad,bridge_name='br-int',has_traffic_filtering=True,id=96202dd8-f6e5-436d-b8e7-1db0469cf513,network=Network(7cec561d-d6de-48e3-ab40-d9bff06a031e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96202dd8-f6') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG os_vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:c9:ad,bridge_name='br-int',has_traffic_filtering=True,id=96202dd8-f6e5-436d-b8e7-1db0469cf513,network=Network(7cec561d-d6de-48e3-ab40-d9bff06a031e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96202dd8-f6') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96202dd8-f6, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96202dd8-f6, col_values=(('external_ids', {'iface-id': '96202dd8-f6e5-436d-b8e7-1db0469cf513', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:c9:ad', 'vm-uuid': '4c37ecd1-7a9b-4c77-8a52-c81f56321ca3'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:00 user nova-compute[73010]: INFO os_vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:c9:ad,bridge_name='br-int',has_traffic_filtering=True,id=96202dd8-f6e5-436d-b8e7-1db0469cf513,network=Network(7cec561d-d6de-48e3-ab40-d9bff06a031e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96202dd8-f6')
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309960876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309960876',id=10,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaElAIGo4Bm7GMTjcj3kUyyF4uXCbPJ11OmUatZA3IqbJCewyAirchbAEmc/yMHGA7E1Vppk2rnG29ulZ0YrZY4bYepg512jiGaRtJsEaQvL3cbLMjpmsAkpK/8OJFTng==',key_name='tempest-keypair-786142666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097516b3ada04de28f172aa5c3ff679f',ramdisk_id='',reservation_id='r-kuh2cgmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1736972663',owner_user_name='tempest-TaggedBootDevicesTest-1736972663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61d907257ede4c1eb8a426a90b81abe6',uuid=4c37ecd1-7a9b-4c77-8a52-c81f56321ca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "address": "fa:16:3e:ee:92:2f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7932f3-05", "ovs_interfaceid": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converting VIF {"id": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "address": "fa:16:3e:ee:92:2f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7932f3-05", "ovs_interfaceid": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:92:2f,bridge_name='br-int',has_traffic_filtering=True,id=fb7932f3-05b0-4f25-b8f2-38cd50b29fd9,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfb7932f3-05') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG os_vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:92:2f,bridge_name='br-int',has_traffic_filtering=True,id=fb7932f3-05b0-4f25-b8f2-38cd50b29fd9,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfb7932f3-05') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb7932f3-05, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfb7932f3-05, col_values=(('external_ids', {'iface-id': 'fb7932f3-05b0-4f25-b8f2-38cd50b29fd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:92:2f', 'vm-uuid': '4c37ecd1-7a9b-4c77-8a52-c81f56321ca3'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:00 user nova-compute[73010]: INFO os_vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:92:2f,bridge_name='br-int',has_traffic_filtering=True,id=fb7932f3-05b0-4f25-b8f2-38cd50b29fd9,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfb7932f3-05')
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309960876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309960876',id=10,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaElAIGo4Bm7GMTjcj3kUyyF4uXCbPJ11OmUatZA3IqbJCewyAirchbAEmc/yMHGA7E1Vppk2rnG29ulZ0YrZY4bYepg512jiGaRtJsEaQvL3cbLMjpmsAkpK/8OJFTng==',key_name='tempest-keypair-786142666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097516b3ada04de28f172aa5c3ff679f',ramdisk_id='',reservation_id='r-kuh2cgmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1736972663',owner_user_name='tempest-TaggedBootDevicesTest-1736972663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61d907257ede4c1eb8a426a90b81abe6',uuid=4c37ecd1-7a9b-4c77-8a52-c81f56321ca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "address": "fa:16:3e:b7:0b:5e", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba8ecd1-f3", "ovs_interfaceid": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converting VIF {"id": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "address": "fa:16:3e:b7:0b:5e", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba8ecd1-f3", "ovs_interfaceid": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0b:5e,bridge_name='br-int',has_traffic_filtering=True,id=1ba8ecd1-f3a8-460d-9f61-b15d9319d83f,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1ba8ecd1-f3') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG os_vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0b:5e,bridge_name='br-int',has_traffic_filtering=True,id=1ba8ecd1-f3a8-460d-9f61-b15d9319d83f,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1ba8ecd1-f3') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ba8ecd1-f3, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ba8ecd1-f3, col_values=(('external_ids', {'iface-id': '1ba8ecd1-f3a8-460d-9f61-b15d9319d83f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:0b:5e', 'vm-uuid': '4c37ecd1-7a9b-4c77-8a52-c81f56321ca3'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.compute.manager [req-85cbbf24-ee97-4d57-a8a7-db23940ec1dd req-464d1957-fb26-4cf5-a0e2-61ca19d1cfc0 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-plugged-21837e06-6627-4156-8b30-7b1499f01b5d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-85cbbf24-ee97-4d57-a8a7-db23940ec1dd req-464d1957-fb26-4cf5-a0e2-61ca19d1cfc0 service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-85cbbf24-ee97-4d57-a8a7-db23940ec1dd req-464d1957-fb26-4cf5-a0e2-61ca19d1cfc0 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-85cbbf24-ee97-4d57-a8a7-db23940ec1dd req-464d1957-fb26-4cf5-a0e2-61ca19d1cfc0 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.compute.manager [req-85cbbf24-ee97-4d57-a8a7-db23940ec1dd req-464d1957-fb26-4cf5-a0e2-61ca19d1cfc0 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-plugged-21837e06-6627-4156-8b30-7b1499f01b5d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:00 user nova-compute[73010]: WARNING nova.compute.manager [req-85cbbf24-ee97-4d57-a8a7-db23940ec1dd req-464d1957-fb26-4cf5-a0e2-61ca19d1cfc0 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received unexpected event network-vif-plugged-21837e06-6627-4156-8b30-7b1499f01b5d for instance with vm_state building and task_state spawning.
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:00 user nova-compute[73010]: INFO os_vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0b:5e,bridge_name='br-int',has_traffic_filtering=True,id=1ba8ecd1-f3a8-460d-9f61-b15d9319d83f,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1ba8ecd1-f3')
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309960876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309960876',id=10,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaElAIGo4Bm7GMTjcj3kUyyF4uXCbPJ11OmUatZA3IqbJCewyAirchbAEmc/yMHGA7E1Vppk2rnG29ulZ0YrZY4bYepg512jiGaRtJsEaQvL3cbLMjpmsAkpK/8OJFTng==',key_name='tempest-keypair-786142666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097516b3ada04de28f172aa5c3ff679f',ramdisk_id='',reservation_id='r-kuh2cgmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1736972663',owner_user_name='tempest-TaggedBootDevicesTest-1736972663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61d907257ede4c1eb8a426a90b81abe6',uuid=4c37ecd1-7a9b-4c77-8a52-c81f56321ca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "address": "fa:16:3e:f8:e5:9f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34cb5-4d", "ovs_interfaceid": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converting VIF {"id": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "address": "fa:16:3e:f8:e5:9f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34cb5-4d", "ovs_interfaceid": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e5:9f,bridge_name='br-int',has_traffic_filtering=True,id=03a34cb5-4d57-4c59-ba58-b162bf49daa3,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a34cb5-4d') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG os_vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e5:9f,bridge_name='br-int',has_traffic_filtering=True,id=03a34cb5-4d57-4c59-ba58-b162bf49daa3,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a34cb5-4d') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03a34cb5-4d, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap03a34cb5-4d, col_values=(('external_ids', {'iface-id': '03a34cb5-4d57-4c59-ba58-b162bf49daa3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:e5:9f', 'vm-uuid': '4c37ecd1-7a9b-4c77-8a52-c81f56321ca3'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:00 user nova-compute[73010]: INFO os_vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e5:9f,bridge_name='br-int',has_traffic_filtering=True,id=03a34cb5-4d57-4c59-ba58-b162bf49daa3,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a34cb5-4d')
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309960876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309960876',id=10,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaElAIGo4Bm7GMTjcj3kUyyF4uXCbPJ11OmUatZA3IqbJCewyAirchbAEmc/yMHGA7E1Vppk2rnG29ulZ0YrZY4bYepg512jiGaRtJsEaQvL3cbLMjpmsAkpK/8OJFTng==',key_name='tempest-keypair-786142666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097516b3ada04de28f172aa5c3ff679f',ramdisk_id='',reservation_id='r-kuh2cgmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1736972663',owner_user_name='tempest-TaggedBootDevicesTest-1736972663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61d907257ede4c1eb8a426a90b81abe6',uuid=4c37ecd1-7a9b-4c77-8a52-c81f56321ca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd5ce0a2-ca8e-422d-b36a-64006d1e8217", "address": "fa:16:3e:8d:8b:3f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5ce0a2-ca", "ovs_interfaceid": "fd5ce0a2-ca8e-422d-b36a-64006d1e8217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converting VIF {"id": "fd5ce0a2-ca8e-422d-b36a-64006d1e8217", "address": "fa:16:3e:8d:8b:3f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5ce0a2-ca", "ovs_interfaceid": "fd5ce0a2-ca8e-422d-b36a-64006d1e8217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=fd5ce0a2-ca8e-422d-b36a-64006d1e8217,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5ce0a2-ca') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG os_vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=fd5ce0a2-ca8e-422d-b36a-64006d1e8217,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5ce0a2-ca') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd5ce0a2-ca, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd5ce0a2-ca, col_values=(('external_ids', {'iface-id': 'fd5ce0a2-ca8e-422d-b36a-64006d1e8217', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:8b:3f', 'vm-uuid': '4c37ecd1-7a9b-4c77-8a52-c81f56321ca3'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:01 user nova-compute[73010]: INFO os_vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=fd5ce0a2-ca8e-422d-b36a-64006d1e8217,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5ce0a2-ca')
Aug 15 00:34:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309960876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309960876',id=10,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaElAIGo4Bm7GMTjcj3kUyyF4uXCbPJ11OmUatZA3IqbJCewyAirchbAEmc/yMHGA7E1Vppk2rnG29ulZ0YrZY4bYepg512jiGaRtJsEaQvL3cbLMjpmsAkpK/8OJFTng==',key_name='tempest-keypair-786142666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097516b3ada04de28f172aa5c3ff679f',ramdisk_id='',reservation_id='r-kuh2cgmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1736972663',owner_user_name='tempest-TaggedBootDevicesTest-1736972663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61d907257ede4c1eb8a426a90b81abe6',uuid=4c37ecd1-7a9b-4c77-8a52-c81f56321ca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc702c0a-c79d-48b8-8cc0-7bb18931b11d", "address": "fa:16:3e:69:12:14", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc702c0a-c7", "ovs_interfaceid": "dc702c0a-c79d-48b8-8cc0-7bb18931b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converting VIF {"id": "dc702c0a-c79d-48b8-8cc0-7bb18931b11d", "address": "fa:16:3e:69:12:14", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc702c0a-c7", "ovs_interfaceid": "dc702c0a-c79d-48b8-8cc0-7bb18931b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:12:14,bridge_name='br-int',has_traffic_filtering=True,id=dc702c0a-c79d-48b8-8cc0-7bb18931b11d,network=Network(10ff1ca5-f22f-4571-bf99-edcc3ed43828),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc702c0a-c7') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG os_vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:12:14,bridge_name='br-int',has_traffic_filtering=True,id=dc702c0a-c79d-48b8-8cc0-7bb18931b11d,network=Network(10ff1ca5-f22f-4571-bf99-edcc3ed43828),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc702c0a-c7') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc702c0a-c7, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdc702c0a-c7, col_values=(('external_ids', {'iface-id': 'dc702c0a-c79d-48b8-8cc0-7bb18931b11d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:12:14', 'vm-uuid': '4c37ecd1-7a9b-4c77-8a52-c81f56321ca3'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:01 user nova-compute[73010]: INFO os_vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:12:14,bridge_name='br-int',has_traffic_filtering=True,id=dc702c0a-c79d-48b8-8cc0-7bb18931b11d,network=Network(10ff1ca5-f22f-4571-bf99-edcc3ed43828),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc702c0a-c7')
Aug 15 00:34:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309960876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309960876',id=10,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaElAIGo4Bm7GMTjcj3kUyyF4uXCbPJ11OmUatZA3IqbJCewyAirchbAEmc/yMHGA7E1Vppk2rnG29ulZ0YrZY4bYepg512jiGaRtJsEaQvL3cbLMjpmsAkpK/8OJFTng==',key_name='tempest-keypair-786142666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097516b3ada04de28f172aa5c3ff679f',ramdisk_id='',reservation_id='r-kuh2cgmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1736972663',owner_user_name='tempest-TaggedBootDevicesTest-1736972663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61d907257ede4c1eb8a426a90b81abe6',uuid=4c37ecd1-7a9b-4c77-8a52-c81f56321ca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df67aaef-5bdd-4a5a-816b-c34392983877", "address": "fa:16:3e:cb:39:d3", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf67aaef-5b", "ovs_interfaceid": "df67aaef-5bdd-4a5a-816b-c34392983877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converting VIF {"id": "df67aaef-5bdd-4a5a-816b-c34392983877", "address": "fa:16:3e:cb:39:d3", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf67aaef-5b", "ovs_interfaceid": "df67aaef-5bdd-4a5a-816b-c34392983877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:39:d3,bridge_name='br-int',has_traffic_filtering=True,id=df67aaef-5bdd-4a5a-816b-c34392983877,network=Network(10ff1ca5-f22f-4571-bf99-edcc3ed43828),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf67aaef-5b') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG os_vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:39:d3,bridge_name='br-int',has_traffic_filtering=True,id=df67aaef-5bdd-4a5a-816b-c34392983877,network=Network(10ff1ca5-f22f-4571-bf99-edcc3ed43828),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf67aaef-5b') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf67aaef-5b, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf67aaef-5b, col_values=(('external_ids', {'iface-id': 'df67aaef-5bdd-4a5a-816b-c34392983877', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:39:d3', 'vm-uuid': '4c37ecd1-7a9b-4c77-8a52-c81f56321ca3'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG nova.compute.manager [req-a57ca7f6-e1df-4d9a-b627-3232762a8127 req-6b03b8b9-9eb2-45bd-96cc-5f0797bb7a4b service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-plugged-6a7825db-198c-48a3-a587-07e565e7f151 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a57ca7f6-e1df-4d9a-b627-3232762a8127 req-6b03b8b9-9eb2-45bd-96cc-5f0797bb7a4b service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a57ca7f6-e1df-4d9a-b627-3232762a8127 req-6b03b8b9-9eb2-45bd-96cc-5f0797bb7a4b service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a57ca7f6-e1df-4d9a-b627-3232762a8127 req-6b03b8b9-9eb2-45bd-96cc-5f0797bb7a4b service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG nova.compute.manager [req-a57ca7f6-e1df-4d9a-b627-3232762a8127 req-6b03b8b9-9eb2-45bd-96cc-5f0797bb7a4b service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-plugged-6a7825db-198c-48a3-a587-07e565e7f151 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:01 user nova-compute[73010]: WARNING nova.compute.manager [req-a57ca7f6-e1df-4d9a-b627-3232762a8127 req-6b03b8b9-9eb2-45bd-96cc-5f0797bb7a4b service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received unexpected event network-vif-plugged-6a7825db-198c-48a3-a587-07e565e7f151 for instance with vm_state building and task_state spawning.
Aug 15 00:34:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:01 user nova-compute[73010]: INFO os_vif [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:39:d3,bridge_name='br-int',has_traffic_filtering=True,id=df67aaef-5bdd-4a5a-816b-c34392983877,network=Network(10ff1ca5-f22f-4571-bf99-edcc3ed43828),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf67aaef-5b')
Aug 15 00:34:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] No BDM found with device name hda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] No VIF found with MAC fa:16:3e:c8:c9:ad, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:34:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] No VIF found with MAC fa:16:3e:8d:8b:3f, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:34:01 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Using config drive
Aug 15 00:34:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:02 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Creating config drive at /opt/stack/data/nova/instances/4c37ecd1-7a9b-4c77-8a52-c81f56321ca3/disk.config
Aug 15 00:34:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4c37ecd1-7a9b-4c77-8a52-c81f56321ca3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmu0clb9c {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-936bfaf0-290b-4945-96da-fb5e90ad3bbb req-2b7ea0b6-6022-4a63-a9d8-c8cda7b370ae service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-plugged-4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-936bfaf0-290b-4945-96da-fb5e90ad3bbb req-2b7ea0b6-6022-4a63-a9d8-c8cda7b370ae service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-936bfaf0-290b-4945-96da-fb5e90ad3bbb req-2b7ea0b6-6022-4a63-a9d8-c8cda7b370ae service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-936bfaf0-290b-4945-96da-fb5e90ad3bbb req-2b7ea0b6-6022-4a63-a9d8-c8cda7b370ae service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-936bfaf0-290b-4945-96da-fb5e90ad3bbb req-2b7ea0b6-6022-4a63-a9d8-c8cda7b370ae service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-plugged-4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:02 user nova-compute[73010]: WARNING nova.compute.manager [req-936bfaf0-290b-4945-96da-fb5e90ad3bbb req-2b7ea0b6-6022-4a63-a9d8-c8cda7b370ae service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received unexpected event network-vif-plugged-4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589 for instance with vm_state building and task_state spawning.
Aug 15 00:34:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4c37ecd1-7a9b-4c77-8a52-c81f56321ca3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmu0clb9c" returned: 0 in 0.089s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-2e17074f-68bc-4b66-9597-933802cbec6b req-b610aa6d-983b-45c5-bb7b-960ea666cd06 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-plugged-21837e06-6627-4156-8b30-7b1499f01b5d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2e17074f-68bc-4b66-9597-933802cbec6b req-b610aa6d-983b-45c5-bb7b-960ea666cd06 service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2e17074f-68bc-4b66-9597-933802cbec6b req-b610aa6d-983b-45c5-bb7b-960ea666cd06 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2e17074f-68bc-4b66-9597-933802cbec6b req-b610aa6d-983b-45c5-bb7b-960ea666cd06 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-2e17074f-68bc-4b66-9597-933802cbec6b req-b610aa6d-983b-45c5-bb7b-960ea666cd06 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-plugged-21837e06-6627-4156-8b30-7b1499f01b5d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:02 user nova-compute[73010]: WARNING nova.compute.manager [req-2e17074f-68bc-4b66-9597-933802cbec6b req-b610aa6d-983b-45c5-bb7b-960ea666cd06 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received unexpected event network-vif-plugged-21837e06-6627-4156-8b30-7b1499f01b5d for instance with vm_state building and task_state spawning.
Aug 15 00:34:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-2e17074f-68bc-4b66-9597-933802cbec6b req-b610aa6d-983b-45c5-bb7b-960ea666cd06 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-plugged-e45de596-2e5e-4306-a083-181d25a33abd {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2e17074f-68bc-4b66-9597-933802cbec6b req-b610aa6d-983b-45c5-bb7b-960ea666cd06 service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2e17074f-68bc-4b66-9597-933802cbec6b req-b610aa6d-983b-45c5-bb7b-960ea666cd06 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2e17074f-68bc-4b66-9597-933802cbec6b req-b610aa6d-983b-45c5-bb7b-960ea666cd06 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-2e17074f-68bc-4b66-9597-933802cbec6b req-b610aa6d-983b-45c5-bb7b-960ea666cd06 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-plugged-e45de596-2e5e-4306-a083-181d25a33abd {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:02 user nova-compute[73010]: WARNING nova.compute.manager [req-2e17074f-68bc-4b66-9597-933802cbec6b req-b610aa6d-983b-45c5-bb7b-960ea666cd06 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received unexpected event network-vif-plugged-e45de596-2e5e-4306-a083-181d25a33abd for instance with vm_state building and task_state spawning.
Aug 15 00:34:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-2e17074f-68bc-4b66-9597-933802cbec6b req-b610aa6d-983b-45c5-bb7b-960ea666cd06 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-plugged-e45de596-2e5e-4306-a083-181d25a33abd {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2e17074f-68bc-4b66-9597-933802cbec6b req-b610aa6d-983b-45c5-bb7b-960ea666cd06 service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2e17074f-68bc-4b66-9597-933802cbec6b req-b610aa6d-983b-45c5-bb7b-960ea666cd06 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2e17074f-68bc-4b66-9597-933802cbec6b req-b610aa6d-983b-45c5-bb7b-960ea666cd06 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-2e17074f-68bc-4b66-9597-933802cbec6b req-b610aa6d-983b-45c5-bb7b-960ea666cd06 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-plugged-e45de596-2e5e-4306-a083-181d25a33abd {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:02 user nova-compute[73010]: WARNING nova.compute.manager [req-2e17074f-68bc-4b66-9597-933802cbec6b req-b610aa6d-983b-45c5-bb7b-960ea666cd06 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received unexpected event network-vif-plugged-e45de596-2e5e-4306-a083-181d25a33abd for instance with vm_state building and task_state spawning.
Aug 15 00:34:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-2e17074f-68bc-4b66-9597-933802cbec6b req-b610aa6d-983b-45c5-bb7b-960ea666cd06 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-plugged-592d1e12-5844-4034-bd24-c5882b4be109 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2e17074f-68bc-4b66-9597-933802cbec6b req-b610aa6d-983b-45c5-bb7b-960ea666cd06 service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2e17074f-68bc-4b66-9597-933802cbec6b req-b610aa6d-983b-45c5-bb7b-960ea666cd06 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2e17074f-68bc-4b66-9597-933802cbec6b req-b610aa6d-983b-45c5-bb7b-960ea666cd06 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-2e17074f-68bc-4b66-9597-933802cbec6b req-b610aa6d-983b-45c5-bb7b-960ea666cd06 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-plugged-592d1e12-5844-4034-bd24-c5882b4be109 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:02 user nova-compute[73010]: WARNING nova.compute.manager [req-2e17074f-68bc-4b66-9597-933802cbec6b req-b610aa6d-983b-45c5-bb7b-960ea666cd06 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received unexpected event network-vif-plugged-592d1e12-5844-4034-bd24-c5882b4be109 for instance with vm_state building and task_state spawning.
Aug 15 00:34:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:03 user nova-compute[73010]: DEBUG nova.compute.manager [req-e92a9daa-5147-4f63-832d-ffa4b0c0a1f1 req-d4bc40b0-4ca4-47c3-b53d-28bb238ea39a service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-plugged-6a7825db-198c-48a3-a587-07e565e7f151 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e92a9daa-5147-4f63-832d-ffa4b0c0a1f1 req-d4bc40b0-4ca4-47c3-b53d-28bb238ea39a service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e92a9daa-5147-4f63-832d-ffa4b0c0a1f1 req-d4bc40b0-4ca4-47c3-b53d-28bb238ea39a service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e92a9daa-5147-4f63-832d-ffa4b0c0a1f1 req-d4bc40b0-4ca4-47c3-b53d-28bb238ea39a service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:03 user nova-compute[73010]: DEBUG nova.compute.manager [req-e92a9daa-5147-4f63-832d-ffa4b0c0a1f1 req-d4bc40b0-4ca4-47c3-b53d-28bb238ea39a service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-plugged-6a7825db-198c-48a3-a587-07e565e7f151 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:03 user nova-compute[73010]: WARNING nova.compute.manager [req-e92a9daa-5147-4f63-832d-ffa4b0c0a1f1 req-d4bc40b0-4ca4-47c3-b53d-28bb238ea39a service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received unexpected event network-vif-plugged-6a7825db-198c-48a3-a587-07e565e7f151 for instance with vm_state building and task_state spawning.
Aug 15 00:34:03 user nova-compute[73010]: DEBUG nova.compute.manager [req-e92a9daa-5147-4f63-832d-ffa4b0c0a1f1 req-d4bc40b0-4ca4-47c3-b53d-28bb238ea39a service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-plugged-c0a7a8fb-96d7-4d75-9c81-bebe9861874d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e92a9daa-5147-4f63-832d-ffa4b0c0a1f1 req-d4bc40b0-4ca4-47c3-b53d-28bb238ea39a service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e92a9daa-5147-4f63-832d-ffa4b0c0a1f1 req-d4bc40b0-4ca4-47c3-b53d-28bb238ea39a service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e92a9daa-5147-4f63-832d-ffa4b0c0a1f1 req-d4bc40b0-4ca4-47c3-b53d-28bb238ea39a service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:03 user nova-compute[73010]: DEBUG nova.compute.manager [req-e92a9daa-5147-4f63-832d-ffa4b0c0a1f1 req-d4bc40b0-4ca4-47c3-b53d-28bb238ea39a service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-plugged-c0a7a8fb-96d7-4d75-9c81-bebe9861874d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:03 user nova-compute[73010]: WARNING nova.compute.manager [req-e92a9daa-5147-4f63-832d-ffa4b0c0a1f1 req-d4bc40b0-4ca4-47c3-b53d-28bb238ea39a service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received unexpected event network-vif-plugged-c0a7a8fb-96d7-4d75-9c81-bebe9861874d for instance with vm_state building and task_state spawning.
Aug 15 00:34:03 user nova-compute[73010]: DEBUG nova.compute.manager [req-e92a9daa-5147-4f63-832d-ffa4b0c0a1f1 req-d4bc40b0-4ca4-47c3-b53d-28bb238ea39a service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-plugged-c0a7a8fb-96d7-4d75-9c81-bebe9861874d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e92a9daa-5147-4f63-832d-ffa4b0c0a1f1 req-d4bc40b0-4ca4-47c3-b53d-28bb238ea39a service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e92a9daa-5147-4f63-832d-ffa4b0c0a1f1 req-d4bc40b0-4ca4-47c3-b53d-28bb238ea39a service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e92a9daa-5147-4f63-832d-ffa4b0c0a1f1 req-d4bc40b0-4ca4-47c3-b53d-28bb238ea39a service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:03 user nova-compute[73010]: DEBUG nova.compute.manager [req-e92a9daa-5147-4f63-832d-ffa4b0c0a1f1 req-d4bc40b0-4ca4-47c3-b53d-28bb238ea39a service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-plugged-c0a7a8fb-96d7-4d75-9c81-bebe9861874d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:03 user nova-compute[73010]: WARNING nova.compute.manager [req-e92a9daa-5147-4f63-832d-ffa4b0c0a1f1 req-d4bc40b0-4ca4-47c3-b53d-28bb238ea39a service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received unexpected event network-vif-plugged-c0a7a8fb-96d7-4d75-9c81-bebe9861874d for instance with vm_state building and task_state spawning.
Aug 15 00:34:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:04 user nova-compute[73010]: DEBUG nova.compute.manager [req-634b3a25-7c78-4021-9ba6-300df4deb3b8 req-0a4795e8-73e3-4f2d-940b-ac54bee75b54 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-plugged-bcef2b29-872a-4cb1-9d3d-80fc04ee8254 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-634b3a25-7c78-4021-9ba6-300df4deb3b8 req-0a4795e8-73e3-4f2d-940b-ac54bee75b54 service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-634b3a25-7c78-4021-9ba6-300df4deb3b8 req-0a4795e8-73e3-4f2d-940b-ac54bee75b54 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-634b3a25-7c78-4021-9ba6-300df4deb3b8 req-0a4795e8-73e3-4f2d-940b-ac54bee75b54 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:04 user nova-compute[73010]: DEBUG nova.compute.manager [req-634b3a25-7c78-4021-9ba6-300df4deb3b8 req-0a4795e8-73e3-4f2d-940b-ac54bee75b54 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-plugged-bcef2b29-872a-4cb1-9d3d-80fc04ee8254 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:04 user nova-compute[73010]: WARNING nova.compute.manager [req-634b3a25-7c78-4021-9ba6-300df4deb3b8 req-0a4795e8-73e3-4f2d-940b-ac54bee75b54 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received unexpected event network-vif-plugged-bcef2b29-872a-4cb1-9d3d-80fc04ee8254 for instance with vm_state building and task_state spawning.
Aug 15 00:34:04 user nova-compute[73010]: DEBUG nova.compute.manager [req-634b3a25-7c78-4021-9ba6-300df4deb3b8 req-0a4795e8-73e3-4f2d-940b-ac54bee75b54 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-plugged-bcef2b29-872a-4cb1-9d3d-80fc04ee8254 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-634b3a25-7c78-4021-9ba6-300df4deb3b8 req-0a4795e8-73e3-4f2d-940b-ac54bee75b54 service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-634b3a25-7c78-4021-9ba6-300df4deb3b8 req-0a4795e8-73e3-4f2d-940b-ac54bee75b54 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-634b3a25-7c78-4021-9ba6-300df4deb3b8 req-0a4795e8-73e3-4f2d-940b-ac54bee75b54 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:04 user nova-compute[73010]: DEBUG nova.compute.manager [req-634b3a25-7c78-4021-9ba6-300df4deb3b8 req-0a4795e8-73e3-4f2d-940b-ac54bee75b54 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-plugged-bcef2b29-872a-4cb1-9d3d-80fc04ee8254 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:04 user nova-compute[73010]: WARNING nova.compute.manager [req-634b3a25-7c78-4021-9ba6-300df4deb3b8 req-0a4795e8-73e3-4f2d-940b-ac54bee75b54 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received unexpected event network-vif-plugged-bcef2b29-872a-4cb1-9d3d-80fc04ee8254 for instance with vm_state building and task_state spawning.
Aug 15 00:34:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:04 user nova-compute[73010]: DEBUG nova.compute.manager [req-f302e3ad-587a-4b1d-9534-5d5768f7161a req-7fcea2c4-87df-4cbf-889e-cadfa640ac6d service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-plugged-592d1e12-5844-4034-bd24-c5882b4be109 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f302e3ad-587a-4b1d-9534-5d5768f7161a req-7fcea2c4-87df-4cbf-889e-cadfa640ac6d service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f302e3ad-587a-4b1d-9534-5d5768f7161a req-7fcea2c4-87df-4cbf-889e-cadfa640ac6d service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f302e3ad-587a-4b1d-9534-5d5768f7161a req-7fcea2c4-87df-4cbf-889e-cadfa640ac6d service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:04 user nova-compute[73010]: DEBUG nova.compute.manager [req-f302e3ad-587a-4b1d-9534-5d5768f7161a req-7fcea2c4-87df-4cbf-889e-cadfa640ac6d service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-plugged-592d1e12-5844-4034-bd24-c5882b4be109 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:04 user nova-compute[73010]: WARNING nova.compute.manager [req-f302e3ad-587a-4b1d-9534-5d5768f7161a req-7fcea2c4-87df-4cbf-889e-cadfa640ac6d service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received unexpected event network-vif-plugged-592d1e12-5844-4034-bd24-c5882b4be109 for instance with vm_state building and task_state spawning.
Aug 15 00:34:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG nova.compute.manager [req-647aeda9-fca2-4de6-b7be-aff3b18847e3 req-dd1b0697-3a47-4d56-b578-2011bb871339 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-plugged-96202dd8-f6e5-436d-b8e7-1db0469cf513 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-647aeda9-fca2-4de6-b7be-aff3b18847e3 req-dd1b0697-3a47-4d56-b578-2011bb871339 service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-647aeda9-fca2-4de6-b7be-aff3b18847e3 req-dd1b0697-3a47-4d56-b578-2011bb871339 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-647aeda9-fca2-4de6-b7be-aff3b18847e3 req-dd1b0697-3a47-4d56-b578-2011bb871339 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG nova.compute.manager [req-647aeda9-fca2-4de6-b7be-aff3b18847e3 req-dd1b0697-3a47-4d56-b578-2011bb871339 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-plugged-96202dd8-f6e5-436d-b8e7-1db0469cf513 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:05 user nova-compute[73010]: WARNING nova.compute.manager [req-647aeda9-fca2-4de6-b7be-aff3b18847e3 req-dd1b0697-3a47-4d56-b578-2011bb871339 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received unexpected event network-vif-plugged-96202dd8-f6e5-436d-b8e7-1db0469cf513 for instance with vm_state building and task_state spawning.
Aug 15 00:34:05 user nova-compute[73010]: DEBUG nova.compute.manager [req-647aeda9-fca2-4de6-b7be-aff3b18847e3 req-dd1b0697-3a47-4d56-b578-2011bb871339 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-plugged-96202dd8-f6e5-436d-b8e7-1db0469cf513 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-647aeda9-fca2-4de6-b7be-aff3b18847e3 req-dd1b0697-3a47-4d56-b578-2011bb871339 service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-647aeda9-fca2-4de6-b7be-aff3b18847e3 req-dd1b0697-3a47-4d56-b578-2011bb871339 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-647aeda9-fca2-4de6-b7be-aff3b18847e3 req-dd1b0697-3a47-4d56-b578-2011bb871339 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG nova.compute.manager [req-647aeda9-fca2-4de6-b7be-aff3b18847e3 req-dd1b0697-3a47-4d56-b578-2011bb871339 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-plugged-96202dd8-f6e5-436d-b8e7-1db0469cf513 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:05 user nova-compute[73010]: WARNING nova.compute.manager [req-647aeda9-fca2-4de6-b7be-aff3b18847e3 req-dd1b0697-3a47-4d56-b578-2011bb871339 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received unexpected event network-vif-plugged-96202dd8-f6e5-436d-b8e7-1db0469cf513 for instance with vm_state building and task_state spawning.
Aug 15 00:34:05 user nova-compute[73010]: DEBUG nova.compute.manager [req-647aeda9-fca2-4de6-b7be-aff3b18847e3 req-dd1b0697-3a47-4d56-b578-2011bb871339 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-plugged-1ba8ecd1-f3a8-460d-9f61-b15d9319d83f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-647aeda9-fca2-4de6-b7be-aff3b18847e3 req-dd1b0697-3a47-4d56-b578-2011bb871339 service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-647aeda9-fca2-4de6-b7be-aff3b18847e3 req-dd1b0697-3a47-4d56-b578-2011bb871339 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-647aeda9-fca2-4de6-b7be-aff3b18847e3 req-dd1b0697-3a47-4d56-b578-2011bb871339 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG nova.compute.manager [req-647aeda9-fca2-4de6-b7be-aff3b18847e3 req-dd1b0697-3a47-4d56-b578-2011bb871339 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-plugged-1ba8ecd1-f3a8-460d-9f61-b15d9319d83f {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:05 user nova-compute[73010]: WARNING nova.compute.manager [req-647aeda9-fca2-4de6-b7be-aff3b18847e3 req-dd1b0697-3a47-4d56-b578-2011bb871339 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received unexpected event network-vif-plugged-1ba8ecd1-f3a8-460d-9f61-b15d9319d83f for instance with vm_state building and task_state spawning.
Aug 15 00:34:05 user nova-compute[73010]: DEBUG nova.compute.manager [req-647aeda9-fca2-4de6-b7be-aff3b18847e3 req-dd1b0697-3a47-4d56-b578-2011bb871339 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-plugged-1ba8ecd1-f3a8-460d-9f61-b15d9319d83f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-647aeda9-fca2-4de6-b7be-aff3b18847e3 req-dd1b0697-3a47-4d56-b578-2011bb871339 service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-647aeda9-fca2-4de6-b7be-aff3b18847e3 req-dd1b0697-3a47-4d56-b578-2011bb871339 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-647aeda9-fca2-4de6-b7be-aff3b18847e3 req-dd1b0697-3a47-4d56-b578-2011bb871339 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG nova.compute.manager [req-647aeda9-fca2-4de6-b7be-aff3b18847e3 req-dd1b0697-3a47-4d56-b578-2011bb871339 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-plugged-1ba8ecd1-f3a8-460d-9f61-b15d9319d83f {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:05 user nova-compute[73010]: WARNING nova.compute.manager [req-647aeda9-fca2-4de6-b7be-aff3b18847e3 req-dd1b0697-3a47-4d56-b578-2011bb871339 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received unexpected event network-vif-plugged-1ba8ecd1-f3a8-460d-9f61-b15d9319d83f for instance with vm_state building and task_state spawning.
Aug 15 00:34:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059646.1231985, 17237e56-67eb-4a05-b004-d27dacc8e04b => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:34:06 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] VM Resumed (Lifecycle Event)
Aug 15 00:34:06 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Instance spawned successfully.
Aug 15 00:34:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:34:06 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:34:06 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059646.1237173, 17237e56-67eb-4a05-b004-d27dacc8e04b => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:34:06 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] VM Started (Lifecycle Event)
Aug 15 00:34:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-a492e5b7-1f5b-4db4-b248-f91c0a0153de req-ac6f720b-6c6f-4c6b-bdde-02c83077c504 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-plugged-fb7932f3-05b0-4f25-b8f2-38cd50b29fd9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a492e5b7-1f5b-4db4-b248-f91c0a0153de req-ac6f720b-6c6f-4c6b-bdde-02c83077c504 service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a492e5b7-1f5b-4db4-b248-f91c0a0153de req-ac6f720b-6c6f-4c6b-bdde-02c83077c504 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a492e5b7-1f5b-4db4-b248-f91c0a0153de req-ac6f720b-6c6f-4c6b-bdde-02c83077c504 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-a492e5b7-1f5b-4db4-b248-f91c0a0153de req-ac6f720b-6c6f-4c6b-bdde-02c83077c504 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-plugged-fb7932f3-05b0-4f25-b8f2-38cd50b29fd9 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:06 user nova-compute[73010]: WARNING nova.compute.manager [req-a492e5b7-1f5b-4db4-b248-f91c0a0153de req-ac6f720b-6c6f-4c6b-bdde-02c83077c504 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received unexpected event network-vif-plugged-fb7932f3-05b0-4f25-b8f2-38cd50b29fd9 for instance with vm_state building and task_state spawning.
Aug 15 00:34:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-a492e5b7-1f5b-4db4-b248-f91c0a0153de req-ac6f720b-6c6f-4c6b-bdde-02c83077c504 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-plugged-fb7932f3-05b0-4f25-b8f2-38cd50b29fd9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a492e5b7-1f5b-4db4-b248-f91c0a0153de req-ac6f720b-6c6f-4c6b-bdde-02c83077c504 service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a492e5b7-1f5b-4db4-b248-f91c0a0153de req-ac6f720b-6c6f-4c6b-bdde-02c83077c504 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a492e5b7-1f5b-4db4-b248-f91c0a0153de req-ac6f720b-6c6f-4c6b-bdde-02c83077c504 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-a492e5b7-1f5b-4db4-b248-f91c0a0153de req-ac6f720b-6c6f-4c6b-bdde-02c83077c504 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-plugged-fb7932f3-05b0-4f25-b8f2-38cd50b29fd9 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:06 user nova-compute[73010]: WARNING nova.compute.manager [req-a492e5b7-1f5b-4db4-b248-f91c0a0153de req-ac6f720b-6c6f-4c6b-bdde-02c83077c504 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received unexpected event network-vif-plugged-fb7932f3-05b0-4f25-b8f2-38cd50b29fd9 for instance with vm_state building and task_state spawning.
Aug 15 00:34:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:06 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:34:06 user nova-compute[73010]: INFO nova.compute.manager [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Took 14.99 seconds to spawn the instance on the hypervisor.
Aug 15 00:34:06 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:06 user nova-compute[73010]: INFO nova.compute.manager [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Took 48.69 seconds to build instance.
Aug 15 00:34:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f031dbdb-56f8-4f20-a30a-e0a7ec9aa0c7 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 48.879s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AGKlYRwE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:34:07 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:34:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:34:07 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:34:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:34:07 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9cff61-a618-43f7-8b9b-1ab9e1f29374]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:34:07 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05382da-9946-40e7-be56-37dbd526f010]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87] added
Aug 15 00:34:07 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ee61e3-a963-413b-8c5c-c069c782930d]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7977c6c5-1198-4a6e-b9f7-7c1e2e98c404]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AGKlYRwE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AGKlYRwE" returned: 0 in 0.037s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6497f7f8-b302-4274-9b47-1043e6388808]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AGKlYRwE'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG nova.compute.manager [req-2d36dc48-c54c-4373-a954-599ab50a68ee req-b85af481-f6c5-40f5-81fd-423cc5061594 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-plugged-03a34cb5-4d57-4c59-ba58-b162bf49daa3 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2d36dc48-c54c-4373-a954-599ab50a68ee req-b85af481-f6c5-40f5-81fd-423cc5061594 service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2d36dc48-c54c-4373-a954-599ab50a68ee req-b85af481-f6c5-40f5-81fd-423cc5061594 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2d36dc48-c54c-4373-a954-599ab50a68ee req-b85af481-f6c5-40f5-81fd-423cc5061594 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG nova.compute.manager [req-2d36dc48-c54c-4373-a954-599ab50a68ee req-b85af481-f6c5-40f5-81fd-423cc5061594 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-plugged-03a34cb5-4d57-4c59-ba58-b162bf49daa3 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:07 user nova-compute[73010]: WARNING nova.compute.manager [req-2d36dc48-c54c-4373-a954-599ab50a68ee req-b85af481-f6c5-40f5-81fd-423cc5061594 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received unexpected event network-vif-plugged-03a34cb5-4d57-4c59-ba58-b162bf49daa3 for instance with vm_state building and task_state spawning.
Aug 15 00:34:07 user nova-compute[73010]: DEBUG nova.compute.manager [req-2d36dc48-c54c-4373-a954-599ab50a68ee req-b85af481-f6c5-40f5-81fd-423cc5061594 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-plugged-03a34cb5-4d57-4c59-ba58-b162bf49daa3 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2d36dc48-c54c-4373-a954-599ab50a68ee req-b85af481-f6c5-40f5-81fd-423cc5061594 service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2d36dc48-c54c-4373-a954-599ab50a68ee req-b85af481-f6c5-40f5-81fd-423cc5061594 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2d36dc48-c54c-4373-a954-599ab50a68ee req-b85af481-f6c5-40f5-81fd-423cc5061594 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG nova.compute.manager [req-2d36dc48-c54c-4373-a954-599ab50a68ee req-b85af481-f6c5-40f5-81fd-423cc5061594 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-plugged-03a34cb5-4d57-4c59-ba58-b162bf49daa3 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:07 user nova-compute[73010]: WARNING nova.compute.manager [req-2d36dc48-c54c-4373-a954-599ab50a68ee req-b85af481-f6c5-40f5-81fd-423cc5061594 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received unexpected event network-vif-plugged-03a34cb5-4d57-4c59-ba58-b162bf49daa3 for instance with vm_state building and task_state spawning.
Aug 15 00:34:07 user nova-compute[73010]: DEBUG nova.compute.manager [req-2d36dc48-c54c-4373-a954-599ab50a68ee req-b85af481-f6c5-40f5-81fd-423cc5061594 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-plugged-df67aaef-5bdd-4a5a-816b-c34392983877 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2d36dc48-c54c-4373-a954-599ab50a68ee req-b85af481-f6c5-40f5-81fd-423cc5061594 service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2d36dc48-c54c-4373-a954-599ab50a68ee req-b85af481-f6c5-40f5-81fd-423cc5061594 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2d36dc48-c54c-4373-a954-599ab50a68ee req-b85af481-f6c5-40f5-81fd-423cc5061594 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG nova.compute.manager [req-2d36dc48-c54c-4373-a954-599ab50a68ee req-b85af481-f6c5-40f5-81fd-423cc5061594 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-plugged-df67aaef-5bdd-4a5a-816b-c34392983877 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:07 user nova-compute[73010]: WARNING nova.compute.manager [req-2d36dc48-c54c-4373-a954-599ab50a68ee req-b85af481-f6c5-40f5-81fd-423cc5061594 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received unexpected event network-vif-plugged-df67aaef-5bdd-4a5a-816b-c34392983877 for instance with vm_state building and task_state spawning.
Aug 15 00:34:07 user nova-compute[73010]: DEBUG nova.compute.manager [req-2d36dc48-c54c-4373-a954-599ab50a68ee req-b85af481-f6c5-40f5-81fd-423cc5061594 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-plugged-df67aaef-5bdd-4a5a-816b-c34392983877 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2d36dc48-c54c-4373-a954-599ab50a68ee req-b85af481-f6c5-40f5-81fd-423cc5061594 service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2d36dc48-c54c-4373-a954-599ab50a68ee req-b85af481-f6c5-40f5-81fd-423cc5061594 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2d36dc48-c54c-4373-a954-599ab50a68ee req-b85af481-f6c5-40f5-81fd-423cc5061594 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG nova.compute.manager [req-2d36dc48-c54c-4373-a954-599ab50a68ee req-b85af481-f6c5-40f5-81fd-423cc5061594 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-plugged-df67aaef-5bdd-4a5a-816b-c34392983877 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:07 user nova-compute[73010]: WARNING nova.compute.manager [req-2d36dc48-c54c-4373-a954-599ab50a68ee req-b85af481-f6c5-40f5-81fd-423cc5061594 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received unexpected event network-vif-plugged-df67aaef-5bdd-4a5a-816b-c34392983877 for instance with vm_state building and task_state spawning.
Aug 15 00:34:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd66b78e-9771-44e7-9d94-21f0703449e3]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1687ff16-5ad2-47cc-a55b-7b461658d187]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:07 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:07 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:07 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:07 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:07 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:07 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:07 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:07 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:07 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:07 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:07 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:07 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8afa228-7554-46c4-adc6-41caf0c260c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87, portal: 172.16.0.220,3260]
Aug 15 00:34:07 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87, portal: 172.16.0.220,3260] successful.
Aug 15 00:34:07 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adfa846-d8cb-441f-b966-c5e2f3900b74]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b05279a-a461-49f6-8bae-6efce7850125]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:07 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:07 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:07 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:07 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:07 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:07 user nova-compute[73010]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 (non-flash)
Aug 15 00:34:07 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:07 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:07 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:07 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:07 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:07 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:07 user nova-compute[73010]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 (non-flash)
Aug 15 00:34:07 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.410s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.034s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[708183a9-cb1d-4e3c-b807-07e07bc56008]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:34:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AGKlYRwE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:34:08 user nova-compute[73010]: DEBUG nova.compute.manager [req-95eaf4d9-8958-48e8-bff8-5aa7f8f70388 req-07b2c52b-9ccd-46ff-aa00-f7de532a8dd0 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-plugged-fd5ce0a2-ca8e-422d-b36a-64006d1e8217 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-95eaf4d9-8958-48e8-bff8-5aa7f8f70388 req-07b2c52b-9ccd-46ff-aa00-f7de532a8dd0 service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-95eaf4d9-8958-48e8-bff8-5aa7f8f70388 req-07b2c52b-9ccd-46ff-aa00-f7de532a8dd0 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-95eaf4d9-8958-48e8-bff8-5aa7f8f70388 req-07b2c52b-9ccd-46ff-aa00-f7de532a8dd0 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:08 user nova-compute[73010]: DEBUG nova.compute.manager [req-95eaf4d9-8958-48e8-bff8-5aa7f8f70388 req-07b2c52b-9ccd-46ff-aa00-f7de532a8dd0 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-plugged-fd5ce0a2-ca8e-422d-b36a-64006d1e8217 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:08 user nova-compute[73010]: WARNING nova.compute.manager [req-95eaf4d9-8958-48e8-bff8-5aa7f8f70388 req-07b2c52b-9ccd-46ff-aa00-f7de532a8dd0 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received unexpected event network-vif-plugged-fd5ce0a2-ca8e-422d-b36a-64006d1e8217 for instance with vm_state building and task_state spawning.
Aug 15 00:34:08 user nova-compute[73010]: DEBUG nova.compute.manager [req-95eaf4d9-8958-48e8-bff8-5aa7f8f70388 req-07b2c52b-9ccd-46ff-aa00-f7de532a8dd0 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-plugged-fd5ce0a2-ca8e-422d-b36a-64006d1e8217 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-95eaf4d9-8958-48e8-bff8-5aa7f8f70388 req-07b2c52b-9ccd-46ff-aa00-f7de532a8dd0 service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-95eaf4d9-8958-48e8-bff8-5aa7f8f70388 req-07b2c52b-9ccd-46ff-aa00-f7de532a8dd0 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-95eaf4d9-8958-48e8-bff8-5aa7f8f70388 req-07b2c52b-9ccd-46ff-aa00-f7de532a8dd0 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:08 user nova-compute[73010]: DEBUG nova.compute.manager [req-95eaf4d9-8958-48e8-bff8-5aa7f8f70388 req-07b2c52b-9ccd-46ff-aa00-f7de532a8dd0 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-plugged-fd5ce0a2-ca8e-422d-b36a-64006d1e8217 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:08 user nova-compute[73010]: WARNING nova.compute.manager [req-95eaf4d9-8958-48e8-bff8-5aa7f8f70388 req-07b2c52b-9ccd-46ff-aa00-f7de532a8dd0 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received unexpected event network-vif-plugged-fd5ce0a2-ca8e-422d-b36a-64006d1e8217 for instance with vm_state building and task_state spawning.
Aug 15 00:34:08 user nova-compute[73010]: DEBUG nova.compute.manager [req-95eaf4d9-8958-48e8-bff8-5aa7f8f70388 req-07b2c52b-9ccd-46ff-aa00-f7de532a8dd0 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-plugged-dc702c0a-c79d-48b8-8cc0-7bb18931b11d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-95eaf4d9-8958-48e8-bff8-5aa7f8f70388 req-07b2c52b-9ccd-46ff-aa00-f7de532a8dd0 service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-95eaf4d9-8958-48e8-bff8-5aa7f8f70388 req-07b2c52b-9ccd-46ff-aa00-f7de532a8dd0 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-95eaf4d9-8958-48e8-bff8-5aa7f8f70388 req-07b2c52b-9ccd-46ff-aa00-f7de532a8dd0 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:08 user nova-compute[73010]: DEBUG nova.compute.manager [req-95eaf4d9-8958-48e8-bff8-5aa7f8f70388 req-07b2c52b-9ccd-46ff-aa00-f7de532a8dd0 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-plugged-dc702c0a-c79d-48b8-8cc0-7bb18931b11d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:08 user nova-compute[73010]: WARNING nova.compute.manager [req-95eaf4d9-8958-48e8-bff8-5aa7f8f70388 req-07b2c52b-9ccd-46ff-aa00-f7de532a8dd0 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received unexpected event network-vif-plugged-dc702c0a-c79d-48b8-8cc0-7bb18931b11d for instance with vm_state building and task_state spawning.
Aug 15 00:34:08 user nova-compute[73010]: DEBUG nova.compute.manager [req-95eaf4d9-8958-48e8-bff8-5aa7f8f70388 req-07b2c52b-9ccd-46ff-aa00-f7de532a8dd0 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-plugged-dc702c0a-c79d-48b8-8cc0-7bb18931b11d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-95eaf4d9-8958-48e8-bff8-5aa7f8f70388 req-07b2c52b-9ccd-46ff-aa00-f7de532a8dd0 service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-95eaf4d9-8958-48e8-bff8-5aa7f8f70388 req-07b2c52b-9ccd-46ff-aa00-f7de532a8dd0 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-95eaf4d9-8958-48e8-bff8-5aa7f8f70388 req-07b2c52b-9ccd-46ff-aa00-f7de532a8dd0 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:08 user nova-compute[73010]: DEBUG nova.compute.manager [req-95eaf4d9-8958-48e8-bff8-5aa7f8f70388 req-07b2c52b-9ccd-46ff-aa00-f7de532a8dd0 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-plugged-dc702c0a-c79d-48b8-8cc0-7bb18931b11d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:08 user nova-compute[73010]: WARNING nova.compute.manager [req-95eaf4d9-8958-48e8-bff8-5aa7f8f70388 req-07b2c52b-9ccd-46ff-aa00-f7de532a8dd0 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received unexpected event network-vif-plugged-dc702c0a-c79d-48b8-8cc0-7bb18931b11d for instance with vm_state building and task_state spawning.
Aug 15 00:34:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.491s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:34:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] <== connect_volume: return (1495ms) {'type': 'block', 'scsi_wwn': '26639656661346232', 'path': '/dev/sdh'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:34:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639656661346232', 'path': '/dev/sdh'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:34:08 user nova-compute[73010]: DEBUG nova.objects.instance [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lazy-loading 'flavor' on Instance uuid 1ba131ea-c646-4719-b85a-5fc021555fcc {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:34:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:34:09 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:34:09 user nova-compute[73010]:   <source dev="/dev/sdh"/>
Aug 15 00:34:09 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:34:09 user nova-compute[73010]:   <serial>696c44d8-7402-414a-9fba-38968c2c4e87</serial>
Aug 15 00:34:09 user nova-compute[73010]: </disk>
Aug 15 00:34:09 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:34:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:34:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:34:09 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059649.2514203, 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:34:09 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] VM Resumed (Lifecycle Event)
Aug 15 00:34:09 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Instance spawned successfully.
Aug 15 00:34:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:34:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:34:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:34:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:34:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:34:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:34:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:34:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:34:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:34:09 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:34:09 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059649.2624254, 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:34:09 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] VM Started (Lifecycle Event)
Aug 15 00:34:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:34:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:34:09 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:34:09 user nova-compute[73010]: INFO nova.compute.manager [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Took 15.76 seconds to spawn the instance on the hypervisor.
Aug 15 00:34:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:34:09 user nova-compute[73010]: INFO nova.compute.manager [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Took 47.54 seconds to build instance.
Aug 15 00:34:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c1ccef27-06fa-48dd-ab67-bc8419e87d7d tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.660s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:34:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:34:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] No VIF found with MAC fa:16:3e:07:4d:fc, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:34:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3a50571a-026c-4a2a-bdab-c17646d8f521 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "1ba131ea-c646-4719-b85a-5fc021555fcc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.019s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Acquiring lock "1ba131ea-c646-4719-b85a-5fc021555fcc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "1ba131ea-c646-4719-b85a-5fc021555fcc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Acquiring lock "1ba131ea-c646-4719-b85a-5fc021555fcc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "1ba131ea-c646-4719-b85a-5fc021555fcc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "1ba131ea-c646-4719-b85a-5fc021555fcc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:10 user nova-compute[73010]: INFO nova.compute.manager [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Terminating instance
Aug 15 00:34:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:34:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:10 user nova-compute[73010]: DEBUG nova.compute.manager [req-0a5ce686-b506-407c-aa8f-69bb7c52e2ff req-492bd6fc-ad82-4702-aab3-b405bb32318f service nova] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Received event network-changed-61021aff-d0dd-4ba3-b862-d989711f4b33 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:10 user nova-compute[73010]: DEBUG nova.compute.manager [req-0a5ce686-b506-407c-aa8f-69bb7c52e2ff req-492bd6fc-ad82-4702-aab3-b405bb32318f service nova] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Refreshing instance network info cache due to event network-changed-61021aff-d0dd-4ba3-b862-d989711f4b33. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:34:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0a5ce686-b506-407c-aa8f-69bb7c52e2ff req-492bd6fc-ad82-4702-aab3-b405bb32318f service nova] Acquiring lock "refresh_cache-0588a46c-2314-47e3-b984-1e04518e8a63" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:34:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0a5ce686-b506-407c-aa8f-69bb7c52e2ff req-492bd6fc-ad82-4702-aab3-b405bb32318f service nova] Acquired lock "refresh_cache-0588a46c-2314-47e3-b984-1e04518e8a63" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:34:10 user nova-compute[73010]: DEBUG nova.network.neutron [req-0a5ce686-b506-407c-aa8f-69bb7c52e2ff req-492bd6fc-ad82-4702-aab3-b405bb32318f service nova] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Refreshing network info cache for port 61021aff-d0dd-4ba3-b862-d989711f4b33 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:11 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Instance destroyed successfully.
Aug 15 00:34:11 user nova-compute[73010]: DEBUG nova.objects.instance [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lazy-loading 'resources' on Instance uuid 1ba131ea-c646-4719-b85a-5fc021555fcc {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1210883711',display_name='tempest-DeleteServersTestJSON-server-1210883711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1210883711',id=1,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:32:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4613c3de3a28481ab5528489a43216aa',ramdisk_id='',reservation_id='r-9zt6xu6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1412161916',owner_user_name='tempest-DeleteServersTestJSON-1412161916-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:32:20Z,user_data=None,user_id='235b32ee84cb49f88e560ea34f659ad5',uuid=1ba131ea-c646-4719-b85a-5fc021555fcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "692b6d7e-a3c6-4330-9e76-851a1501950c", "address": "fa:16:3e:07:4d:fc", "network": {"id": "1ea47cb1-fc85-491d-95a7-927606f5e3d4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-620603594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4613c3de3a28481ab5528489a43216aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap692b6d7e-a3", "ovs_interfaceid": "692b6d7e-a3c6-4330-9e76-851a1501950c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Converting VIF {"id": "692b6d7e-a3c6-4330-9e76-851a1501950c", "address": "fa:16:3e:07:4d:fc", "network": {"id": "1ea47cb1-fc85-491d-95a7-927606f5e3d4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-620603594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4613c3de3a28481ab5528489a43216aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap692b6d7e-a3", "ovs_interfaceid": "692b6d7e-a3c6-4330-9e76-851a1501950c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:4d:fc,bridge_name='br-int',has_traffic_filtering=True,id=692b6d7e-a3c6-4330-9e76-851a1501950c,network=Network(1ea47cb1-fc85-491d-95a7-927606f5e3d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap692b6d7e-a3') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG os_vif [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:4d:fc,bridge_name='br-int',has_traffic_filtering=True,id=692b6d7e-a3c6-4330-9e76-851a1501950c,network=Network(1ea47cb1-fc85-491d-95a7-927606f5e3d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap692b6d7e-a3') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap692b6d7e-a3, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:11 user nova-compute[73010]: INFO os_vif [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:4d:fc,bridge_name='br-int',has_traffic_filtering=True,id=692b6d7e-a3c6-4330-9e76-851a1501950c,network=Network(1ea47cb1-fc85-491d-95a7-927606f5e3d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap692b6d7e-a3')
Aug 15 00:34:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AGKlYRwE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:34:11 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:34:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2755fcd7-10cf-4d27-b30d-a39c0f1c8041]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG nova.network.neutron [req-0a5ce686-b506-407c-aa8f-69bb7c52e2ff req-492bd6fc-ad82-4702-aab3-b405bb32318f service nova] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Updated VIF entry in instance network info cache for port 61021aff-d0dd-4ba3-b862-d989711f4b33. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG nova.network.neutron [req-0a5ce686-b506-407c-aa8f-69bb7c52e2ff req-492bd6fc-ad82-4702-aab3-b405bb32318f service nova] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Updating instance_info_cache with network_info: [{"id": "61021aff-d0dd-4ba3-b862-d989711f4b33", "address": "fa:16:3e:8d:63:82", "network": {"id": "9aa91991-9d4c-4b0d-a955-652df703cde1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-393715584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a620c803f76045d6a5b5b78ec1894c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61021aff-d0", "ovs_interfaceid": "61021aff-d0dd-4ba3-b862-d989711f4b33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8928efd0-6ce0-4f98-a71c-43a5e1c0d67b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:11 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:11 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:11 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:11 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:11 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:11 user nova-compute[73010]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 (non-flash)
Aug 15 00:34:11 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:11 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:11 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:11 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:11 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:11 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:11 user nova-compute[73010]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 (non-flash)
Aug 15 00:34:11 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec503a6050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87'): ({'sdh'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Removing single pathed devices sdh {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0a5ce686-b506-407c-aa8f-69bb7c52e2ff req-492bd6fc-ad82-4702-aab3-b405bb32318f service nova] Releasing lock "refresh_cache-0588a46c-2314-47e3-b984-1e04518e8a63" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39e6ffa-8a6b-45f5-8076-285c24365927]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e493d83c-32f1-4c55-a465-c8ce5de6c304]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Flushing IO for device /dev/sdh {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[68554e97-d277-4c73-968a-0a5421fd2a69]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.060s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1244f635-6a86-432b-bf71-63d241b0693a]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] SCSI volumes sdh have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[45088e61-3108-4080-92bd-4a90ba83ce5b]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbd2183-e027-44e1-badd-de99b32de2d7]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87, portal: 172.16.0.220,3260]
Aug 15 00:34:11 user nova-compute[73010]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87, portal: 172.16.0.220,3260] successful.
Aug 15 00:34:11 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:696c44d8-7402-414a-9fba-38968c2c4e87 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[51155926-3f2f-4369-a015-3b5a5605bab0]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.429s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] <== disconnect_volume: return (432ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:34:11 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Deleting instance files /opt/stack/data/nova/instances/1ba131ea-c646-4719-b85a-5fc021555fcc_del
Aug 15 00:34:11 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Deletion of /opt/stack/data/nova/instances/1ba131ea-c646-4719-b85a-5fc021555fcc_del complete
Aug 15 00:34:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73010) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 15 00:34:11 user nova-compute[73010]: INFO nova.virt.libvirt.host [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] UEFI support detected
Aug 15 00:34:11 user nova-compute[73010]: INFO nova.compute.manager [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Took 1.47 seconds to destroy the instance on the hypervisor.
Aug 15 00:34:11 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:34:11 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpgnlPGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:34:12 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:34:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:34:12 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:34:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:34:12 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[99683b2f-6af2-4e1a-8ea6-384c0421378e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:34:12 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[53807892-249a-4fe7-af9f-d9504cfab2bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c] added
Aug 15 00:34:12 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a0d90b-0568-4a66-9472-4452ef5bb843]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[da606344-7b34-4baf-b36d-e6d89829629e]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EpgnlPGB {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EpgnlPGB" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dadd10-9eb3-44f6-98e7-cf76681f3cdd]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EpgnlPGB'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6f49a1-7ee0-45c9-8728-eda48320ee41]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb37f645-c549-43e7-89e9-1297be170a98]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:12 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:12 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:12 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:12 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:12 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:12 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:12 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:12 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:12 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:12 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:12 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:12 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --login" returned: 0 in 0.114s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40ffe6e-ca83-43a5-a9c2-64204cfc6841]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c, portal: 172.16.0.220,3260]
Aug 15 00:34:12 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c, portal: 172.16.0.220,3260] successful.
Aug 15 00:34:12 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[34037dcf-c22d-474c-994d-5359e9cd849e]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2dd0e6-73f3-4e54-8a9b-9b8af1d8e858]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:12 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:12 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:12 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:12 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:12 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:12 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:12 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:12 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:12 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:12 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:12 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:12 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:12 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:12 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf0e196-6c10-4f00-95c3-3930e8affe16]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpgnlPGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-2392840f-3c21-4aae-88e8-eb91ab19f282 req-c906d4ff-5ea9-4363-a63e-883ff826ddf0 service nova] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Received event network-vif-unplugged-692b6d7e-a3c6-4330-9e76-851a1501950c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2392840f-3c21-4aae-88e8-eb91ab19f282 req-c906d4ff-5ea9-4363-a63e-883ff826ddf0 service nova] Acquiring lock "1ba131ea-c646-4719-b85a-5fc021555fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2392840f-3c21-4aae-88e8-eb91ab19f282 req-c906d4ff-5ea9-4363-a63e-883ff826ddf0 service nova] Lock "1ba131ea-c646-4719-b85a-5fc021555fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2392840f-3c21-4aae-88e8-eb91ab19f282 req-c906d4ff-5ea9-4363-a63e-883ff826ddf0 service nova] Lock "1ba131ea-c646-4719-b85a-5fc021555fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-2392840f-3c21-4aae-88e8-eb91ab19f282 req-c906d4ff-5ea9-4363-a63e-883ff826ddf0 service nova] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] No waiting events found dispatching network-vif-unplugged-692b6d7e-a3c6-4330-9e76-851a1501950c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-2392840f-3c21-4aae-88e8-eb91ab19f282 req-c906d4ff-5ea9-4363-a63e-883ff826ddf0 service nova] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Received event network-vif-unplugged-692b6d7e-a3c6-4330-9e76-851a1501950c for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-2392840f-3c21-4aae-88e8-eb91ab19f282 req-c906d4ff-5ea9-4363-a63e-883ff826ddf0 service nova] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Received event network-vif-plugged-692b6d7e-a3c6-4330-9e76-851a1501950c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2392840f-3c21-4aae-88e8-eb91ab19f282 req-c906d4ff-5ea9-4363-a63e-883ff826ddf0 service nova] Acquiring lock "1ba131ea-c646-4719-b85a-5fc021555fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2392840f-3c21-4aae-88e8-eb91ab19f282 req-c906d4ff-5ea9-4363-a63e-883ff826ddf0 service nova] Lock "1ba131ea-c646-4719-b85a-5fc021555fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2392840f-3c21-4aae-88e8-eb91ab19f282 req-c906d4ff-5ea9-4363-a63e-883ff826ddf0 service nova] Lock "1ba131ea-c646-4719-b85a-5fc021555fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-2392840f-3c21-4aae-88e8-eb91ab19f282 req-c906d4ff-5ea9-4363-a63e-883ff826ddf0 service nova] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] No waiting events found dispatching network-vif-plugged-692b6d7e-a3c6-4330-9e76-851a1501950c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:12 user nova-compute[73010]: WARNING nova.compute.manager [req-2392840f-3c21-4aae-88e8-eb91ab19f282 req-c906d4ff-5ea9-4363-a63e-883ff826ddf0 service nova] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Received unexpected event network-vif-plugged-692b6d7e-a3c6-4330-9e76-851a1501950c for instance with vm_state active and task_state deleting.
Aug 15 00:34:13 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:34:13 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Took 1.15 seconds to deallocate network for instance.
Aug 15 00:34:13 user nova-compute[73010]: DEBUG nova.compute.manager [req-f04e94e6-eb99-4c86-81f7-82275172f70d req-69ff6a87-db20-4c26-8799-21d3d05102c8 service nova] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Received event network-vif-deleted-692b6d7e-a3c6-4330-9e76-851a1501950c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:13 user nova-compute[73010]: INFO nova.compute.manager [req-f04e94e6-eb99-4c86-81f7-82275172f70d req-69ff6a87-db20-4c26-8799-21d3d05102c8 service nova] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Neutron deleted interface 692b6d7e-a3c6-4330-9e76-851a1501950c; detaching it from the instance and deleting it from the info cache
Aug 15 00:34:13 user nova-compute[73010]: DEBUG nova.network.neutron [req-f04e94e6-eb99-4c86-81f7-82275172f70d req-69ff6a87-db20-4c26-8799-21d3d05102c8 service nova] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:34:13 user nova-compute[73010]: DEBUG nova.compute.manager [req-f04e94e6-eb99-4c86-81f7-82275172f70d req-69ff6a87-db20-4c26-8799-21d3d05102c8 service nova] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Detach interface failed, port_id=692b6d7e-a3c6-4330-9e76-851a1501950c, reason: Instance 1ba131ea-c646-4719-b85a-5fc021555fcc could not be found. {{(pid=73010) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 00:34:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:34:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] <== connect_volume: return (1451ms) {'type': 'block', 'scsi_wwn': '26330346331363330', 'path': '/dev/sdh'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:34:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330346331363330', 'path': '/dev/sdh'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:34:13 user nova-compute[73010]: DEBUG nova.objects.instance [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'flavor' on Instance uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:34:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:34:13 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:34:13 user nova-compute[73010]:   <source dev="/dev/sdh"/>
Aug 15 00:34:13 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:34:13 user nova-compute[73010]:   <serial>4b15bb6b-3a19-4857-b779-8264e831296c</serial>
Aug 15 00:34:13 user nova-compute[73010]: </disk>
Aug 15 00:34:13 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:34:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:34:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:34:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] No VIF found with MAC fa:16:3e:7b:68:0b, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:34:14 user nova-compute[73010]: INFO nova.compute.manager [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Took 1.05 seconds to detach 1 volumes for instance.
Aug 15 00:34:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3b0da193-9837-42b8-bee0-ca755c406dbf tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.802s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:14 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:34:14 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:34:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.501s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:14 user nova-compute[73010]: DEBUG nova.compute.manager [req-b95cf133-9780-46b4-926a-f836cd3416c3 req-7dd73b59-de4d-4ff0-b258-bc9a9c0f96ba service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Received event network-changed-54ba8c70-915f-4da3-8354-d2a49b3f776e {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:14 user nova-compute[73010]: DEBUG nova.compute.manager [req-b95cf133-9780-46b4-926a-f836cd3416c3 req-7dd73b59-de4d-4ff0-b258-bc9a9c0f96ba service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Refreshing instance network info cache due to event network-changed-54ba8c70-915f-4da3-8354-d2a49b3f776e. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:34:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b95cf133-9780-46b4-926a-f836cd3416c3 req-7dd73b59-de4d-4ff0-b258-bc9a9c0f96ba service nova] Acquiring lock "refresh_cache-eabef054-b50f-4a34-a501-eb1b991d76af" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:34:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b95cf133-9780-46b4-926a-f836cd3416c3 req-7dd73b59-de4d-4ff0-b258-bc9a9c0f96ba service nova] Acquired lock "refresh_cache-eabef054-b50f-4a34-a501-eb1b991d76af" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:34:14 user nova-compute[73010]: DEBUG nova.network.neutron [req-b95cf133-9780-46b4-926a-f836cd3416c3 req-7dd73b59-de4d-4ff0-b258-bc9a9c0f96ba service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Refreshing network info cache for port 54ba8c70-915f-4da3-8354-d2a49b3f776e {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:34:14 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Deleted allocations for instance 1ba131ea-c646-4719-b85a-5fc021555fcc
Aug 15 00:34:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c3399728-52cf-403f-bd78-99ebfd281131 tempest-DeleteServersTestJSON-1412161916 tempest-DeleteServersTestJSON-1412161916-project-member] Lock "1ba131ea-c646-4719-b85a-5fc021555fcc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.588s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5d2bbd8f-8a99-4867-9a6e-7e19a4071d27 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5d2bbd8f-8a99-4867-9a6e-7e19a4071d27 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:15 user nova-compute[73010]: DEBUG nova.compute.manager [None req-5d2bbd8f-8a99-4867-9a6e-7e19a4071d27 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:34:15 user nova-compute[73010]: DEBUG nova.compute.manager [None req-5d2bbd8f-8a99-4867-9a6e-7e19a4071d27 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73010) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 15 00:34:15 user nova-compute[73010]: DEBUG nova.objects.instance [None req-5d2bbd8f-8a99-4867-9a6e-7e19a4071d27 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'flavor' on Instance uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:34:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:15 user nova-compute[73010]: DEBUG nova.network.neutron [req-b95cf133-9780-46b4-926a-f836cd3416c3 req-7dd73b59-de4d-4ff0-b258-bc9a9c0f96ba service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Updated VIF entry in instance network info cache for port 54ba8c70-915f-4da3-8354-d2a49b3f776e. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:34:15 user nova-compute[73010]: DEBUG nova.network.neutron [req-b95cf133-9780-46b4-926a-f836cd3416c3 req-7dd73b59-de4d-4ff0-b258-bc9a9c0f96ba service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Updating instance_info_cache with network_info: [{"id": "54ba8c70-915f-4da3-8354-d2a49b3f776e", "address": "fa:16:3e:1a:29:68", "network": {"id": "b301d89d-4779-4c2c-9706-69290914800f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1794168145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1345a35a7947442a82d566d64bcde2b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ba8c70-91", "ovs_interfaceid": "54ba8c70-915f-4da3-8354-d2a49b3f776e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:34:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b95cf133-9780-46b4-926a-f836cd3416c3 req-7dd73b59-de4d-4ff0-b258-bc9a9c0f96ba service nova] Releasing lock "refresh_cache-eabef054-b50f-4a34-a501-eb1b991d76af" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:34:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-e7271fce-3f41-4698-bbce-09240695bb73 req-615b57ad-61bf-439f-b90d-175b82589361 service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received event network-vif-unplugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e7271fce-3f41-4698-bbce-09240695bb73 req-615b57ad-61bf-439f-b90d-175b82589361 service nova] Acquiring lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e7271fce-3f41-4698-bbce-09240695bb73 req-615b57ad-61bf-439f-b90d-175b82589361 service nova] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e7271fce-3f41-4698-bbce-09240695bb73 req-615b57ad-61bf-439f-b90d-175b82589361 service nova] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-e7271fce-3f41-4698-bbce-09240695bb73 req-615b57ad-61bf-439f-b90d-175b82589361 service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] No waiting events found dispatching network-vif-unplugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:15 user nova-compute[73010]: WARNING nova.compute.manager [req-e7271fce-3f41-4698-bbce-09240695bb73 req-615b57ad-61bf-439f-b90d-175b82589361 service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received unexpected event network-vif-unplugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 for instance with vm_state active and task_state powering-off.
Aug 15 00:34:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquiring lock "0588a46c-2314-47e3-b984-1e04518e8a63" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "0588a46c-2314-47e3-b984-1e04518e8a63" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:15 user nova-compute[73010]: DEBUG nova.objects.instance [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lazy-loading 'flavor' on Instance uuid 0588a46c-2314-47e3-b984-1e04518e8a63 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:34:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "0588a46c-2314-47e3-b984-1e04518e8a63" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquiring lock "0588a46c-2314-47e3-b984-1e04518e8a63" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "0588a46c-2314-47e3-b984-1e04518e8a63" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:16 user nova-compute[73010]: INFO nova.compute.manager [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Attaching volume bef01ca3-78e5-423b-81dc-23855e05d5c4 to /dev/vdb
Aug 15 00:34:16 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Instance destroyed successfully.
Aug 15 00:34:16 user nova-compute[73010]: DEBUG nova.compute.manager [None req-5d2bbd8f-8a99-4867-9a6e-7e19a4071d27 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG os_brick.utils [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d994369c-98f6-456d-8bcc-bc2b3e5e8e98]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fadbbf-8c44-419f-9c77-8a6157a5fb51]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5d2bbd8f-8a99-4867-9a6e-7e19a4071d27 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.249s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[befa664a-5065-4964-8198-9bf014ba2be6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[175185b5-f1c5-4fa1-9994-a5a7d64ac2ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:34:16 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:34:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d139cbc3-1694-489c-b372-45e5f9fe2a4a]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG os_brick.utils [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:34:16 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Updating existing volume attachment record: 356ed650-3df5-4028-8369-c51451698310 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:34:17 user nova-compute[73010]: DEBUG nova.compute.manager [req-3212a3b5-d3b2-4ab0-a702-c610a986de46 req-fe4f45eb-96fd-4f8f-96c8-5e0ec2e12eaf service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received event network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3212a3b5-d3b2-4ab0-a702-c610a986de46 req-fe4f45eb-96fd-4f8f-96c8-5e0ec2e12eaf service nova] Acquiring lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3212a3b5-d3b2-4ab0-a702-c610a986de46 req-fe4f45eb-96fd-4f8f-96c8-5e0ec2e12eaf service nova] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3212a3b5-d3b2-4ab0-a702-c610a986de46 req-fe4f45eb-96fd-4f8f-96c8-5e0ec2e12eaf service nova] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:17 user nova-compute[73010]: DEBUG nova.compute.manager [req-3212a3b5-d3b2-4ab0-a702-c610a986de46 req-fe4f45eb-96fd-4f8f-96c8-5e0ec2e12eaf service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] No waiting events found dispatching network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:17 user nova-compute[73010]: WARNING nova.compute.manager [req-3212a3b5-d3b2-4ab0-a702-c610a986de46 req-fe4f45eb-96fd-4f8f-96c8-5e0ec2e12eaf service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received unexpected event network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 for instance with vm_state stopped and task_state None.
Aug 15 00:34:17 user nova-compute[73010]: DEBUG nova.compute.manager [req-3212a3b5-d3b2-4ab0-a702-c610a986de46 req-fe4f45eb-96fd-4f8f-96c8-5e0ec2e12eaf service nova] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Received event network-changed-e8325311-2426-4587-b3be-94ebc97c7d9c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:17 user nova-compute[73010]: DEBUG nova.compute.manager [req-3212a3b5-d3b2-4ab0-a702-c610a986de46 req-fe4f45eb-96fd-4f8f-96c8-5e0ec2e12eaf service nova] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Refreshing instance network info cache due to event network-changed-e8325311-2426-4587-b3be-94ebc97c7d9c. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:34:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3212a3b5-d3b2-4ab0-a702-c610a986de46 req-fe4f45eb-96fd-4f8f-96c8-5e0ec2e12eaf service nova] Acquiring lock "refresh_cache-de9297d8-10e8-4244-b25d-54d4c2a83aea" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:34:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3212a3b5-d3b2-4ab0-a702-c610a986de46 req-fe4f45eb-96fd-4f8f-96c8-5e0ec2e12eaf service nova] Acquired lock "refresh_cache-de9297d8-10e8-4244-b25d-54d4c2a83aea" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:34:17 user nova-compute[73010]: DEBUG nova.network.neutron [req-3212a3b5-d3b2-4ab0-a702-c610a986de46 req-fe4f45eb-96fd-4f8f-96c8-5e0ec2e12eaf service nova] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Refreshing network info cache for port e8325311-2426-4587-b3be-94ebc97c7d9c {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:34:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Acquiring lock "de9297d8-10e8-4244-b25d-54d4c2a83aea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Lock "de9297d8-10e8-4244-b25d-54d4c2a83aea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:17 user nova-compute[73010]: DEBUG nova.objects.instance [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Lazy-loading 'flavor' on Instance uuid de9297d8-10e8-4244-b25d-54d4c2a83aea {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Lock "de9297d8-10e8-4244-b25d-54d4c2a83aea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Acquiring lock "de9297d8-10e8-4244-b25d-54d4c2a83aea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Lock "de9297d8-10e8-4244-b25d-54d4c2a83aea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:18 user nova-compute[73010]: INFO nova.compute.manager [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Attaching volume 1cab8cb2-9359-41f1-ae25-f73c0f4fb548 to /dev/vdb
Aug 15 00:34:18 user nova-compute[73010]: DEBUG os_brick.utils [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[35401030-5702-4191-92c3-a4ea774a2a1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG nova.network.neutron [req-3212a3b5-d3b2-4ab0-a702-c610a986de46 req-fe4f45eb-96fd-4f8f-96c8-5e0ec2e12eaf service nova] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Updated VIF entry in instance network info cache for port e8325311-2426-4587-b3be-94ebc97c7d9c. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG nova.network.neutron [req-3212a3b5-d3b2-4ab0-a702-c610a986de46 req-fe4f45eb-96fd-4f8f-96c8-5e0ec2e12eaf service nova] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Updating instance_info_cache with network_info: [{"id": "e8325311-2426-4587-b3be-94ebc97c7d9c", "address": "fa:16:3e:3c:07:e1", "network": {"id": "fe36cefd-7a91-4307-92a8-1200af86e04e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-185864758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d2ef5987cbe4bc0a98749cac9455b6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8325311-24", "ovs_interfaceid": "e8325311-2426-4587-b3be-94ebc97c7d9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5d3b91-9ac8-4e78-9428-800c6d2ad657]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3212a3b5-d3b2-4ab0-a702-c610a986de46 req-fe4f45eb-96fd-4f8f-96c8-5e0ec2e12eaf service nova] Releasing lock "refresh_cache-de9297d8-10e8-4244-b25d-54d4c2a83aea" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88ac9fe-2039-40db-b0ea-f023c2f0689c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce42a08c-fe87-4533-b647-9872ee5c2d04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:34:18 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6422df38-1d5d-4bd6-ba1c-7a55e9902042]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG os_brick.utils [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Updating existing volume attachment record: 5ab84128-7295-4992-a33c-ee689e91178b {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Acquiring lock "eabef054-b50f-4a34-a501-eb1b991d76af" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "eabef054-b50f-4a34-a501-eb1b991d76af" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG nova.objects.instance [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lazy-loading 'flavor' on Instance uuid eabef054-b50f-4a34-a501-eb1b991d76af {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "eabef054-b50f-4a34-a501-eb1b991d76af" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Acquiring lock "eabef054-b50f-4a34-a501-eb1b991d76af" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "eabef054-b50f-4a34-a501-eb1b991d76af" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:18 user nova-compute[73010]: INFO nova.compute.manager [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Attaching volume bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc to /dev/sdc
Aug 15 00:34:18 user nova-compute[73010]: DEBUG os_brick.utils [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba56214b-431b-4b0d-9b59-61e5cd5df3dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ea2c46-0790-4f9e-9c18-98e467c49dfe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d48e4de-6950-4b3d-a497-0c4aa17ff23b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c8bc97-95c9-4c9c-b820-7e5a9051f36e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:34:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:34:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:34:19 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:34:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b97e74-182c-4506-a417-5554c9d60232]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:34:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:34:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:34:19 user nova-compute[73010]: DEBUG os_brick.utils [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:34:19 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Updating existing volume attachment record: f358cdca-5bdb-44ee-b391-3161ab5ef12b {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:34:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-e9188530-fc6e-4689-82d2-76de6dce3b86 req-3a18a45d-1d4e-4d25-9f5a-922a079240df service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Received event network-changed-cd4cdfd2-7917-4c56-b348-6856691dec61 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-e9188530-fc6e-4689-82d2-76de6dce3b86 req-3a18a45d-1d4e-4d25-9f5a-922a079240df service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Refreshing instance network info cache due to event network-changed-cd4cdfd2-7917-4c56-b348-6856691dec61. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:34:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e9188530-fc6e-4689-82d2-76de6dce3b86 req-3a18a45d-1d4e-4d25-9f5a-922a079240df service nova] Acquiring lock "refresh_cache-b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:34:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e9188530-fc6e-4689-82d2-76de6dce3b86 req-3a18a45d-1d4e-4d25-9f5a-922a079240df service nova] Acquired lock "refresh_cache-b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:34:25 user nova-compute[73010]: DEBUG nova.network.neutron [req-e9188530-fc6e-4689-82d2-76de6dce3b86 req-3a18a45d-1d4e-4d25-9f5a-922a079240df service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Refreshing network info cache for port cd4cdfd2-7917-4c56-b348-6856691dec61 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:34:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:26 user nova-compute[73010]: DEBUG nova.network.neutron [req-e9188530-fc6e-4689-82d2-76de6dce3b86 req-3a18a45d-1d4e-4d25-9f5a-922a079240df service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Updated VIF entry in instance network info cache for port cd4cdfd2-7917-4c56-b348-6856691dec61. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:34:26 user nova-compute[73010]: DEBUG nova.network.neutron [req-e9188530-fc6e-4689-82d2-76de6dce3b86 req-3a18a45d-1d4e-4d25-9f5a-922a079240df service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Updating instance_info_cache with network_info: [{"id": "cd4cdfd2-7917-4c56-b348-6856691dec61", "address": "fa:16:3e:19:09:43", "network": {"id": "af43fc40-99df-4eac-b5f1-c481b6de298a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378376468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331f005ccb394d18a5ec723b1a94bf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4cdfd2-79", "ovs_interfaceid": "cd4cdfd2-7917-4c56-b348-6856691dec61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:34:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e9188530-fc6e-4689-82d2-76de6dce3b86 req-3a18a45d-1d4e-4d25-9f5a-922a079240df service nova] Releasing lock "refresh_cache-b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:34:26 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692059651.3213716, 1ba131ea-c646-4719-b85a-5fc021555fcc => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:34:26 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] VM Stopped (Lifecycle Event)
Aug 15 00:34:26 user nova-compute[73010]: DEBUG nova.compute.manager [None req-d098d61c-3823-4ccc-8f71-4f1291259fec None None] [instance: 1ba131ea-c646-4719-b85a-5fc021555fcc] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:34:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQSVfTht', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:34:27 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:34:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:34:27 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:34:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:34:27 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9525e02f-c5c7-400a-8e19-d23f65190f61]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:34:27 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a49b20-266b-49da-81ab-44285c3eacdf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4] added
Aug 15 00:34:27 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32ffad1-7b19-4eee-80f3-5f75d51115bd]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[21240eaa-7bd9-4b00-9c12-d5d9b2cf3486]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qQSVfTht {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qQSVfTht" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[491c26b5-d7d3-4450-a999-121e64631233]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qQSVfTht'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc1f8e1-305d-49ec-92e5-f4554172d18d]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Acquiring lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8961df16-d16d-4291-bc81-9b6dbe1dc8a3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:27 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:27 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG nova.objects.instance [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lazy-loading 'flavor' on Instance uuid b1d5a938-3f1e-4e8c-bdda-0786d4e27d98 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28a8ba4-54c5-4abc-817b-76a4aa4ca108]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4, portal: 172.16.0.220,3260]
Aug 15 00:34:27 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4, portal: 172.16.0.220,3260] successful.
Aug 15 00:34:27 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e05bcb9-1425-44fb-b1d2-3333dead912c]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4c54d9-26d2-4dce-89c6-618ce6164859]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:27 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:27 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:27 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7487577-6dc2-4668-8612-7f9ab49b7513]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:34:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQSVfTht', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Acquiring lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:28 user nova-compute[73010]: INFO nova.compute.manager [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Attaching volume 96be9a99-0b4f-4eb0-80c3-ca88864e771e to /dev/vdb
Aug 15 00:34:28 user nova-compute[73010]: DEBUG os_brick.utils [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1c9a13-df03-4009-82e2-059e5b759aea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[21254e8a-ae4b-4667-8465-71cf207e058f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ea6bd2-3d44-49c3-bafc-7efa88287ac9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c578d0-dfe7-456c-b236-a2eb28ca1daf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:34:28 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:34:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[16edc052-d536-436f-9a96-b420f154611f]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG os_brick.utils [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Updating existing volume attachment record: e2f7bb7e-f506-43fa-96f5-83df3433e83f {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '26437363139346530', 'path': '/dev/sdi'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437363139346530', 'path': '/dev/sdi'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:34:28 user nova-compute[73010]: DEBUG nova.objects.instance [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lazy-loading 'flavor' on Instance uuid 0588a46c-2314-47e3-b984-1e04518e8a63 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:34:29 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:34:29 user nova-compute[73010]:   <source dev="/dev/sdi"/>
Aug 15 00:34:29 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:34:29 user nova-compute[73010]:   <serial>bef01ca3-78e5-423b-81dc-23855e05d5c4</serial>
Aug 15 00:34:29 user nova-compute[73010]: </disk>
Aug 15 00:34:29 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IDbLmrtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:34:29 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:34:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:34:29 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:34:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:34:29 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf23f482-1106-4e0d-a379-80faebb17d47]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:34:29 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c958258d-999a-423b-afc7-f288640554c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548] added
Aug 15 00:34:29 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca00e089-2d66-4fd5-8827-e1b911363397]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff31188-872f-412b-b9e5-7ef0459a7c66]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IDbLmrtF {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IDbLmrtF" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2856ade-713a-407d-b931-309fd259d774]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IDbLmrtF'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[75503713-f821-465c-a9dd-c87ca44184f7]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1920b690-e5b9-42e0-93db-8abf7ffe8de7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:29 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:29 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[040c1257-5646-4dd9-b1bb-6f7f495856b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548, portal: 172.16.0.220,3260]
Aug 15 00:34:29 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548, portal: 172.16.0.220,3260] successful.
Aug 15 00:34:29 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a273f94-18e0-4342-9ed2-99f16de9f070]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] No VIF found with MAC fa:16:3e:8d:63:82, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e30af35-154a-4e7e-8c65-beea78acdd15]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:29 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:29 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:29 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e8042e-ebe7-4c55-982c-c84bcd71bde4]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IDbLmrtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:34:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-09af988b-4c8f-4885-9243-83a6517e483d tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "0588a46c-2314-47e3-b984-1e04518e8a63" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.355s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRhMadnO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:34:30 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23463383037386432', 'path': '/dev/sdj'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463383037386432', 'path': '/dev/sdj'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.206s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:34:30 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:34:30 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG nova.objects.instance [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Lazy-loading 'flavor' on Instance uuid de9297d8-10e8-4244-b25d-54d4c2a83aea {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a611328c-d6bd-484e-b3bb-357dc8c5702e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:34:30 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb14759-dd71-4f2c-bf33-5e00817a8add]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc] added
Aug 15 00:34:30 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] attach device xml: <disk type="block" device="disk">
Aug 15 00:34:30 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:34:30 user nova-compute[73010]:   <source dev="/dev/sdj"/>
Aug 15 00:34:30 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:34:30 user nova-compute[73010]:   <serial>1cab8cb2-9359-41f1-ae25-f73c0f4fb548</serial>
Aug 15 00:34:30 user nova-compute[73010]: </disk>
Aug 15 00:34:30 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00aae7b-61ce-43f8-bda2-e289033cb46a]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad6e380-1b28-4de0-8b16-86126dadb2d9]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TRhMadnO {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TRhMadnO" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[badaa83c-070b-481a-9287-edc385ff602a]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TRhMadnO'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[82904919-c24c-47e3-be20-17359d5e46a3]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6a7084-d500-4f72-a9ae-ba22ffcb15c9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:30 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:30 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[379d59f3-91bb-45d6-89eb-225e458a9501]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc, portal: 172.16.0.220,3260]
Aug 15 00:34:30 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc, portal: 172.16.0.220,3260] successful.
Aug 15 00:34:30 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d7c421-1d39-40a0-a726-7166b5111558]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2994ff30-2724-4e0e-939f-b370c7fa6614]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:30 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:30 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:30 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b486626a-ca7f-4c3a-9efc-1f23ac1614d6]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:34:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRhMadnO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] No VIF found with MAC fa:16:3e:3c:07:e1, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquiring lock "0588a46c-2314-47e3-b984-1e04518e8a63" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "0588a46c-2314-47e3-b984-1e04518e8a63" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:31 user nova-compute[73010]: INFO nova.compute.manager [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Detaching volume bef01ca3-78e5-423b-81dc-23855e05d5c4
Aug 15 00:34:31 user nova-compute[73010]: INFO nova.virt.block_device [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Attempting to driver detach volume bef01ca3-78e5-423b-81dc-23855e05d5c4 from mountpoint /dev/vdb
Aug 15 00:34:31 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692059656.3400483, afcd0a05-e035-492e-9fbe-cd63f4c3ea42 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:34:31 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] VM Stopped (Lifecycle Event)
Aug 15 00:34:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG nova.compute.manager [None req-a6e824fb-40ac-4c70-bd7d-9f2378d6c276 None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG nova.compute.manager [None req-a6e824fb-40ac-4c70-bd7d-9f2378d6c276 None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-797d6759-23a8-4ff7-ab3e-ac3a37594229 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Lock "de9297d8-10e8-4244-b25d-54d4c2a83aea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.220s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Attempting to detach device vdb from instance 0588a46c-2314-47e3-b984-1e04518e8a63 from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:34:31 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:34:31 user nova-compute[73010]:   <source dev="/dev/sdi"/>
Aug 15 00:34:31 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:34:31 user nova-compute[73010]:   <serial>bef01ca3-78e5-423b-81dc-23855e05d5c4</serial>
Aug 15 00:34:31 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:34:31 user nova-compute[73010]: </disk>
Aug 15 00:34:31 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:34:31 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Successfully detached device vdb from instance 0588a46c-2314-47e3-b984-1e04518e8a63 from the persistent domain config.
Aug 15 00:34:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0588a46c-2314-47e3-b984-1e04518e8a63 from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:34:31 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:34:31 user nova-compute[73010]:   <source dev="/dev/sdi"/>
Aug 15 00:34:31 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:34:31 user nova-compute[73010]:   <serial>bef01ca3-78e5-423b-81dc-23855e05d5c4</serial>
Aug 15 00:34:31 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:34:31 user nova-compute[73010]: </disk>
Aug 15 00:34:31 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-08effdc0-746b-40a9-8325-9ba9b323e8eb tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] volume_snapshot_create: create_info: {'snapshot_id': 'a505fbea-744d-44a9-a69d-69399f65024c', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73010) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-08effdc0-746b-40a9-8325-9ba9b323e8eb tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] snap xml: <domainsnapshot>
Aug 15 00:34:31 user nova-compute[73010]:   <disks>
Aug 15 00:34:31 user nova-compute[73010]:     <disk name="/dev/sdj" snapshot="external" type="file">
Aug 15 00:34:31 user nova-compute[73010]:       <source file="/dev/new_file"/>
Aug 15 00:34:31 user nova-compute[73010]:     </disk>
Aug 15 00:34:31 user nova-compute[73010]:     <disk name="vda" snapshot="no"/>
Aug 15 00:34:31 user nova-compute[73010]:   </disks>
Aug 15 00:34:31 user nova-compute[73010]: </domainsnapshot>
Aug 15 00:34:31 user nova-compute[73010]:  {{(pid=73010) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG nova.objects.instance [None req-08effdc0-746b-40a9-8325-9ba9b323e8eb tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Lazy-loading 'system_metadata' on Instance uuid de9297d8-10e8-4244-b25d-54d4c2a83aea {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:34:31 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-08effdc0-746b-40a9-8325-9ba9b323e8eb tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 00:34:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b0366096-ad85-413a-b1e7-68314fde7c52 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] volume_snapshot_delete: delete_info: {'volume_id': '1cab8cb2-9359-41f1-ae25-f73c0f4fb548'} {{(pid=73010) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [None req-b0366096-ad85-413a-b1e7-68314fde7c52 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Traceback (most recent call last):
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]     if delete_info['type'] != 'qcow2':
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] KeyError: 'type'
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] 
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [None req-08effdc0-746b-40a9-8325-9ba9b323e8eb tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Traceback (most recent call last):
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]     rv = execute(f, *args, **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]     six.reraise(c, e, tb)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]     raise value
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]     rv = meth(*args, **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] 
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [None req-08effdc0-746b-40a9-8325-9ba9b323e8eb tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Traceback (most recent call last):
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]     self._volume_snapshot_create(context, instance, guest,
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]     rv = execute(f, *args, **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]     six.reraise(c, e, tb)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]     raise value
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]     rv = meth(*args, **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] 
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [None req-b0366096-ad85-413a-b1e7-68314fde7c52 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver 
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver 
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-93d54b09-7c3d-459f-8182-192cb75682d0)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver 
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver 
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver 
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server [None req-b0366096-ad85-413a-b1e7-68314fde7c52 tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Exception during message handling: KeyError: 'type'
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server 
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver [None req-08effdc0-746b-40a9-8325-9ba9b323e8eb tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot a505fbea-744d-44a9-a69d-69399f65024c could not be found.
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     raise value
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver 
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver 
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot a505fbea-744d-44a9-a69d-69399f65024c could not be found. (HTTP 404) (Request-ID: req-e7c17fd6-1fa8-4432-94b2-94099257730c)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver 
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver 
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot a505fbea-744d-44a9-a69d-69399f65024c could not be found.
Aug 15 00:34:31 user nova-compute[73010]: ERROR nova.virt.libvirt.driver 
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server [None req-08effdc0-746b-40a9-8325-9ba9b323e8eb tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     raise value
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 00:34:31 user nova-compute[73010]: ERROR oslo_messaging.rpc.server 
Aug 15 00:34:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] <== connect_volume: return (1588ms) {'type': 'block', 'scsi_wwn': '26432346135613035', 'path': '/dev/sdk'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432346135613035', 'path': '/dev/sdk'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG nova.objects.instance [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lazy-loading 'flavor' on Instance uuid eabef054-b50f-4a34-a501-eb1b991d76af {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692059671.9281096, 0588a46c-2314-47e3-b984-1e04518e8a63 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0588a46c-2314-47e3-b984-1e04518e8a63 {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:34:31 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Successfully detached device vdb from instance 0588a46c-2314-47e3-b984-1e04518e8a63 from the live domain config.
Aug 15 00:34:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQSVfTht', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:34:31 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:34:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e8cfb8-77c3-4758-af6a-e444efc4fa37]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:34:31 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:34:31 user nova-compute[73010]:   <source dev="/dev/sdk"/>
Aug 15 00:34:31 user nova-compute[73010]:   <target dev="sdc" bus="scsi"/>
Aug 15 00:34:31 user nova-compute[73010]:   <serial>bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc</serial>
Aug 15 00:34:31 user nova-compute[73010]:   <address type="drive" controller="0" unit="2"/>
Aug 15 00:34:31 user nova-compute[73010]: </disk>
Aug 15 00:34:31 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[43926ff0-20d9-4e43-a024-2b7eb0ed2a61]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:32 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:32 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec506a68c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4'): ({'sdi'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Removing single pathed devices sdi {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b561da03-ff39-4e46-a19f-67fb3e371ab3]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.034s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b956bc-e19e-4520-aacd-6568472a2f16]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Flushing IO for device /dev/sdi {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Acquiring lock "de9297d8-10e8-4244-b25d-54d4c2a83aea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Lock "de9297d8-10e8-4244-b25d-54d4c2a83aea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[659712bb-c0e2-421f-90bf-5e10417f4038]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:32 user nova-compute[73010]: INFO nova.compute.manager [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Detaching volume 1cab8cb2-9359-41f1-ae25-f73c0f4fb548
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.056s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ff0261-b209-4a3a-b532-c4e0d1a66cf6]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] SCSI volumes sdi have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:34:32 user nova-compute[73010]: INFO nova.virt.block_device [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Attempting to driver detach volume 1cab8cb2-9359-41f1-ae25-f73c0f4fb548 from mountpoint /dev/vdb
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Attempting to detach device vdb from instance de9297d8-10e8-4244-b25d-54d4c2a83aea from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] detach device xml: <disk type="block" device="disk">
Aug 15 00:34:32 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:34:32 user nova-compute[73010]:   <source dev="/dev/sdj"/>
Aug 15 00:34:32 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:34:32 user nova-compute[73010]:   <serial>1cab8cb2-9359-41f1-ae25-f73c0f4fb548</serial>
Aug 15 00:34:32 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:34:32 user nova-compute[73010]: </disk>
Aug 15 00:34:32 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:34:32 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Successfully detached device vdb from instance de9297d8-10e8-4244-b25d-54d4c2a83aea from the persistent domain config.
Aug 15 00:34:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de9297d8-10e8-4244-b25d-54d4c2a83aea from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] detach device xml: <disk type="block" device="disk">
Aug 15 00:34:32 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:34:32 user nova-compute[73010]:   <source dev="/dev/sdj"/>
Aug 15 00:34:32 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:34:32 user nova-compute[73010]:   <serial>1cab8cb2-9359-41f1-ae25-f73c0f4fb548</serial>
Aug 15 00:34:32 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:34:32 user nova-compute[73010]: </disk>
Aug 15 00:34:32 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[96641ed8-b6d1-4433-8255-d4103949d2d5]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9cdbf4-9096-4e17-9a42-8d8d10929507]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4, portal: 172.16.0.220,3260]
Aug 15 00:34:32 user nova-compute[73010]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4, portal: 172.16.0.220,3260] successful.
Aug 15 00:34:32 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef01ca3-78e5-423b-81dc-23855e05d5c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c73fd9-fd52-4864-ae58-8fc9dc28f5de]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] <== disconnect_volume: return (353ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] No BDM found with device name sda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] No VIF found with MAC fa:16:3e:1a:29:68, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-125522e8-24ef-4572-8588-9fae17a262a9 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "eabef054-b50f-4a34-a501-eb1b991d76af" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.761s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692059672.6412868, de9297d8-10e8-4244-b25d-54d4c2a83aea => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de9297d8-10e8-4244-b25d-54d4c2a83aea {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:34:32 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Successfully detached device vdb from instance de9297d8-10e8-4244-b25d-54d4c2a83aea from the live domain config.
Aug 15 00:34:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IDbLmrtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:34:32 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae5846f-1f68-459b-8bbf-ba25e88e4bb9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d381b1e-ae79-42e8-b51a-33ed5e37c887]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:32 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:32 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:32 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec305527a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548'): ({'sdj'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Removing single pathed devices sdj {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a44f698-02bc-4a12-84f3-35228106f382]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06b684c-5ae0-4b64-886c-d39a94d2ea7f]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Flushing IO for device /dev/sdj {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d94cad2-719a-4dd1-a999-be61bca7cdbe]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.037s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[05672515-853b-42ee-af48-b1b87b043819]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] SCSI volumes sdj have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ddc90f-9b9f-4824-bc5f-d22e0a013ffd]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be9180a-1d53-4df9-a2de-c52441d4809f]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548, portal: 172.16.0.220,3260]
Aug 15 00:34:32 user nova-compute[73010]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548, portal: 172.16.0.220,3260] successful.
Aug 15 00:34:32 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cab8cb2-9359-41f1-ae25-f73c0f4fb548 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[434d54a6-0ec7-409e-b88a-3584498780d9]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] <== disconnect_volume: return (337ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:34:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG nova.objects.instance [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lazy-loading 'flavor' on Instance uuid 0588a46c-2314-47e3-b984-1e04518e8a63 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ed25ab2f-509c-4012-8c6f-77d4a2e39736 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "0588a46c-2314-47e3-b984-1e04518e8a63" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.999s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Acquiring lock "eabef054-b50f-4a34-a501-eb1b991d76af" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "eabef054-b50f-4a34-a501-eb1b991d76af" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:33 user nova-compute[73010]: INFO nova.compute.manager [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Detaching volume bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc
Aug 15 00:34:33 user nova-compute[73010]: INFO nova.virt.block_device [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Attempting to driver detach volume bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc from mountpoint /dev/sdc
Aug 15 00:34:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Attempting to detach device sdc from instance eabef054-b50f-4a34-a501-eb1b991d76af from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:34:33 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:34:33 user nova-compute[73010]:   <source dev="/dev/sdk"/>
Aug 15 00:34:33 user nova-compute[73010]:   <target dev="sdc" bus="scsi"/>
Aug 15 00:34:33 user nova-compute[73010]:   <serial>bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc</serial>
Aug 15 00:34:33 user nova-compute[73010]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 15 00:34:33 user nova-compute[73010]: </disk>
Aug 15 00:34:33 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:34:33 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Successfully detached device sdc from instance eabef054-b50f-4a34-a501-eb1b991d76af from the persistent domain config.
Aug 15 00:34:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance eabef054-b50f-4a34-a501-eb1b991d76af from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:34:33 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:34:33 user nova-compute[73010]:   <source dev="/dev/sdk"/>
Aug 15 00:34:33 user nova-compute[73010]:   <target dev="sdc" bus="scsi"/>
Aug 15 00:34:33 user nova-compute[73010]:   <serial>bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc</serial>
Aug 15 00:34:33 user nova-compute[73010]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 15 00:34:33 user nova-compute[73010]: </disk>
Aug 15 00:34:33 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692059673.5932298, eabef054-b50f-4a34-a501-eb1b991d76af => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance eabef054-b50f-4a34-a501-eb1b991d76af {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:34:33 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Successfully detached device sdc from instance eabef054-b50f-4a34-a501-eb1b991d76af from the live domain config.
Aug 15 00:34:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRhMadnO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:34:33 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:34:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8323ac-8e1d-4322-ae18-992319e908a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[85756b12-c109-4113-93fd-6a43e7b9e3e6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc (non-flash)
Aug 15 00:34:33 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:33 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:33 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:33 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:33 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:33 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:33 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:33 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc (non-flash)
Aug 15 00:34:33 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:33 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:33 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:33 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:33 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:33 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:33 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:33 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec50245990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc'): ({'sdk'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Removing single pathed devices sdk {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e545164b-a3ea-45e7-90a2-5338f57b4dbd]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[36266e7d-717b-475f-a762-a81cd7b9cc7f]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Flushing IO for device /dev/sdk {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1481acfc-c1bf-4384-8f8d-5b2cffdd72ff]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG nova.objects.instance [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Lazy-loading 'flavor' on Instance uuid de9297d8-10e8-4244-b25d-54d4c2a83aea {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.041s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0226da2-7bb3-4b01-9fcf-53fcd61e85f1]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] SCSI volumes sdk have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4613de4-e85b-4513-b46f-2151bc90de4d tempest-VolumesAssistedSnapshotsTest-1136262055 tempest-VolumesAssistedSnapshotsTest-1136262055-project-admin] Lock "de9297d8-10e8-4244-b25d-54d4c2a83aea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.733s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[000a5de3-4ebc-4866-a36e-c33baf3364f6]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2e751f-f29a-4010-aca2-4e6b65fb7728]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc, portal: 172.16.0.220,3260]
Aug 15 00:34:33 user nova-compute[73010]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc, portal: 172.16.0.220,3260] successful.
Aug 15 00:34:33 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd2d6fee-a67b-4f5f-bdd4-fe3e17c55abc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0857155-f2f4-4e98-9dc3-43cd8ade7e14]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] <== disconnect_volume: return (314ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:34:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:34:34 user nova-compute[73010]: DEBUG nova.objects.instance [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lazy-loading 'flavor' on Instance uuid eabef054-b50f-4a34-a501-eb1b991d76af {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:34:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-862423cc-ccd5-43ea-a60a-83410beb4bff tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "eabef054-b50f-4a34-a501-eb1b991d76af" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.556s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-458ab16b-f055-487f-9176-1911379973f5 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Acquiring lock "eabef054-b50f-4a34-a501-eb1b991d76af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-458ab16b-f055-487f-9176-1911379973f5 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "eabef054-b50f-4a34-a501-eb1b991d76af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-458ab16b-f055-487f-9176-1911379973f5 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Acquiring lock "eabef054-b50f-4a34-a501-eb1b991d76af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-458ab16b-f055-487f-9176-1911379973f5 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "eabef054-b50f-4a34-a501-eb1b991d76af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-458ab16b-f055-487f-9176-1911379973f5 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "eabef054-b50f-4a34-a501-eb1b991d76af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:35 user nova-compute[73010]: INFO nova.compute.manager [None req-458ab16b-f055-487f-9176-1911379973f5 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Terminating instance
Aug 15 00:34:35 user nova-compute[73010]: DEBUG nova.compute.manager [None req-458ab16b-f055-487f-9176-1911379973f5 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:34:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:35 user nova-compute[73010]: DEBUG nova.compute.manager [req-00f4e27f-eb3c-4e87-b0b5-d6ccb60bc38d req-8f21e50d-76f8-4aa5-a8f7-229cafc11389 service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Received event network-vif-unplugged-54ba8c70-915f-4da3-8354-d2a49b3f776e {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-00f4e27f-eb3c-4e87-b0b5-d6ccb60bc38d req-8f21e50d-76f8-4aa5-a8f7-229cafc11389 service nova] Acquiring lock "eabef054-b50f-4a34-a501-eb1b991d76af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-00f4e27f-eb3c-4e87-b0b5-d6ccb60bc38d req-8f21e50d-76f8-4aa5-a8f7-229cafc11389 service nova] Lock "eabef054-b50f-4a34-a501-eb1b991d76af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-00f4e27f-eb3c-4e87-b0b5-d6ccb60bc38d req-8f21e50d-76f8-4aa5-a8f7-229cafc11389 service nova] Lock "eabef054-b50f-4a34-a501-eb1b991d76af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:35 user nova-compute[73010]: DEBUG nova.compute.manager [req-00f4e27f-eb3c-4e87-b0b5-d6ccb60bc38d req-8f21e50d-76f8-4aa5-a8f7-229cafc11389 service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] No waiting events found dispatching network-vif-unplugged-54ba8c70-915f-4da3-8354-d2a49b3f776e {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:35 user nova-compute[73010]: DEBUG nova.compute.manager [req-00f4e27f-eb3c-4e87-b0b5-d6ccb60bc38d req-8f21e50d-76f8-4aa5-a8f7-229cafc11389 service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Received event network-vif-unplugged-54ba8c70-915f-4da3-8354-d2a49b3f776e for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:34:36 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Instance destroyed successfully.
Aug 15 00:34:36 user nova-compute[73010]: DEBUG nova.objects.instance [None req-458ab16b-f055-487f-9176-1911379973f5 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lazy-loading 'resources' on Instance uuid eabef054-b50f-4a34-a501-eb1b991d76af {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:34:36 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-458ab16b-f055-487f-9176-1911379973f5 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:32:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-982755511',display_name='tempest-AttachSCSIVolumeTestJSON-server-982755511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-982755511',id=5,image_ref='437d0ef2-1250-478e-82a8-6bd5914d7aa3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcGDTkHecei8uWZJMvNnj2qLTSP7xRFV/pGQWUMWex8lGrzW9FR5OKQRmpHiz3oaMgSSHR71J83dM5EtXVp7Lbmh7Zj++r1aqFg8kCZmxW5GwZ3vIWOP2ZIBFMnR0G25A==',key_name='tempest-keypair-1416261456',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:32:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1345a35a7947442a82d566d64bcde2b7',ramdisk_id='',reservation_id='r-x80vz07t',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='437d0ef2-1250-478e-82a8-6bd5914d7aa3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-105430535',owner_user_name='tempest-AttachSCSIVolumeTestJSON-105430535-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:32:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a9ba889139040b1b65d5d89d023959f',uuid=eabef054-b50f-4a34-a501-eb1b991d76af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54ba8c70-915f-4da3-8354-d2a49b3f776e", "address": "fa:16:3e:1a:29:68", "network": {"id": "b301d89d-4779-4c2c-9706-69290914800f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1794168145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1345a35a7947442a82d566d64bcde2b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ba8c70-91", "ovs_interfaceid": "54ba8c70-915f-4da3-8354-d2a49b3f776e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:34:36 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-458ab16b-f055-487f-9176-1911379973f5 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Converting VIF {"id": "54ba8c70-915f-4da3-8354-d2a49b3f776e", "address": "fa:16:3e:1a:29:68", "network": {"id": "b301d89d-4779-4c2c-9706-69290914800f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1794168145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1345a35a7947442a82d566d64bcde2b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ba8c70-91", "ovs_interfaceid": "54ba8c70-915f-4da3-8354-d2a49b3f776e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:34:36 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-458ab16b-f055-487f-9176-1911379973f5 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:29:68,bridge_name='br-int',has_traffic_filtering=True,id=54ba8c70-915f-4da3-8354-d2a49b3f776e,network=Network(b301d89d-4779-4c2c-9706-69290914800f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ba8c70-91') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:34:36 user nova-compute[73010]: DEBUG os_vif [None req-458ab16b-f055-487f-9176-1911379973f5 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:29:68,bridge_name='br-int',has_traffic_filtering=True,id=54ba8c70-915f-4da3-8354-d2a49b3f776e,network=Network(b301d89d-4779-4c2c-9706-69290914800f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ba8c70-91') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:34:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54ba8c70-91, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:34:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:34:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:36 user nova-compute[73010]: INFO os_vif [None req-458ab16b-f055-487f-9176-1911379973f5 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:29:68,bridge_name='br-int',has_traffic_filtering=True,id=54ba8c70-915f-4da3-8354-d2a49b3f776e,network=Network(b301d89d-4779-4c2c-9706-69290914800f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ba8c70-91')
Aug 15 00:34:36 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-458ab16b-f055-487f-9176-1911379973f5 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Deleting instance files /opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af_del
Aug 15 00:34:36 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-458ab16b-f055-487f-9176-1911379973f5 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Deletion of /opt/stack/data/nova/instances/eabef054-b50f-4a34-a501-eb1b991d76af_del complete
Aug 15 00:34:36 user nova-compute[73010]: INFO nova.compute.manager [None req-458ab16b-f055-487f-9176-1911379973f5 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 15 00:34:36 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-458ab16b-f055-487f-9176-1911379973f5 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:34:36 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:34:36 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:34:37 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:34:37 user nova-compute[73010]: DEBUG nova.compute.manager [req-95cae830-701e-436f-b044-71b6b002ca2b req-e553e4d0-23ce-4552-9001-875f303587bb service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Received event network-vif-deleted-54ba8c70-915f-4da3-8354-d2a49b3f776e {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:37 user nova-compute[73010]: INFO nova.compute.manager [req-95cae830-701e-436f-b044-71b6b002ca2b req-e553e4d0-23ce-4552-9001-875f303587bb service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Neutron deleted interface 54ba8c70-915f-4da3-8354-d2a49b3f776e; detaching it from the instance and deleting it from the info cache
Aug 15 00:34:37 user nova-compute[73010]: DEBUG nova.network.neutron [req-95cae830-701e-436f-b044-71b6b002ca2b req-e553e4d0-23ce-4552-9001-875f303587bb service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:34:37 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Took 0.78 seconds to deallocate network for instance.
Aug 15 00:34:37 user nova-compute[73010]: DEBUG nova.compute.manager [req-95cae830-701e-436f-b044-71b6b002ca2b req-e553e4d0-23ce-4552-9001-875f303587bb service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Detach interface failed, port_id=54ba8c70-915f-4da3-8354-d2a49b3f776e, reason: Instance eabef054-b50f-4a34-a501-eb1b991d76af could not be found. {{(pid=73010) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 00:34:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-458ab16b-f055-487f-9176-1911379973f5 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-458ab16b-f055-487f-9176-1911379973f5 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:37 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-458ab16b-f055-487f-9176-1911379973f5 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:34:37 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-458ab16b-f055-487f-9176-1911379973f5 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:34:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-458ab16b-f055-487f-9176-1911379973f5 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:37 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-458ab16b-f055-487f-9176-1911379973f5 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Deleted allocations for instance eabef054-b50f-4a34-a501-eb1b991d76af
Aug 15 00:34:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-458ab16b-f055-487f-9176-1911379973f5 tempest-AttachSCSIVolumeTestJSON-105430535 tempest-AttachSCSIVolumeTestJSON-105430535-project-member] Lock "eabef054-b50f-4a34-a501-eb1b991d76af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.205s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG nova.compute.manager [req-53d5bdd7-ba1c-47ce-9180-787ed66d17a0 req-6a2a891b-3dc9-447c-b330-37ab5d5af90d service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Received event network-vif-plugged-54ba8c70-915f-4da3-8354-d2a49b3f776e {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-53d5bdd7-ba1c-47ce-9180-787ed66d17a0 req-6a2a891b-3dc9-447c-b330-37ab5d5af90d service nova] Acquiring lock "eabef054-b50f-4a34-a501-eb1b991d76af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-53d5bdd7-ba1c-47ce-9180-787ed66d17a0 req-6a2a891b-3dc9-447c-b330-37ab5d5af90d service nova] Lock "eabef054-b50f-4a34-a501-eb1b991d76af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-53d5bdd7-ba1c-47ce-9180-787ed66d17a0 req-6a2a891b-3dc9-447c-b330-37ab5d5af90d service nova] Lock "eabef054-b50f-4a34-a501-eb1b991d76af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG nova.compute.manager [req-53d5bdd7-ba1c-47ce-9180-787ed66d17a0 req-6a2a891b-3dc9-447c-b330-37ab5d5af90d service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] No waiting events found dispatching network-vif-plugged-54ba8c70-915f-4da3-8354-d2a49b3f776e {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:38 user nova-compute[73010]: WARNING nova.compute.manager [req-53d5bdd7-ba1c-47ce-9180-787ed66d17a0 req-6a2a891b-3dc9-447c-b330-37ab5d5af90d service nova] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Received unexpected event network-vif-plugged-54ba8c70-915f-4da3-8354-d2a49b3f776e for instance with vm_state deleted and task_state None.
Aug 15 00:34:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTZKdpzY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:34:38 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:34:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:34:38 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:34:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:34:38 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7408c76-44b3-4936-ac74-b27f61451287]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:34:38 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdf3305-be06-4f8b-8ea5-cdf81f899431]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e] added
Aug 15 00:34:38 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[00554f9f-0abb-40a8-a925-fc532db284f5]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40870ff-23be-4325-b037-05966dcf7c02]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BTZKdpzY {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BTZKdpzY" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e956df2-bc6b-48ff-9faf-a34c662010c2]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BTZKdpzY'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d47219-20a8-4180-89c0-de6db2184a7f]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[586f47f7-f0ce-4633-809e-6ef2d64e61b6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:38 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:38 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1732fa35-f4e0-46c1-a9e9-6d909c2adad4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e, portal: 172.16.0.220,3260]
Aug 15 00:34:38 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e, portal: 172.16.0.220,3260] successful.
Aug 15 00:34:38 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be77dc6-f511-4b98-a486-18091d501f10]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e400253a-74df-491c-acd9-d75638d5956a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:38 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:38 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:38 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] HCTL ('40', '-', '-', 0) found on session 13 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8235d1-2815-4bc0-b442-fe4f85d9bf00]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:38 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Searching for a device in session 13 and hctl ['40', '*', '*', 0] yield: None {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:34:39 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Searching for a device in session 13 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:34:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTZKdpzY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:34:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:34:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23134363330373865', 'path': '/dev/sdi'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:34:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134363330373865', 'path': '/dev/sdi'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:34:39 user nova-compute[73010]: DEBUG nova.objects.instance [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lazy-loading 'flavor' on Instance uuid b1d5a938-3f1e-4e8c-bdda-0786d4e27d98 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:34:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:34:39 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:34:39 user nova-compute[73010]:   <source dev="/dev/sdi"/>
Aug 15 00:34:39 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:34:39 user nova-compute[73010]:   <serial>96be9a99-0b4f-4eb0-80c3-ca88864e771e</serial>
Aug 15 00:34:39 user nova-compute[73010]: </disk>
Aug 15 00:34:39 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:34:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:34:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:34:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] No VIF found with MAC fa:16:3e:19:09:43, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:34:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4d5b8bec-4dd7-403a-bb48-5fb64f08a6dd tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.136s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Acquiring lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:41 user nova-compute[73010]: DEBUG os_brick.utils [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:34:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:41 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fab5e1f-23d1-4dd5-9ec9-5281c3b3d3b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:41 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a8b4a7-6885-42cd-a1e4-76208258b64c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:41 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67ea07f-ca87-4f03-a249-1bf2b799082f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:41 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b905087c-c4ab-4991-968f-500c8cbae128]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:34:41 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:34:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:34:41 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:34:41 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54dd35c-d91d-4ba7-a712-5dcd93da834b]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:41 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:34:41 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:34:41 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:34:41 user nova-compute[73010]: DEBUG os_brick.utils [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:34:41 user nova-compute[73010]: INFO nova.compute.manager [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Swapping volume 96be9a99-0b4f-4eb0-80c3-ca88864e771e for cbff44c5-db3f-4495-b774-8b0da8ae1c99
Aug 15 00:34:44 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:34:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:44 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:34:44 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:34:44 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:34:44 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:34:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0627dc52-eca1-48b3-ab8c-c612629a1db2/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0627dc52-eca1-48b3-ab8c-c612629a1db2/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0627dc52-eca1-48b3-ab8c-c612629a1db2/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0627dc52-eca1-48b3-ab8c-c612629a1db2/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:34:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:34:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:34:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:34:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:34:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:48 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:34:48 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:34:48 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=7086MB free_disk=25.828285217285156GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:34:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:48 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 983577b5-4abb-4280-b8e8-a63f42d8f796 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:34:48 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance afcd0a05-e035-492e-9fbe-cd63f4c3ea42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:34:48 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 0588a46c-2314-47e3-b984-1e04518e8a63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:34:48 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance de9297d8-10e8-4244-b25d-54d4c2a83aea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:34:48 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance b1d5a938-3f1e-4e8c-bdda-0786d4e27d98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:34:48 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 0627dc52-eca1-48b3-ab8c-c612629a1db2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:34:48 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 17237e56-67eb-4a05-b004-d27dacc8e04b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:34:48 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:34:48 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance e2410ee7-7351-460a-8d9c-47fe54e08c8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:34:48 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance da32613e-b1a9-4733-831f-e4fb1f34995f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:34:48 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:34:48 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:34:48 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:34:48 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:34:48 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:34:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:49 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:34:49 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:34:49 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:34:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-afcd0a05-e035-492e-9fbe-cd63f4c3ea42" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:34:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-afcd0a05-e035-492e-9fbe-cd63f4c3ea42" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:34:49 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 00:34:50 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Updating instance_info_cache with network_info: [{"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:34:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-afcd0a05-e035-492e-9fbe-cd63f4c3ea42" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:34:50 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 00:34:50 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:34:50 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:34:50 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:34:50 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:34:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692059676.3733923, eabef054-b50f-4a34-a501-eb1b991d76af => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:34:51 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] VM Stopped (Lifecycle Event)
Aug 15 00:34:51 user nova-compute[73010]: DEBUG nova.compute.manager [None req-a5007fcd-d75f-4585-8242-c7224b4350d9 None None] [instance: eabef054-b50f-4a34-a501-eb1b991d76af] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG nova.compute.manager [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCGBmPfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b1d5a938-3f1e-4e8c-bdda-0786d4e27d98', 'attached_at': '', 'detached_at': '', 'volume_id': 'cbff44c5-db3f-4495-b774-8b0da8ae1c99', 'serial': 'cbff44c5-db3f-4495-b774-8b0da8ae1c99'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTZKdpzY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'b1d5a938-3f1e-4e8c-bdda-0786d4e27d98', 'attached_at': '', 'detached_at': '', 'volume_id': '96be9a99-0b4f-4eb0-80c3-ca88864e771e', 'serial'} {{(pid=73010) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCGBmPfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:34:51 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:34:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:34:51 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:34:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:34:51 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e329040-1080-42ab-871c-5a234614e78b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:34:51 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a010f3d6-e1aa-4813-8298-b6fd998a8040]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99] added
Aug 15 00:34:51 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[50736d50-dc79-43a3-96d8-909aa3932717]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d496f49d-40c7-4dc1-a3f3-631f2bd45307]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCGBmPfx {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCGBmPfx" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f3b477-9545-426a-bc26-f12ebe67e709]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dCGBmPfx'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[814014cd-789e-45b7-9660-03755ba078f5]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27b262d-c981-41a3-9ba5-44bc9c21b67b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:51 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:51 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6280e7-95af-40b5-8fba-9949dac2840d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99, portal: 172.16.0.220,3260]
Aug 15 00:34:51 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99, portal: 172.16.0.220,3260] successful.
Aug 15 00:34:51 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd00641e-ccf2-4188-b7bb-6b1b60922504]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a767394-e815-451e-b2f9-2cb3bb249b64]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:51 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:51 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:51 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] HCTL ('41', '-', '-', 0) found on session 14 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0ce02d-dd14-4b9b-90f3-398f49808b33]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Searching for a device in session 14 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:34:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCGBmPfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:34:52 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:34:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:34:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23838333739623238', 'path': '/dev/sdj'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:34:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838333739623238', 'path': '/dev/sdj'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:34:52 user nova-compute[73010]: DEBUG nova.objects.instance [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Lazy-loading 'flavor' on Instance uuid b1d5a938-3f1e-4e8c-bdda-0786d4e27d98 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:34:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 00:34:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] COPY block job progress, current cursor: 176160768 final cursor: 1073741824 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 00:34:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] COPY block job progress, current cursor: 338690048 final cursor: 1073741824 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 00:34:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] COPY block job progress, current cursor: 516947968 final cursor: 1073741824 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 00:34:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] COPY block job progress, current cursor: 691011584 final cursor: 1073741824 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 00:34:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] COPY block job progress, current cursor: 874512384 final cursor: 1073741824 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 00:34:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] COPY block job progress, current cursor: 1038090240 final cursor: 1073741824 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 00:34:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:34:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 00:34:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:34:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTZKdpzY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:34:56 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:34:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:34:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:34:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:34:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[68eca120-c3f9-4fba-899e-4b4b2f8aadac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67be2f5-dbc5-4ca8-8e66-be55e2d94ec0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)
Aug 15 00:34:57 user nova-compute[73010]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 (non-flash)
Aug 15 00:34:57 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:57 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:57 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:57 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:57 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:57 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:57 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:57 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)
Aug 15 00:34:57 user nova-compute[73010]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 (non-flash)
Aug 15 00:34:57 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:34:57 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:34:57 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:34:57 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:34:57 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:34:57 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:34:57 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:34:57 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec503a5bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e'): ({'sdi'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Removing single pathed devices sdi {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8322f02b-f3f7-4133-8bf8-1dcdb80740ee]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b966665-02ba-4f47-b8a4-6ed4043ffd38]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Flushing IO for device /dev/sdi {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[83447e68-4cd9-4f51-bbbc-7e9ccf826953]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.043s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[990302e3-2026-4e2c-9452-5fa0274c8c61]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] SCSI volumes sdi have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6d3740-3f11-47e1-9976-ce600dab6941]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d7174a-7ec3-4088-9706-9e4ccfb6db6a]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e, portal: 172.16.0.220,3260]
Aug 15 00:34:57 user nova-compute[73010]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e, portal: 172.16.0.220,3260] successful.
Aug 15 00:34:57 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda7fbc8-d053-4794-9256-e78b775b082c]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] <== disconnect_volume: return (344ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCGBmPfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'b1d5a938-3f1e-4e8c-bdda-0786d4e27d98', 'attached_at': '', 'detached_at': '', 'volume_id': 'cbff44c5-db3f-4495-b774-8b0da8ae1c99', 'serial'} {{(pid=73010) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] swap_volume: removing Cinder connection for volume 96be9a99-0b4f-4eb0-80c3-ca88864e771e {{(pid=73010) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-08ae31a0-39b0-4109-a1f9-97dc5225dff2 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Acquiring lock "0627dc52-eca1-48b3-ab8c-c612629a1db2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-08ae31a0-39b0-4109-a1f9-97dc5225dff2 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Lock "0627dc52-eca1-48b3-ab8c-c612629a1db2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-08ae31a0-39b0-4109-a1f9-97dc5225dff2 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Acquiring lock "0627dc52-eca1-48b3-ab8c-c612629a1db2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-08ae31a0-39b0-4109-a1f9-97dc5225dff2 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Lock "0627dc52-eca1-48b3-ab8c-c612629a1db2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-08ae31a0-39b0-4109-a1f9-97dc5225dff2 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Lock "0627dc52-eca1-48b3-ab8c-c612629a1db2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:57 user nova-compute[73010]: INFO nova.compute.manager [None req-08ae31a0-39b0-4109-a1f9-97dc5225dff2 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Terminating instance
Aug 15 00:34:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-08ae31a0-39b0-4109-a1f9-97dc5225dff2 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:34:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] swap_volume: Updating volume 96be9a99-0b4f-4eb0-80c3-ca88864e771e BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "dCGBmPfx", "auth_password": "dDFLkoEzuGbHw3", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "cbff44c5-db3f-4495-b774-8b0da8ae1c99"}, "status": "reserved", "instance": "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98", "attached_at": "", "detached_at": "", "volume_id": "cbff44c5-db3f-4495-b774-8b0da8ae1c99", "serial": "cbff44c5-db3f-4495-b774-8b0da8ae1c99"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'cbff44c5-db3f-4495-b774-8b0da8ae1c99', 'no_device': None, 'attachment_id': 'c13e88a2-028e-46e9-89a9-8b8b5f7eac0a'} {{(pid=73010) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 15 00:34:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3f2120f7-38cf-4612-8174-24e490df9a2a tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.586s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:58 user nova-compute[73010]: DEBUG nova.compute.manager [req-3da3cca4-87df-423b-baac-9198284ee45d req-3c4b39c0-4636-4ff9-83ec-79c038e130c6 service nova] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Received event network-vif-unplugged-a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:34:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3da3cca4-87df-423b-baac-9198284ee45d req-3c4b39c0-4636-4ff9-83ec-79c038e130c6 service nova] Acquiring lock "0627dc52-eca1-48b3-ab8c-c612629a1db2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3da3cca4-87df-423b-baac-9198284ee45d req-3c4b39c0-4636-4ff9-83ec-79c038e130c6 service nova] Lock "0627dc52-eca1-48b3-ab8c-c612629a1db2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3da3cca4-87df-423b-baac-9198284ee45d req-3c4b39c0-4636-4ff9-83ec-79c038e130c6 service nova] Lock "0627dc52-eca1-48b3-ab8c-c612629a1db2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:34:58 user nova-compute[73010]: DEBUG nova.compute.manager [req-3da3cca4-87df-423b-baac-9198284ee45d req-3c4b39c0-4636-4ff9-83ec-79c038e130c6 service nova] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] No waiting events found dispatching network-vif-unplugged-a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:34:58 user nova-compute[73010]: DEBUG nova.compute.manager [req-3da3cca4-87df-423b-baac-9198284ee45d req-3c4b39c0-4636-4ff9-83ec-79c038e130c6 service nova] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Received event network-vif-unplugged-a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:34:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Instance destroyed successfully.
Aug 15 00:34:58 user nova-compute[73010]: DEBUG nova.objects.instance [None req-08ae31a0-39b0-4109-a1f9-97dc5225dff2 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Lazy-loading 'resources' on Instance uuid 0627dc52-eca1-48b3-ab8c-c612629a1db2 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:34:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-08ae31a0-39b0-4109-a1f9-97dc5225dff2 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1635998963',display_name='tempest-VolumesActionsTest-instance-1635998963',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1635998963',id=8,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:33:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa034555126d4d708c936d814907d3e5',ramdisk_id='',reservation_id='r-eesihso1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-258940867',owner_user_name='tempest-VolumesActionsTest-258940867-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:33:04Z,user_data=None,user_id='bbd8d398678a4209b631a1f7efb26052',uuid=0627dc52-eca1-48b3-ab8c-c612629a1db2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40", "address": "fa:16:3e:42:ed:c2", "network": {"id": "284020d9-9139-4ae6-b9d5-423309aecbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1943154676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa034555126d4d708c936d814907d3e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c9fd2-b1", "ovs_interfaceid": "a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:34:58 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-08ae31a0-39b0-4109-a1f9-97dc5225dff2 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Converting VIF {"id": "a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40", "address": "fa:16:3e:42:ed:c2", "network": {"id": "284020d9-9139-4ae6-b9d5-423309aecbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1943154676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa034555126d4d708c936d814907d3e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c9fd2-b1", "ovs_interfaceid": "a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:34:58 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-08ae31a0-39b0-4109-a1f9-97dc5225dff2 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:ed:c2,bridge_name='br-int',has_traffic_filtering=True,id=a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40,network=Network(284020d9-9139-4ae6-b9d5-423309aecbb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa90c9fd2-b1') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:34:58 user nova-compute[73010]: DEBUG os_vif [None req-08ae31a0-39b0-4109-a1f9-97dc5225dff2 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:ed:c2,bridge_name='br-int',has_traffic_filtering=True,id=a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40,network=Network(284020d9-9139-4ae6-b9d5-423309aecbb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa90c9fd2-b1') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:34:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa90c9fd2-b1, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:34:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:34:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:58 user nova-compute[73010]: INFO os_vif [None req-08ae31a0-39b0-4109-a1f9-97dc5225dff2 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:ed:c2,bridge_name='br-int',has_traffic_filtering=True,id=a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40,network=Network(284020d9-9139-4ae6-b9d5-423309aecbb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa90c9fd2-b1')
Aug 15 00:34:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-08ae31a0-39b0-4109-a1f9-97dc5225dff2 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Deleting instance files /opt/stack/data/nova/instances/0627dc52-eca1-48b3-ab8c-c612629a1db2_del
Aug 15 00:34:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-08ae31a0-39b0-4109-a1f9-97dc5225dff2 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Deletion of /opt/stack/data/nova/instances/0627dc52-eca1-48b3-ab8c-c612629a1db2_del complete
Aug 15 00:34:58 user nova-compute[73010]: INFO nova.compute.manager [None req-08ae31a0-39b0-4109-a1f9-97dc5225dff2 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 15 00:34:58 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-08ae31a0-39b0-4109-a1f9-97dc5225dff2 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:34:58 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:34:58 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:34:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Acquiring lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG os_brick.utils [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[38390917-24e8-4dac-a30a-7de639703c85]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f2e279-4a51-4a06-8b3f-92eccf0fcd31]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e657f2-595f-4aa7-9993-3d7b342a629a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e1ab2e-bd0f-46e6-b0be-2ec2bdbdb563]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:34:59 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Took 0.83 seconds to deallocate network for instance.
Aug 15 00:34:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:34:59 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:34:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c49b02d-d50d-4357-b2e1-a6af3d5910e2]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG os_brick.utils [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-08ae31a0-39b0-4109-a1f9-97dc5225dff2 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-08ae31a0-39b0-4109-a1f9-97dc5225dff2 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:34:59 user nova-compute[73010]: INFO nova.compute.manager [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Swapping volume cbff44c5-db3f-4495-b774-8b0da8ae1c99 for 96be9a99-0b4f-4eb0-80c3-ca88864e771e
Aug 15 00:34:59 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-08ae31a0-39b0-4109-a1f9-97dc5225dff2 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-08ae31a0-39b0-4109-a1f9-97dc5225dff2 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:34:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-08ae31a0-39b0-4109-a1f9-97dc5225dff2 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:00 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-08ae31a0-39b0-4109-a1f9-97dc5225dff2 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Deleted allocations for instance 0627dc52-eca1-48b3-ab8c-c612629a1db2
Aug 15 00:35:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-08ae31a0-39b0-4109-a1f9-97dc5225dff2 tempest-VolumesActionsTest-258940867 tempest-VolumesActionsTest-258940867-project-member] Lock "0627dc52-eca1-48b3-ab8c-c612629a1db2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.149s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:00 user nova-compute[73010]: DEBUG nova.compute.manager [req-d0dd969d-8999-4de6-8357-58800c0a39fb req-a7b27ccb-2b48-409a-be04-2d8b871ba3c6 service nova] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Received event network-vif-plugged-a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d0dd969d-8999-4de6-8357-58800c0a39fb req-a7b27ccb-2b48-409a-be04-2d8b871ba3c6 service nova] Acquiring lock "0627dc52-eca1-48b3-ab8c-c612629a1db2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d0dd969d-8999-4de6-8357-58800c0a39fb req-a7b27ccb-2b48-409a-be04-2d8b871ba3c6 service nova] Lock "0627dc52-eca1-48b3-ab8c-c612629a1db2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d0dd969d-8999-4de6-8357-58800c0a39fb req-a7b27ccb-2b48-409a-be04-2d8b871ba3c6 service nova] Lock "0627dc52-eca1-48b3-ab8c-c612629a1db2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:00 user nova-compute[73010]: DEBUG nova.compute.manager [req-d0dd969d-8999-4de6-8357-58800c0a39fb req-a7b27ccb-2b48-409a-be04-2d8b871ba3c6 service nova] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] No waiting events found dispatching network-vif-plugged-a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:00 user nova-compute[73010]: WARNING nova.compute.manager [req-d0dd969d-8999-4de6-8357-58800c0a39fb req-a7b27ccb-2b48-409a-be04-2d8b871ba3c6 service nova] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Received unexpected event network-vif-plugged-a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40 for instance with vm_state deleted and task_state None.
Aug 15 00:35:00 user nova-compute[73010]: DEBUG nova.compute.manager [req-d0dd969d-8999-4de6-8357-58800c0a39fb req-a7b27ccb-2b48-409a-be04-2d8b871ba3c6 service nova] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Received event network-vif-deleted-a90c9fd2-b186-4d0a-bcb1-6b7d6da56d40 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG nova.compute.manager [req-f03124ff-50e9-4c85-b1b5-27df28519064 req-ae428f7c-e726-43e0-b69d-b4d827f0073a service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-changed-4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG nova.compute.manager [req-f03124ff-50e9-4c85-b1b5-27df28519064 req-ae428f7c-e726-43e0-b69d-b4d827f0073a service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Refreshing instance network info cache due to event network-changed-4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f03124ff-50e9-4c85-b1b5-27df28519064 req-ae428f7c-e726-43e0-b69d-b4d827f0073a service nova] Acquiring lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f03124ff-50e9-4c85-b1b5-27df28519064 req-ae428f7c-e726-43e0-b69d-b4d827f0073a service nova] Acquired lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG nova.network.neutron [req-f03124ff-50e9-4c85-b1b5-27df28519064 req-ae428f7c-e726-43e0-b69d-b4d827f0073a service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Refreshing network info cache for port 4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTZKdpzY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b1d5a938-3f1e-4e8c-bdda-0786d4e27d98', 'attached_at': '', 'detached_at': '', 'volume_id': '96be9a99-0b4f-4eb0-80c3-ca88864e771e', 'serial': '96be9a99-0b4f-4eb0-80c3-ca88864e771e'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCGBmPfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'cbff44c5-db3f-4495-b774-8b0da8ae1c99'}, 'status': 'reserved', 'instance': 'b1d5a938-3f1e-4e8c-bdda-0786d4e27d98', 'attached_at': '', 'detached_at': '', 'volume_id': 'cbff44c5-db3f-4495-b774-8b0da8ae1c99', 'serial'} {{(pid=73010) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTZKdpzY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:35:10 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:35:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:35:10 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:35:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:35:10 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c2ccba-0c2a-4cfe-8435-a3e296e70772]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:35:10 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca3a7f3-55d9-445a-95d7-7da8884c4a73]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e] added
Aug 15 00:35:10 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[900cf6cc-e8fc-4787-8f99-f49c191c5758]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25995af-de26-4300-abb3-623fc21da79f]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BTZKdpzY {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BTZKdpzY" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[231a3834-8750-4ad0-aec9-f7b02a962282]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BTZKdpzY'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f79db0-ff83-4f34-90d3-0d6cc9ce9b87]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a506253-1260-43d7-ae6e-e43858480d2f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:10 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:10 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a26bc6-234c-4a7f-a0e4-8cd6210ad6e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e, portal: 172.16.0.220,3260]
Aug 15 00:35:10 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e, portal: 172.16.0.220,3260] successful.
Aug 15 00:35:10 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e7c021-fdd5-4f49-a5d9-772a56a3bfe0]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d524adc-5a6f-4c31-ac25-1c77ddd71ad9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:10 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:35:10 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:10 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] HCTL ('40', '-', '-', 0) found on session 15 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd4d64a-abe0-459d-ae7a-990b2e057c57]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Searching for a device in session 15 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTZKdpzY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG nova.network.neutron [req-f03124ff-50e9-4c85-b1b5-27df28519064 req-ae428f7c-e726-43e0-b69d-b4d827f0073a service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Updated VIF entry in instance network info cache for port 4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG nova.network.neutron [req-f03124ff-50e9-4c85-b1b5-27df28519064 req-ae428f7c-e726-43e0-b69d-b4d827f0073a service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Updating instance_info_cache with network_info: [{"id": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "address": "fa:16:3e:b2:cf:d1", "network": {"id": "fb9d1b69-d351-4867-b15a-09c90bf7c5e4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934474624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe2f2c5-f6", "ovs_interfaceid": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21837e06-6627-4156-8b30-7b1499f01b5d", "address": "fa:16:3e:0a:9f:40", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21837e06-66", "ovs_interfaceid": "21837e06-6627-4156-8b30-7b1499f01b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e45de596-2e5e-4306-a083-181d25a33abd", "address": "fa:16:3e:cb:9c:b6", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45de596-2e", "ovs_interfaceid": "e45de596-2e5e-4306-a083-181d25a33abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a7825db-198c-48a3-a587-07e565e7f151", "address": "fa:16:3e:38:fe:95", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7825db-19", "ovs_interfaceid": "6a7825db-198c-48a3-a587-07e565e7f151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "address": "fa:16:3e:4b:5b:ed", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a7a8fb-96", "ovs_interfaceid": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "address": "fa:16:3e:20:58:5d", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcef2b29-87", "ovs_interfaceid": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "592d1e12-5844-4034-bd24-c5882b4be109", "address": "fa:16:3e:c2:dd:0f", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592d1e12-58", "ovs_interfaceid": "592d1e12-5844-4034-bd24-c5882b4be109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:35:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f03124ff-50e9-4c85-b1b5-27df28519064 req-ae428f7c-e726-43e0-b69d-b4d827f0073a service nova] Releasing lock "refresh_cache-17237e56-67eb-4a05-b004-d27dacc8e04b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:35:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:35:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23134363330373865', 'path': '/dev/sdi'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:35:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134363330373865', 'path': '/dev/sdi'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:35:11 user nova-compute[73010]: DEBUG nova.objects.instance [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Lazy-loading 'flavor' on Instance uuid b1d5a938-3f1e-4e8c-bdda-0786d4e27d98 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:35:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 00:35:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] COPY block job progress, current cursor: 126877696 final cursor: 1073741824 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 00:35:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:12 user nova-compute[73010]: INFO nova.compute.manager [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Terminating instance
Aug 15 00:35:12 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:35:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] COPY block job progress, current cursor: 313524224 final cursor: 1073741824 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 00:35:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG nova.compute.manager [req-17744622-a56f-418b-a3d5-c7371a969bab req-9cf20497-aea3-4fb7-bc1e-7b63557d30d1 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-unplugged-21837e06-6627-4156-8b30-7b1499f01b5d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-17744622-a56f-418b-a3d5-c7371a969bab req-9cf20497-aea3-4fb7-bc1e-7b63557d30d1 service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-17744622-a56f-418b-a3d5-c7371a969bab req-9cf20497-aea3-4fb7-bc1e-7b63557d30d1 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-17744622-a56f-418b-a3d5-c7371a969bab req-9cf20497-aea3-4fb7-bc1e-7b63557d30d1 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG nova.compute.manager [req-17744622-a56f-418b-a3d5-c7371a969bab req-9cf20497-aea3-4fb7-bc1e-7b63557d30d1 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-unplugged-21837e06-6627-4156-8b30-7b1499f01b5d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG nova.compute.manager [req-17744622-a56f-418b-a3d5-c7371a969bab req-9cf20497-aea3-4fb7-bc1e-7b63557d30d1 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-unplugged-21837e06-6627-4156-8b30-7b1499f01b5d for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] COPY block job progress, current cursor: 489684992 final cursor: 1073741824 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692059698.5597992, 0627dc52-eca1-48b3-ab8c-c612629a1db2 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:35:13 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] VM Stopped (Lifecycle Event)
Aug 15 00:35:13 user nova-compute[73010]: DEBUG nova.compute.manager [req-dff27c1b-4592-498c-8c3a-78fff17c984f req-4821d616-c911-4a34-aef1-c9f971bcaa39 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-unplugged-4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dff27c1b-4592-498c-8c3a-78fff17c984f req-4821d616-c911-4a34-aef1-c9f971bcaa39 service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dff27c1b-4592-498c-8c3a-78fff17c984f req-4821d616-c911-4a34-aef1-c9f971bcaa39 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dff27c1b-4592-498c-8c3a-78fff17c984f req-4821d616-c911-4a34-aef1-c9f971bcaa39 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG nova.compute.manager [req-dff27c1b-4592-498c-8c3a-78fff17c984f req-4821d616-c911-4a34-aef1-c9f971bcaa39 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-unplugged-4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG nova.compute.manager [req-dff27c1b-4592-498c-8c3a-78fff17c984f req-4821d616-c911-4a34-aef1-c9f971bcaa39 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-unplugged-4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG nova.compute.manager [None req-47160cb4-0638-4cc2-92ba-ff6174c79ef8 None None] [instance: 0627dc52-eca1-48b3-ab8c-c612629a1db2] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] COPY block job progress, current cursor: 668991488 final cursor: 1073741824 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 00:35:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:14 user nova-compute[73010]: DEBUG nova.compute.manager [req-f3bdf2ef-92b0-4b7a-81f2-8ddfe268fe7f req-f7a2ccfd-1767-4b3a-97d1-cdeaab0491b4 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-unplugged-6a7825db-198c-48a3-a587-07e565e7f151 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f3bdf2ef-92b0-4b7a-81f2-8ddfe268fe7f req-f7a2ccfd-1767-4b3a-97d1-cdeaab0491b4 service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f3bdf2ef-92b0-4b7a-81f2-8ddfe268fe7f req-f7a2ccfd-1767-4b3a-97d1-cdeaab0491b4 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f3bdf2ef-92b0-4b7a-81f2-8ddfe268fe7f req-f7a2ccfd-1767-4b3a-97d1-cdeaab0491b4 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:14 user nova-compute[73010]: DEBUG nova.compute.manager [req-f3bdf2ef-92b0-4b7a-81f2-8ddfe268fe7f req-f7a2ccfd-1767-4b3a-97d1-cdeaab0491b4 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-unplugged-6a7825db-198c-48a3-a587-07e565e7f151 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:14 user nova-compute[73010]: DEBUG nova.compute.manager [req-f3bdf2ef-92b0-4b7a-81f2-8ddfe268fe7f req-f7a2ccfd-1767-4b3a-97d1-cdeaab0491b4 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-unplugged-6a7825db-198c-48a3-a587-07e565e7f151 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:35:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] COPY block job progress, current cursor: 801112064 final cursor: 1073741824 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 00:35:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:14 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Instance destroyed successfully.
Aug 15 00:35:14 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lazy-loading 'resources' on Instance uuid 17237e56-67eb-4a05-b004-d27dacc8e04b {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:35:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1967307702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1967307702',id=9,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb77Tq+A5224r5Krpcf49lfSYOhZYyRwgIvnPx0qjf9uFvGCcyIpUtEgHDjrpNXhairuoL+2ujo9E/dynuHIAklLETDvUdq2ij5w/N0YGRhmy64ulbPiiJ0JESPY0Sz8Q==',key_name='tempest-keypair-1553316417',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:34:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c40820fcd77f4dbc8532e4090dd2ca0b',ramdisk_id='',reservation_id='r-rg5wt6cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-488812863',owner_user_name='tempest-TaggedBootDevicesTest_v242-488812863-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7e247179e3845708d8d9565cfe5f472',uuid=17237e56-67eb-4a05-b004-d27dacc8e04b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "address": "fa:16:3e:b2:cf:d1", "network": {"id": "fb9d1b69-d351-4867-b15a-09c90bf7c5e4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934474624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe2f2c5-f6", "ovs_interfaceid": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:35:14 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converting VIF {"id": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "address": "fa:16:3e:b2:cf:d1", "network": {"id": "fb9d1b69-d351-4867-b15a-09c90bf7c5e4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934474624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe2f2c5-f6", "ovs_interfaceid": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:35:14 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:cf:d1,bridge_name='br-int',has_traffic_filtering=True,id=4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589,network=Network(fb9d1b69-d351-4867-b15a-09c90bf7c5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe2f2c5-f6') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:35:14 user nova-compute[73010]: DEBUG os_vif [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:cf:d1,bridge_name='br-int',has_traffic_filtering=True,id=4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589,network=Network(fb9d1b69-d351-4867-b15a-09c90bf7c5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe2f2c5-f6') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:35:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fe2f2c5-f6, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:35:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] COPY block job progress, current cursor: 944766976 final cursor: 1073741824 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 00:35:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:15 user nova-compute[73010]: INFO os_vif [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:cf:d1,bridge_name='br-int',has_traffic_filtering=True,id=4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589,network=Network(fb9d1b69-d351-4867-b15a-09c90bf7c5e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe2f2c5-f6')
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1967307702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1967307702',id=9,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb77Tq+A5224r5Krpcf49lfSYOhZYyRwgIvnPx0qjf9uFvGCcyIpUtEgHDjrpNXhairuoL+2ujo9E/dynuHIAklLETDvUdq2ij5w/N0YGRhmy64ulbPiiJ0JESPY0Sz8Q==',key_name='tempest-keypair-1553316417',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:34:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c40820fcd77f4dbc8532e4090dd2ca0b',ramdisk_id='',reservation_id='r-rg5wt6cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-488812863',owner_user_name='tempest-TaggedBootDevicesTest_v242-488812863-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7e247179e3845708d8d9565cfe5f472',uuid=17237e56-67eb-4a05-b004-d27dacc8e04b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21837e06-6627-4156-8b30-7b1499f01b5d", "address": "fa:16:3e:0a:9f:40", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21837e06-66", "ovs_interfaceid": "21837e06-6627-4156-8b30-7b1499f01b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converting VIF {"id": "21837e06-6627-4156-8b30-7b1499f01b5d", "address": "fa:16:3e:0a:9f:40", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21837e06-66", "ovs_interfaceid": "21837e06-6627-4156-8b30-7b1499f01b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:9f:40,bridge_name='br-int',has_traffic_filtering=True,id=21837e06-6627-4156-8b30-7b1499f01b5d,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21837e06-66') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_vif [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:9f:40,bridge_name='br-int',has_traffic_filtering=True,id=21837e06-6627-4156-8b30-7b1499f01b5d,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21837e06-66') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21837e06-66, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:15 user nova-compute[73010]: INFO os_vif [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:9f:40,bridge_name='br-int',has_traffic_filtering=True,id=21837e06-6627-4156-8b30-7b1499f01b5d,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21837e06-66')
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1967307702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1967307702',id=9,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb77Tq+A5224r5Krpcf49lfSYOhZYyRwgIvnPx0qjf9uFvGCcyIpUtEgHDjrpNXhairuoL+2ujo9E/dynuHIAklLETDvUdq2ij5w/N0YGRhmy64ulbPiiJ0JESPY0Sz8Q==',key_name='tempest-keypair-1553316417',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:34:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c40820fcd77f4dbc8532e4090dd2ca0b',ramdisk_id='',reservation_id='r-rg5wt6cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-488812863',owner_user_name='tempest-TaggedBootDevicesTest_v242-488812863-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7e247179e3845708d8d9565cfe5f472',uuid=17237e56-67eb-4a05-b004-d27dacc8e04b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e45de596-2e5e-4306-a083-181d25a33abd", "address": "fa:16:3e:cb:9c:b6", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45de596-2e", "ovs_interfaceid": "e45de596-2e5e-4306-a083-181d25a33abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converting VIF {"id": "e45de596-2e5e-4306-a083-181d25a33abd", "address": "fa:16:3e:cb:9c:b6", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45de596-2e", "ovs_interfaceid": "e45de596-2e5e-4306-a083-181d25a33abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:9c:b6,bridge_name='br-int',has_traffic_filtering=True,id=e45de596-2e5e-4306-a083-181d25a33abd,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape45de596-2e') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_vif [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:9c:b6,bridge_name='br-int',has_traffic_filtering=True,id=e45de596-2e5e-4306-a083-181d25a33abd,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape45de596-2e') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape45de596-2e, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:15 user nova-compute[73010]: INFO os_vif [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:9c:b6,bridge_name='br-int',has_traffic_filtering=True,id=e45de596-2e5e-4306-a083-181d25a33abd,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape45de596-2e')
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1967307702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1967307702',id=9,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb77Tq+A5224r5Krpcf49lfSYOhZYyRwgIvnPx0qjf9uFvGCcyIpUtEgHDjrpNXhairuoL+2ujo9E/dynuHIAklLETDvUdq2ij5w/N0YGRhmy64ulbPiiJ0JESPY0Sz8Q==',key_name='tempest-keypair-1553316417',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:34:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c40820fcd77f4dbc8532e4090dd2ca0b',ramdisk_id='',reservation_id='r-rg5wt6cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-488812863',owner_user_name='tempest-TaggedBootDevicesTest_v242-488812863-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7e247179e3845708d8d9565cfe5f472',uuid=17237e56-67eb-4a05-b004-d27dacc8e04b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a7825db-198c-48a3-a587-07e565e7f151", "address": "fa:16:3e:38:fe:95", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7825db-19", "ovs_interfaceid": "6a7825db-198c-48a3-a587-07e565e7f151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converting VIF {"id": "6a7825db-198c-48a3-a587-07e565e7f151", "address": "fa:16:3e:38:fe:95", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7825db-19", "ovs_interfaceid": "6a7825db-198c-48a3-a587-07e565e7f151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=6a7825db-198c-48a3-a587-07e565e7f151,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7825db-19') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_vif [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=6a7825db-198c-48a3-a587-07e565e7f151,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7825db-19') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a7825db-19, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:15 user nova-compute[73010]: INFO os_vif [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:fe:95,bridge_name='br-int',has_traffic_filtering=True,id=6a7825db-198c-48a3-a587-07e565e7f151,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7825db-19')
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1967307702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1967307702',id=9,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb77Tq+A5224r5Krpcf49lfSYOhZYyRwgIvnPx0qjf9uFvGCcyIpUtEgHDjrpNXhairuoL+2ujo9E/dynuHIAklLETDvUdq2ij5w/N0YGRhmy64ulbPiiJ0JESPY0Sz8Q==',key_name='tempest-keypair-1553316417',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:34:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c40820fcd77f4dbc8532e4090dd2ca0b',ramdisk_id='',reservation_id='r-rg5wt6cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-488812863',owner_user_name='tempest-TaggedBootDevicesTest_v242-488812863-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7e247179e3845708d8d9565cfe5f472',uuid=17237e56-67eb-4a05-b004-d27dacc8e04b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "address": "fa:16:3e:4b:5b:ed", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a7a8fb-96", "ovs_interfaceid": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converting VIF {"id": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "address": "fa:16:3e:4b:5b:ed", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a7a8fb-96", "ovs_interfaceid": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:5b:ed,bridge_name='br-int',has_traffic_filtering=True,id=c0a7a8fb-96d7-4d75-9c81-bebe9861874d,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a7a8fb-96') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_vif [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:5b:ed,bridge_name='br-int',has_traffic_filtering=True,id=c0a7a8fb-96d7-4d75-9c81-bebe9861874d,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a7a8fb-96') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0a7a8fb-96, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:15 user nova-compute[73010]: INFO os_vif [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:5b:ed,bridge_name='br-int',has_traffic_filtering=True,id=c0a7a8fb-96d7-4d75-9c81-bebe9861874d,network=Network(d0e46dc7-2079-4743-acef-693584926ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a7a8fb-96')
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1967307702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1967307702',id=9,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb77Tq+A5224r5Krpcf49lfSYOhZYyRwgIvnPx0qjf9uFvGCcyIpUtEgHDjrpNXhairuoL+2ujo9E/dynuHIAklLETDvUdq2ij5w/N0YGRhmy64ulbPiiJ0JESPY0Sz8Q==',key_name='tempest-keypair-1553316417',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:34:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c40820fcd77f4dbc8532e4090dd2ca0b',ramdisk_id='',reservation_id='r-rg5wt6cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-488812863',owner_user_name='tempest-TaggedBootDevicesTest_v242-488812863-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7e247179e3845708d8d9565cfe5f472',uuid=17237e56-67eb-4a05-b004-d27dacc8e04b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "address": "fa:16:3e:20:58:5d", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcef2b29-87", "ovs_interfaceid": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converting VIF {"id": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "address": "fa:16:3e:20:58:5d", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcef2b29-87", "ovs_interfaceid": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:58:5d,bridge_name='br-int',has_traffic_filtering=True,id=bcef2b29-872a-4cb1-9d3d-80fc04ee8254,network=Network(4548537a-5eaf-4db4-8e88-179973e7b956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcef2b29-87') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_vif [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:58:5d,bridge_name='br-int',has_traffic_filtering=True,id=bcef2b29-872a-4cb1-9d3d-80fc04ee8254,network=Network(4548537a-5eaf-4db4-8e88-179973e7b956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcef2b29-87') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcef2b29-87, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:15 user nova-compute[73010]: INFO os_vif [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:58:5d,bridge_name='br-int',has_traffic_filtering=True,id=bcef2b29-872a-4cb1-9d3d-80fc04ee8254,network=Network(4548537a-5eaf-4db4-8e88-179973e7b956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcef2b29-87')
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1967307702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1967307702',id=9,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb77Tq+A5224r5Krpcf49lfSYOhZYyRwgIvnPx0qjf9uFvGCcyIpUtEgHDjrpNXhairuoL+2ujo9E/dynuHIAklLETDvUdq2ij5w/N0YGRhmy64ulbPiiJ0JESPY0Sz8Q==',key_name='tempest-keypair-1553316417',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:34:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c40820fcd77f4dbc8532e4090dd2ca0b',ramdisk_id='',reservation_id='r-rg5wt6cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-488812863',owner_user_name='tempest-TaggedBootDevicesTest_v242-488812863-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7e247179e3845708d8d9565cfe5f472',uuid=17237e56-67eb-4a05-b004-d27dacc8e04b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "592d1e12-5844-4034-bd24-c5882b4be109", "address": "fa:16:3e:c2:dd:0f", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592d1e12-58", "ovs_interfaceid": "592d1e12-5844-4034-bd24-c5882b4be109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converting VIF {"id": "592d1e12-5844-4034-bd24-c5882b4be109", "address": "fa:16:3e:c2:dd:0f", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592d1e12-58", "ovs_interfaceid": "592d1e12-5844-4034-bd24-c5882b4be109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:dd:0f,bridge_name='br-int',has_traffic_filtering=True,id=592d1e12-5844-4034-bd24-c5882b4be109,network=Network(4548537a-5eaf-4db4-8e88-179973e7b956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592d1e12-58') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_vif [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:dd:0f,bridge_name='br-int',has_traffic_filtering=True,id=592d1e12-5844-4034-bd24-c5882b4be109,network=Network(4548537a-5eaf-4db4-8e88-179973e7b956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592d1e12-58') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap592d1e12-58, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:15 user nova-compute[73010]: INFO os_vif [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:dd:0f,bridge_name='br-int',has_traffic_filtering=True,id=592d1e12-5844-4034-bd24-c5882b4be109,network=Network(4548537a-5eaf-4db4-8e88-179973e7b956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592d1e12-58')
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HLYogrpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:35:15 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] COPY block job progress, current cursor: 1067450368 final cursor: 1073741824 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[543bf3f8-a0a5-4ac6-b7eb-25eece41037a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd3d735-41f5-4c93-84f7-7ca634517fd9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:15 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:15 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec305ae560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e'): ({'sde'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Removing single pathed devices sde {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e577e465-6491-4ce8-b593-e822ce874082]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[994f4e6c-8a86-4ddb-b7f9-b6c8a72b559f]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Flushing IO for device /dev/sde {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-2c16ab67-e92a-4036-ba7a-dd0fbe312cdf req-370c6913-8b7c-496f-8154-8c7e678bdc02 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-plugged-4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2c16ab67-e92a-4036-ba7a-dd0fbe312cdf req-370c6913-8b7c-496f-8154-8c7e678bdc02 service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2c16ab67-e92a-4036-ba7a-dd0fbe312cdf req-370c6913-8b7c-496f-8154-8c7e678bdc02 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2c16ab67-e92a-4036-ba7a-dd0fbe312cdf req-370c6913-8b7c-496f-8154-8c7e678bdc02 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-2c16ab67-e92a-4036-ba7a-dd0fbe312cdf req-370c6913-8b7c-496f-8154-8c7e678bdc02 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-plugged-4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:15 user nova-compute[73010]: WARNING nova.compute.manager [req-2c16ab67-e92a-4036-ba7a-dd0fbe312cdf req-370c6913-8b7c-496f-8154-8c7e678bdc02 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received unexpected event network-vif-plugged-4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589 for instance with vm_state active and task_state deleting.
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-2c16ab67-e92a-4036-ba7a-dd0fbe312cdf req-370c6913-8b7c-496f-8154-8c7e678bdc02 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-unplugged-bcef2b29-872a-4cb1-9d3d-80fc04ee8254 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2c16ab67-e92a-4036-ba7a-dd0fbe312cdf req-370c6913-8b7c-496f-8154-8c7e678bdc02 service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2c16ab67-e92a-4036-ba7a-dd0fbe312cdf req-370c6913-8b7c-496f-8154-8c7e678bdc02 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2c16ab67-e92a-4036-ba7a-dd0fbe312cdf req-370c6913-8b7c-496f-8154-8c7e678bdc02 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-2c16ab67-e92a-4036-ba7a-dd0fbe312cdf req-370c6913-8b7c-496f-8154-8c7e678bdc02 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-unplugged-bcef2b29-872a-4cb1-9d3d-80fc04ee8254 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-2c16ab67-e92a-4036-ba7a-dd0fbe312cdf req-370c6913-8b7c-496f-8154-8c7e678bdc02 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-unplugged-bcef2b29-872a-4cb1-9d3d-80fc04ee8254 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-2c16ab67-e92a-4036-ba7a-dd0fbe312cdf req-370c6913-8b7c-496f-8154-8c7e678bdc02 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-plugged-bcef2b29-872a-4cb1-9d3d-80fc04ee8254 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2c16ab67-e92a-4036-ba7a-dd0fbe312cdf req-370c6913-8b7c-496f-8154-8c7e678bdc02 service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2c16ab67-e92a-4036-ba7a-dd0fbe312cdf req-370c6913-8b7c-496f-8154-8c7e678bdc02 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2c16ab67-e92a-4036-ba7a-dd0fbe312cdf req-370c6913-8b7c-496f-8154-8c7e678bdc02 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-2c16ab67-e92a-4036-ba7a-dd0fbe312cdf req-370c6913-8b7c-496f-8154-8c7e678bdc02 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-plugged-bcef2b29-872a-4cb1-9d3d-80fc04ee8254 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:15 user nova-compute[73010]: WARNING nova.compute.manager [req-2c16ab67-e92a-4036-ba7a-dd0fbe312cdf req-370c6913-8b7c-496f-8154-8c7e678bdc02 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received unexpected event network-vif-plugged-bcef2b29-872a-4cb1-9d3d-80fc04ee8254 for instance with vm_state active and task_state deleting.
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebbb1e8-311a-4e10-a1d0-865e7e2514c6]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.061s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceff8744-fb80-4efc-9992-c25103fe63a3]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] SCSI volumes sde have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[36604201-63de-406e-bca9-a58837cfbe01]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c73167-8920-4f9a-bb5b-70cb491f6701]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e, portal: 172.16.0.220,3260]
Aug 15 00:35:15 user nova-compute[73010]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e, portal: 172.16.0.220,3260] successful.
Aug 15 00:35:15 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d37848-d45f-4801-ba89-4bff1ae2e44e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d7b972-6e3d-42bf-a650-b957506f4dd9]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] <== disconnect_volume: return (413ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QNJEkPgt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:35:15 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-plugged-21837e06-6627-4156-8b30-7b1499f01b5d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-plugged-21837e06-6627-4156-8b30-7b1499f01b5d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:15 user nova-compute[73010]: WARNING nova.compute.manager [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received unexpected event network-vif-plugged-21837e06-6627-4156-8b30-7b1499f01b5d for instance with vm_state active and task_state deleting.
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-unplugged-e45de596-2e5e-4306-a083-181d25a33abd {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-unplugged-e45de596-2e5e-4306-a083-181d25a33abd {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-unplugged-e45de596-2e5e-4306-a083-181d25a33abd for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-plugged-e45de596-2e5e-4306-a083-181d25a33abd {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-plugged-e45de596-2e5e-4306-a083-181d25a33abd {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:15 user nova-compute[73010]: WARNING nova.compute.manager [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received unexpected event network-vif-plugged-e45de596-2e5e-4306-a083-181d25a33abd for instance with vm_state active and task_state deleting.
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-unplugged-592d1e12-5844-4034-bd24-c5882b4be109 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-unplugged-592d1e12-5844-4034-bd24-c5882b4be109 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-unplugged-592d1e12-5844-4034-bd24-c5882b4be109 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-plugged-592d1e12-5844-4034-bd24-c5882b4be109 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-plugged-592d1e12-5844-4034-bd24-c5882b4be109 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:15 user nova-compute[73010]: WARNING nova.compute.manager [req-3493957e-e7bb-4edb-9166-299909d06690 req-05097eb4-ba9b-439d-978d-cf018b150383 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received unexpected event network-vif-plugged-592d1e12-5844-4034-bd24-c5882b4be109 for instance with vm_state active and task_state deleting.
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[35606d03-5f9f-43ad-991a-58a3b53dfaef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf1289b-243e-444b-b67a-298d3eb270cd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:15 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:35:15 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:15 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec30552c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5'): ({'sdc'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Removing single pathed devices sdc {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d61447d-354c-42a4-bcf3-56a4b7577fec]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d71711-baea-48ae-8856-962f20ae6fac]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:15 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Flushing IO for device /dev/sdc {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[162dd68d-9043-42e4-bfcc-5b3c1ac515cb]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cf857e-019c-454c-8fcb-53088f34e0d7]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] SCSI volumes sdc have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[115ee3b4-9348-48fa-9388-6e8c583ba405]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCGBmPfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'cbff44c5-db3f-4495-b774-8b0da8ae1c99'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:35:16 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bf2ad2-1162-4240-a4d8-fa9f63a366de]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5, portal: 172.16.0.220,3260]
Aug 15 00:35:16 user nova-compute[73010]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5, portal: 172.16.0.220,3260] successful.
Aug 15 00:35:16 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53852b1d-9928-4b22-8c2f-dc8e4fb1dfe5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[094e2025-28ad-4722-baf4-964cfe5dca61]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] <== disconnect_volume: return (303ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.065s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xuecXCgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:35:16 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c86cdf-554e-48f7-826c-7be62618b919]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2294d3-9b3a-4929-a191-57815e5ded07]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 (non-flash)
Aug 15 00:35:16 user nova-compute[73010]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)
Aug 15 00:35:16 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:35:16 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:35:16 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:35:16 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:35:16 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:16 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 (non-flash)
Aug 15 00:35:16 user nova-compute[73010]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)
Aug 15 00:35:16 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:35:16 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:35:16 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:35:16 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:35:16 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:16 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec30648940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99'): ({'sdj'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Removing single pathed devices sdj {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc054761-e4e1-4ef1-ad36-6770ba38a573]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3364887a-01af-4777-a2a8-ee75d0139b13]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Flushing IO for device /dev/sdj {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.012s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b6c4e4-24d3-42f8-abc6-018f04c34c54]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.036s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ecf074-405d-4ee4-890a-744e1cb4f8ac]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] SCSI volumes sdj have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG nova.compute.manager [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-changed-96202dd8-f6e5-436d-b8e7-1db0469cf513 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG nova.compute.manager [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Refreshing instance network info cache due to event network-changed-96202dd8-f6e5-436d-b8e7-1db0469cf513. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] Acquiring lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] Acquired lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG nova.network.neutron [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Refreshing network info cache for port 96202dd8-f6e5-436d-b8e7-1db0469cf513 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b01dd51-4896-458c-bc85-b1928b58655b]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec82a007-622a-48bd-bc0a-23a4e1fc4902]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99, portal: 172.16.0.220,3260]
Aug 15 00:35:16 user nova-compute[73010]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99, portal: 172.16.0.220,3260] successful.
Aug 15 00:35:16 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbff44c5-db3f-4495-b774-8b0da8ae1c99 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22a894c-6e9a-40e4-bb5e-1dd6cc4b371f]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] <== disconnect_volume: return (351ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.289s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5abed2-ad4c-4cea-9963-0dbc389f8a1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fa288a-276e-43fd-bbbc-265f18ab3482]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)
Aug 15 00:35:16 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:35:16 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:35:16 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:35:16 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:35:16 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:16 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)
Aug 15 00:35:16 user nova-compute[73010]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 (non-flash)
Aug 15 00:35:16 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:35:16 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:35:16 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:35:16 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:16 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec506a7c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0'): ({'sdb'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Removing single pathed devices sdb {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG nova.compute.manager [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTZKdpzY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'b1d5a938-3f1e-4e8c-bdda-0786d4e27d98', 'attached_at': '', 'detached_at': '', 'volume_id': '96be9a99-0b4f-4eb0-80c3-ca88864e771e', 'serial'} {{(pid=73010) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG nova.compute.manager [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] swap_volume: removing Cinder connection for volume cbff44c5-db3f-4495-b774-8b0da8ae1c99 {{(pid=73010) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e25231-b5e9-44ad-ae7f-bd27450e14e6]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c273b6-61d0-4e2a-b47f-636f89a013b7]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Flushing IO for device /dev/sdb {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd086a4-7752-4ca8-beee-8c2d51fe20de]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d630960d-a0ad-40eb-a6b1-5927cd767ddc]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd0af63-2720-4820-a9e7-e2fe80e59ab7]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8fdde1-f36f-481a-92e0-d58c386acda5]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0, portal: 172.16.0.220,3260]
Aug 15 00:35:16 user nova-compute[73010]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0, portal: 172.16.0.220,3260] successful.
Aug 15 00:35:16 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9672cd95-fa0a-4c35-b73a-04cb3cfc60e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e792d1e-ec49-4ec9-a4b2-6f3ac039bd45]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] <== disconnect_volume: return (613ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:35:16 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Deleting instance files /opt/stack/data/nova/instances/17237e56-67eb-4a05-b004-d27dacc8e04b_del
Aug 15 00:35:16 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Deletion of /opt/stack/data/nova/instances/17237e56-67eb-4a05-b004-d27dacc8e04b_del complete
Aug 15 00:35:16 user nova-compute[73010]: INFO nova.compute.manager [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Took 4.01 seconds to destroy the instance on the hypervisor.
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG nova.network.neutron [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Updated VIF entry in instance network info cache for port 96202dd8-f6e5-436d-b8e7-1db0469cf513. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG nova.network.neutron [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Updating instance_info_cache with network_info: [{"id": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "address": "fa:16:3e:c8:c9:ad", "network": {"id": "7cec561d-d6de-48e3-ab40-d9bff06a031e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1980904641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96202dd8-f6", "ovs_interfaceid": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "address": "fa:16:3e:ee:92:2f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7932f3-05", "ovs_interfaceid": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "address": "fa:16:3e:b7:0b:5e", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba8ecd1-f3", "ovs_interfaceid": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "address": "fa:16:3e:f8:e5:9f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34cb5-4d", "ovs_interfaceid": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd5ce0a2-ca8e-422d-b36a-64006d1e8217", "address": "fa:16:3e:8d:8b:3f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5ce0a2-ca", "ovs_interfaceid": "fd5ce0a2-ca8e-422d-b36a-64006d1e8217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc702c0a-c79d-48b8-8cc0-7bb18931b11d", "address": "fa:16:3e:69:12:14", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc702c0a-c7", "ovs_interfaceid": "dc702c0a-c79d-48b8-8cc0-7bb18931b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df67aaef-5bdd-4a5a-816b-c34392983877", "address": "fa:16:3e:cb:39:d3", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf67aaef-5b", "ovs_interfaceid": "df67aaef-5bdd-4a5a-816b-c34392983877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] Releasing lock "refresh_cache-4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:35:16 user nova-compute[73010]: DEBUG nova.compute.manager [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-plugged-6a7825db-198c-48a3-a587-07e565e7f151 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:17 user nova-compute[73010]: DEBUG nova.compute.manager [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-plugged-6a7825db-198c-48a3-a587-07e565e7f151 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:17 user nova-compute[73010]: WARNING nova.compute.manager [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received unexpected event network-vif-plugged-6a7825db-198c-48a3-a587-07e565e7f151 for instance with vm_state active and task_state deleting.
Aug 15 00:35:17 user nova-compute[73010]: DEBUG nova.compute.manager [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-unplugged-c0a7a8fb-96d7-4d75-9c81-bebe9861874d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:17 user nova-compute[73010]: DEBUG nova.compute.manager [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-unplugged-c0a7a8fb-96d7-4d75-9c81-bebe9861874d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:17 user nova-compute[73010]: DEBUG nova.compute.manager [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-unplugged-c0a7a8fb-96d7-4d75-9c81-bebe9861874d for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:35:17 user nova-compute[73010]: DEBUG nova.compute.manager [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-plugged-c0a7a8fb-96d7-4d75-9c81-bebe9861874d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] Acquiring lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:17 user nova-compute[73010]: DEBUG nova.compute.manager [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] No waiting events found dispatching network-vif-plugged-c0a7a8fb-96d7-4d75-9c81-bebe9861874d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:17 user nova-compute[73010]: WARNING nova.compute.manager [req-a4326037-6cc3-4651-af9e-c60d5e9e9255 req-5c88aedb-be2d-4e29-aab3-9e4ae867ce06 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received unexpected event network-vif-plugged-c0a7a8fb-96d7-4d75-9c81-bebe9861874d for instance with vm_state active and task_state deleting.
Aug 15 00:35:17 user nova-compute[73010]: DEBUG nova.compute.manager [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] swap_volume: Updating volume cbff44c5-db3f-4495-b774-8b0da8ae1c99 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "BTZKdpzY", "auth_password": "VSgBAIy20dq59j", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "96be9a99-0b4f-4eb0-80c3-ca88864e771e"}, "status": "reserved", "instance": "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98", "attached_at": "", "detached_at": "", "volume_id": "96be9a99-0b4f-4eb0-80c3-ca88864e771e", "serial": "96be9a99-0b4f-4eb0-80c3-ca88864e771e"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '96be9a99-0b4f-4eb0-80c3-ca88864e771e', 'no_device': None, 'attachment_id': '686cec50-9464-461f-a87b-feac8925af41'} {{(pid=73010) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 15 00:35:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-491997bd-1ec7-485a-9b0e-05f71e8e49ef tempest-TestVolumeSwap-1258388830 tempest-TestVolumeSwap-1258388830-project-admin] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.959s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:17 user nova-compute[73010]: INFO nova.compute.manager [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Terminating instance
Aug 15 00:35:17 user nova-compute[73010]: DEBUG nova.compute.manager [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:35:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Acquiring lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:18 user nova-compute[73010]: INFO nova.compute.manager [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Detaching volume 96be9a99-0b4f-4eb0-80c3-ca88864e771e
Aug 15 00:35:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:18 user nova-compute[73010]: INFO nova.virt.block_device [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Attempting to driver detach volume 96be9a99-0b4f-4eb0-80c3-ca88864e771e from mountpoint /dev/vdb
Aug 15 00:35:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Attempting to detach device vdb from instance b1d5a938-3f1e-4e8c-bdda-0786d4e27d98 from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:35:18 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:35:18 user nova-compute[73010]:   <source dev="/dev/sdi"/>
Aug 15 00:35:18 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:35:18 user nova-compute[73010]:   <serial>96be9a99-0b4f-4eb0-80c3-ca88864e771e</serial>
Aug 15 00:35:18 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:35:18 user nova-compute[73010]: </disk>
Aug 15 00:35:18 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:35:18 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Successfully detached device vdb from instance b1d5a938-3f1e-4e8c-bdda-0786d4e27d98 from the persistent domain config.
Aug 15 00:35:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b1d5a938-3f1e-4e8c-bdda-0786d4e27d98 from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:35:18 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:35:18 user nova-compute[73010]:   <source dev="/dev/sdi"/>
Aug 15 00:35:18 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:35:18 user nova-compute[73010]:   <serial>96be9a99-0b4f-4eb0-80c3-ca88864e771e</serial>
Aug 15 00:35:18 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:35:18 user nova-compute[73010]: </disk>
Aug 15 00:35:18 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG nova.compute.manager [req-c092d76c-cdd2-4b17-8a40-fcdc7b6bd678 req-e248f83f-2051-4b00-856f-c2bb1605dd70 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-unplugged-96202dd8-f6e5-436d-b8e7-1db0469cf513 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c092d76c-cdd2-4b17-8a40-fcdc7b6bd678 req-e248f83f-2051-4b00-856f-c2bb1605dd70 service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c092d76c-cdd2-4b17-8a40-fcdc7b6bd678 req-e248f83f-2051-4b00-856f-c2bb1605dd70 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c092d76c-cdd2-4b17-8a40-fcdc7b6bd678 req-e248f83f-2051-4b00-856f-c2bb1605dd70 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG nova.compute.manager [req-c092d76c-cdd2-4b17-8a40-fcdc7b6bd678 req-e248f83f-2051-4b00-856f-c2bb1605dd70 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-unplugged-96202dd8-f6e5-436d-b8e7-1db0469cf513 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG nova.compute.manager [req-c092d76c-cdd2-4b17-8a40-fcdc7b6bd678 req-e248f83f-2051-4b00-856f-c2bb1605dd70 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-unplugged-96202dd8-f6e5-436d-b8e7-1db0469cf513 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG nova.compute.manager [req-087d7ced-caa9-4039-b57e-e33849fa0661 req-1ecdcab5-4189-47af-9b3e-1972b6f4bb7e service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-unplugged-fb7932f3-05b0-4f25-b8f2-38cd50b29fd9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-087d7ced-caa9-4039-b57e-e33849fa0661 req-1ecdcab5-4189-47af-9b3e-1972b6f4bb7e service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-087d7ced-caa9-4039-b57e-e33849fa0661 req-1ecdcab5-4189-47af-9b3e-1972b6f4bb7e service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-087d7ced-caa9-4039-b57e-e33849fa0661 req-1ecdcab5-4189-47af-9b3e-1972b6f4bb7e service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG nova.compute.manager [req-087d7ced-caa9-4039-b57e-e33849fa0661 req-1ecdcab5-4189-47af-9b3e-1972b6f4bb7e service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-unplugged-fb7932f3-05b0-4f25-b8f2-38cd50b29fd9 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG nova.compute.manager [req-087d7ced-caa9-4039-b57e-e33849fa0661 req-1ecdcab5-4189-47af-9b3e-1972b6f4bb7e service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-unplugged-fb7932f3-05b0-4f25-b8f2-38cd50b29fd9 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692059718.8744693, b1d5a938-3f1e-4e8c-bdda-0786d4e27d98 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b1d5a938-3f1e-4e8c-bdda-0786d4e27d98 {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:35:18 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Successfully detached device vdb from instance b1d5a938-3f1e-4e8c-bdda-0786d4e27d98 from the live domain config.
Aug 15 00:35:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTZKdpzY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '96be9a99-0b4f-4eb0-80c3-ca88864e771e'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:35:18 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:35:18 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be26091-08a1-4e55-8be5-81bf53ed191c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[232c5da0-068b-4b1a-b178-0362d9c08260]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)
Aug 15 00:35:18 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:35:18 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:35:18 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:35:18 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:18 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e (non-flash)
Aug 15 00:35:18 user nova-compute[73010]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:35:18 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:35:18 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:35:18 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:18 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec50244310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e'): ({'sdi'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Removing single pathed devices sdi {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9c7d8f-2c46-476a-80d9-6de9817993da]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3798e66-5316-48db-9d0e-e6a5109d589f]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Flushing IO for device /dev/sdi {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:35:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[effa104d-5f46-422e-85e1-adcc34173dd5]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.062s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99f2f64-3502-4a6e-bf8f-15e933adb3ec]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] SCSI volumes sdi have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df01b57-d2fa-45cf-827a-8bc23b084cc1]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b577a62-bba7-42b4-bb10-58b702bbd758]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e, portal: 172.16.0.220,3260]
Aug 15 00:35:19 user nova-compute[73010]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e, portal: 172.16.0.220,3260] successful.
Aug 15 00:35:19 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be9a99-0b4f-4eb0-80c3-ca88864e771e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e7b5f6-2930-4956-8cc7-db84b604c94b]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] <== disconnect_volume: return (353ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG nova.compute.manager [req-4a193a8f-1bba-47a2-8954-642192a31573 req-93f33b3a-ac20-4370-9836-dd68003f1026 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-deleted-6a7825db-198c-48a3-a587-07e565e7f151 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:19 user nova-compute[73010]: INFO nova.compute.manager [req-4a193a8f-1bba-47a2-8954-642192a31573 req-93f33b3a-ac20-4370-9836-dd68003f1026 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Neutron deleted interface 6a7825db-198c-48a3-a587-07e565e7f151; detaching it from the instance and deleting it from the info cache
Aug 15 00:35:19 user nova-compute[73010]: DEBUG nova.network.neutron [req-4a193a8f-1bba-47a2-8954-642192a31573 req-93f33b3a-ac20-4370-9836-dd68003f1026 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Updating instance_info_cache with network_info: [{"id": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "address": "fa:16:3e:b2:cf:d1", "network": {"id": "fb9d1b69-d351-4867-b15a-09c90bf7c5e4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934474624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe2f2c5-f6", "ovs_interfaceid": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21837e06-6627-4156-8b30-7b1499f01b5d", "address": "fa:16:3e:0a:9f:40", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21837e06-66", "ovs_interfaceid": "21837e06-6627-4156-8b30-7b1499f01b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e45de596-2e5e-4306-a083-181d25a33abd", "address": "fa:16:3e:cb:9c:b6", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45de596-2e", "ovs_interfaceid": "e45de596-2e5e-4306-a083-181d25a33abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "address": "fa:16:3e:4b:5b:ed", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a7a8fb-96", "ovs_interfaceid": "c0a7a8fb-96d7-4d75-9c81-bebe9861874d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "address": "fa:16:3e:20:58:5d", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcef2b29-87", "ovs_interfaceid": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "592d1e12-5844-4034-bd24-c5882b4be109", "address": "fa:16:3e:c2:dd:0f", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592d1e12-58", "ovs_interfaceid": "592d1e12-5844-4034-bd24-c5882b4be109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG nova.compute.manager [req-4a193a8f-1bba-47a2-8954-642192a31573 req-93f33b3a-ac20-4370-9836-dd68003f1026 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Detach interface failed, port_id=6a7825db-198c-48a3-a587-07e565e7f151, reason: Instance 17237e56-67eb-4a05-b004-d27dacc8e04b could not be found. {{(pid=73010) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 00:35:19 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Instance destroyed successfully.
Aug 15 00:35:19 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lazy-loading 'resources' on Instance uuid 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309960876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309960876',id=10,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaElAIGo4Bm7GMTjcj3kUyyF4uXCbPJ11OmUatZA3IqbJCewyAirchbAEmc/yMHGA7E1Vppk2rnG29ulZ0YrZY4bYepg512jiGaRtJsEaQvL3cbLMjpmsAkpK/8OJFTng==',key_name='tempest-keypair-786142666',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:34:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097516b3ada04de28f172aa5c3ff679f',ramdisk_id='',reservation_id='r-kuh2cgmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1736972663',owner_user_name='tempest-TaggedBootDevicesTest-1736972663-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:34:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61d907257ede4c1eb8a426a90b81abe6',uuid=4c37ecd1-7a9b-4c77-8a52-c81f56321ca3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "address": "fa:16:3e:c8:c9:ad", "network": {"id": "7cec561d-d6de-48e3-ab40-d9bff06a031e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1980904641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96202dd8-f6", "ovs_interfaceid": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converting VIF {"id": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "address": "fa:16:3e:c8:c9:ad", "network": {"id": "7cec561d-d6de-48e3-ab40-d9bff06a031e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1980904641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96202dd8-f6", "ovs_interfaceid": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:c9:ad,bridge_name='br-int',has_traffic_filtering=True,id=96202dd8-f6e5-436d-b8e7-1db0469cf513,network=Network(7cec561d-d6de-48e3-ab40-d9bff06a031e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96202dd8-f6') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG os_vif [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:c9:ad,bridge_name='br-int',has_traffic_filtering=True,id=96202dd8-f6e5-436d-b8e7-1db0469cf513,network=Network(7cec561d-d6de-48e3-ab40-d9bff06a031e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96202dd8-f6') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96202dd8-f6, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:19 user nova-compute[73010]: INFO os_vif [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:c9:ad,bridge_name='br-int',has_traffic_filtering=True,id=96202dd8-f6e5-436d-b8e7-1db0469cf513,network=Network(7cec561d-d6de-48e3-ab40-d9bff06a031e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96202dd8-f6')
Aug 15 00:35:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309960876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309960876',id=10,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaElAIGo4Bm7GMTjcj3kUyyF4uXCbPJ11OmUatZA3IqbJCewyAirchbAEmc/yMHGA7E1Vppk2rnG29ulZ0YrZY4bYepg512jiGaRtJsEaQvL3cbLMjpmsAkpK/8OJFTng==',key_name='tempest-keypair-786142666',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:34:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097516b3ada04de28f172aa5c3ff679f',ramdisk_id='',reservation_id='r-kuh2cgmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1736972663',owner_user_name='tempest-TaggedBootDevicesTest-1736972663-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:34:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61d907257ede4c1eb8a426a90b81abe6',uuid=4c37ecd1-7a9b-4c77-8a52-c81f56321ca3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "address": "fa:16:3e:ee:92:2f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7932f3-05", "ovs_interfaceid": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converting VIF {"id": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "address": "fa:16:3e:ee:92:2f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7932f3-05", "ovs_interfaceid": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:92:2f,bridge_name='br-int',has_traffic_filtering=True,id=fb7932f3-05b0-4f25-b8f2-38cd50b29fd9,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfb7932f3-05') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG os_vif [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:92:2f,bridge_name='br-int',has_traffic_filtering=True,id=fb7932f3-05b0-4f25-b8f2-38cd50b29fd9,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfb7932f3-05') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb7932f3-05, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:19 user nova-compute[73010]: INFO os_vif [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:92:2f,bridge_name='br-int',has_traffic_filtering=True,id=fb7932f3-05b0-4f25-b8f2-38cd50b29fd9,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfb7932f3-05')
Aug 15 00:35:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309960876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309960876',id=10,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaElAIGo4Bm7GMTjcj3kUyyF4uXCbPJ11OmUatZA3IqbJCewyAirchbAEmc/yMHGA7E1Vppk2rnG29ulZ0YrZY4bYepg512jiGaRtJsEaQvL3cbLMjpmsAkpK/8OJFTng==',key_name='tempest-keypair-786142666',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:34:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097516b3ada04de28f172aa5c3ff679f',ramdisk_id='',reservation_id='r-kuh2cgmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1736972663',owner_user_name='tempest-TaggedBootDevicesTest-1736972663-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:34:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61d907257ede4c1eb8a426a90b81abe6',uuid=4c37ecd1-7a9b-4c77-8a52-c81f56321ca3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "address": "fa:16:3e:b7:0b:5e", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba8ecd1-f3", "ovs_interfaceid": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converting VIF {"id": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "address": "fa:16:3e:b7:0b:5e", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba8ecd1-f3", "ovs_interfaceid": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0b:5e,bridge_name='br-int',has_traffic_filtering=True,id=1ba8ecd1-f3a8-460d-9f61-b15d9319d83f,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1ba8ecd1-f3') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG os_vif [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0b:5e,bridge_name='br-int',has_traffic_filtering=True,id=1ba8ecd1-f3a8-460d-9f61-b15d9319d83f,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1ba8ecd1-f3') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ba8ecd1-f3, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:19 user nova-compute[73010]: INFO os_vif [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0b:5e,bridge_name='br-int',has_traffic_filtering=True,id=1ba8ecd1-f3a8-460d-9f61-b15d9319d83f,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1ba8ecd1-f3')
Aug 15 00:35:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309960876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309960876',id=10,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaElAIGo4Bm7GMTjcj3kUyyF4uXCbPJ11OmUatZA3IqbJCewyAirchbAEmc/yMHGA7E1Vppk2rnG29ulZ0YrZY4bYepg512jiGaRtJsEaQvL3cbLMjpmsAkpK/8OJFTng==',key_name='tempest-keypair-786142666',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:34:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097516b3ada04de28f172aa5c3ff679f',ramdisk_id='',reservation_id='r-kuh2cgmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1736972663',owner_user_name='tempest-TaggedBootDevicesTest-1736972663-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:34:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61d907257ede4c1eb8a426a90b81abe6',uuid=4c37ecd1-7a9b-4c77-8a52-c81f56321ca3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "address": "fa:16:3e:f8:e5:9f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34cb5-4d", "ovs_interfaceid": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converting VIF {"id": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "address": "fa:16:3e:f8:e5:9f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34cb5-4d", "ovs_interfaceid": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e5:9f,bridge_name='br-int',has_traffic_filtering=True,id=03a34cb5-4d57-4c59-ba58-b162bf49daa3,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a34cb5-4d') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG os_vif [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e5:9f,bridge_name='br-int',has_traffic_filtering=True,id=03a34cb5-4d57-4c59-ba58-b162bf49daa3,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a34cb5-4d') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03a34cb5-4d, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:35:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:20 user nova-compute[73010]: INFO os_vif [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:e5:9f,bridge_name='br-int',has_traffic_filtering=True,id=03a34cb5-4d57-4c59-ba58-b162bf49daa3,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a34cb5-4d')
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309960876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309960876',id=10,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaElAIGo4Bm7GMTjcj3kUyyF4uXCbPJ11OmUatZA3IqbJCewyAirchbAEmc/yMHGA7E1Vppk2rnG29ulZ0YrZY4bYepg512jiGaRtJsEaQvL3cbLMjpmsAkpK/8OJFTng==',key_name='tempest-keypair-786142666',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:34:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097516b3ada04de28f172aa5c3ff679f',ramdisk_id='',reservation_id='r-kuh2cgmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1736972663',owner_user_name='tempest-TaggedBootDevicesTest-1736972663-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:34:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61d907257ede4c1eb8a426a90b81abe6',uuid=4c37ecd1-7a9b-4c77-8a52-c81f56321ca3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd5ce0a2-ca8e-422d-b36a-64006d1e8217", "address": "fa:16:3e:8d:8b:3f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5ce0a2-ca", "ovs_interfaceid": "fd5ce0a2-ca8e-422d-b36a-64006d1e8217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converting VIF {"id": "fd5ce0a2-ca8e-422d-b36a-64006d1e8217", "address": "fa:16:3e:8d:8b:3f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5ce0a2-ca", "ovs_interfaceid": "fd5ce0a2-ca8e-422d-b36a-64006d1e8217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=fd5ce0a2-ca8e-422d-b36a-64006d1e8217,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5ce0a2-ca') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_vif [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=fd5ce0a2-ca8e-422d-b36a-64006d1e8217,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5ce0a2-ca') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd5ce0a2-ca, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:20 user nova-compute[73010]: INFO os_vif [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=fd5ce0a2-ca8e-422d-b36a-64006d1e8217,network=Network(72833973-969d-43e2-a74b-445e89f60921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5ce0a2-ca')
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309960876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309960876',id=10,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaElAIGo4Bm7GMTjcj3kUyyF4uXCbPJ11OmUatZA3IqbJCewyAirchbAEmc/yMHGA7E1Vppk2rnG29ulZ0YrZY4bYepg512jiGaRtJsEaQvL3cbLMjpmsAkpK/8OJFTng==',key_name='tempest-keypair-786142666',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:34:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097516b3ada04de28f172aa5c3ff679f',ramdisk_id='',reservation_id='r-kuh2cgmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1736972663',owner_user_name='tempest-TaggedBootDevicesTest-1736972663-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:34:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61d907257ede4c1eb8a426a90b81abe6',uuid=4c37ecd1-7a9b-4c77-8a52-c81f56321ca3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc702c0a-c79d-48b8-8cc0-7bb18931b11d", "address": "fa:16:3e:69:12:14", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc702c0a-c7", "ovs_interfaceid": "dc702c0a-c79d-48b8-8cc0-7bb18931b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converting VIF {"id": "dc702c0a-c79d-48b8-8cc0-7bb18931b11d", "address": "fa:16:3e:69:12:14", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc702c0a-c7", "ovs_interfaceid": "dc702c0a-c79d-48b8-8cc0-7bb18931b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:12:14,bridge_name='br-int',has_traffic_filtering=True,id=dc702c0a-c79d-48b8-8cc0-7bb18931b11d,network=Network(10ff1ca5-f22f-4571-bf99-edcc3ed43828),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc702c0a-c7') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_vif [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:12:14,bridge_name='br-int',has_traffic_filtering=True,id=dc702c0a-c79d-48b8-8cc0-7bb18931b11d,network=Network(10ff1ca5-f22f-4571-bf99-edcc3ed43828),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc702c0a-c7') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc702c0a-c7, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:20 user nova-compute[73010]: INFO os_vif [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:12:14,bridge_name='br-int',has_traffic_filtering=True,id=dc702c0a-c79d-48b8-8cc0-7bb18931b11d,network=Network(10ff1ca5-f22f-4571-bf99-edcc3ed43828),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc702c0a-c7')
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309960876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309960876',id=10,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaElAIGo4Bm7GMTjcj3kUyyF4uXCbPJ11OmUatZA3IqbJCewyAirchbAEmc/yMHGA7E1Vppk2rnG29ulZ0YrZY4bYepg512jiGaRtJsEaQvL3cbLMjpmsAkpK/8OJFTng==',key_name='tempest-keypair-786142666',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:34:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097516b3ada04de28f172aa5c3ff679f',ramdisk_id='',reservation_id='r-kuh2cgmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1736972663',owner_user_name='tempest-TaggedBootDevicesTest-1736972663-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:34:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61d907257ede4c1eb8a426a90b81abe6',uuid=4c37ecd1-7a9b-4c77-8a52-c81f56321ca3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df67aaef-5bdd-4a5a-816b-c34392983877", "address": "fa:16:3e:cb:39:d3", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf67aaef-5b", "ovs_interfaceid": "df67aaef-5bdd-4a5a-816b-c34392983877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converting VIF {"id": "df67aaef-5bdd-4a5a-816b-c34392983877", "address": "fa:16:3e:cb:39:d3", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf67aaef-5b", "ovs_interfaceid": "df67aaef-5bdd-4a5a-816b-c34392983877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:39:d3,bridge_name='br-int',has_traffic_filtering=True,id=df67aaef-5bdd-4a5a-816b-c34392983877,network=Network(10ff1ca5-f22f-4571-bf99-edcc3ed43828),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf67aaef-5b') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_vif [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:39:d3,bridge_name='br-int',has_traffic_filtering=True,id=df67aaef-5bdd-4a5a-816b-c34392983877,network=Network(10ff1ca5-f22f-4571-bf99-edcc3ed43828),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf67aaef-5b') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf67aaef-5b, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:20 user nova-compute[73010]: INFO os_vif [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:39:d3,bridge_name='br-int',has_traffic_filtering=True,id=df67aaef-5bdd-4a5a-816b-c34392983877,network=Network(10ff1ca5-f22f-4571-bf99-edcc3ed43828),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf67aaef-5b')
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hIaUewYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:35:20 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ff0a7f-1a05-447d-ae84-602fae4f80f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc48db67-1aa3-4916-a0bc-7bb5bf99a535]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:35:20 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:35:20 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:35:20 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:20 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:35:20 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:35:20 user nova-compute[73010]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f (non-flash)
Aug 15 00:35:20 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:20 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec305adab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f'): ({'sdg'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Removing single pathed devices sdg {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cf69c7-a6dc-41cd-b9be-a8b5d998eb86]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.objects.instance [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lazy-loading 'flavor' on Instance uuid b1d5a938-3f1e-4e8c-bdda-0786d4e27d98 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8568547-e5f8-4d04-8ba9-52d9689f247e]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Flushing IO for device /dev/sdg {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[964a2ca5-a144-4d32-9b5a-164c5b8364dc]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cc86c423-c925-4764-80c7-4abd2bb91c91 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.084s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9e9aad-e35b-4c67-9db7-7b93b17a7d10]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] SCSI volumes sdg have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4661d5-5d12-41e0-acb5-745e65ffccb4]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[149c11ae-a16c-408c-95ff-325b97191fb5]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f, portal: 172.16.0.220,3260]
Aug 15 00:35:20 user nova-compute[73010]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f, portal: 172.16.0.220,3260] successful.
Aug 15 00:35:20 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-plugged-96202dd8-f6e5-436d-b8e7-1db0469cf513 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-plugged-96202dd8-f6e5-436d-b8e7-1db0469cf513 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:20 user nova-compute[73010]: WARNING nova.compute.manager [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received unexpected event network-vif-plugged-96202dd8-f6e5-436d-b8e7-1db0469cf513 for instance with vm_state active and task_state deleting.
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-unplugged-1ba8ecd1-f3a8-460d-9f61-b15d9319d83f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-unplugged-1ba8ecd1-f3a8-460d-9f61-b15d9319d83f {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-unplugged-1ba8ecd1-f3a8-460d-9f61-b15d9319d83f for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-plugged-1ba8ecd1-f3a8-460d-9f61-b15d9319d83f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-plugged-1ba8ecd1-f3a8-460d-9f61-b15d9319d83f {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:20 user nova-compute[73010]: WARNING nova.compute.manager [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received unexpected event network-vif-plugged-1ba8ecd1-f3a8-460d-9f61-b15d9319d83f for instance with vm_state active and task_state deleting.
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-unplugged-03a34cb5-4d57-4c59-ba58-b162bf49daa3 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-unplugged-03a34cb5-4d57-4c59-ba58-b162bf49daa3 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-unplugged-03a34cb5-4d57-4c59-ba58-b162bf49daa3 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-plugged-03a34cb5-4d57-4c59-ba58-b162bf49daa3 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-plugged-03a34cb5-4d57-4c59-ba58-b162bf49daa3 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:20 user nova-compute[73010]: WARNING nova.compute.manager [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received unexpected event network-vif-plugged-03a34cb5-4d57-4c59-ba58-b162bf49daa3 for instance with vm_state active and task_state deleting.
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-unplugged-df67aaef-5bdd-4a5a-816b-c34392983877 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-unplugged-df67aaef-5bdd-4a5a-816b-c34392983877 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-35801d1c-7d8f-46ee-b5b7-757f10ce3d00 req-5e579805-d3cb-417e-8135-0ec8f4deb9a1 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-unplugged-df67aaef-5bdd-4a5a-816b-c34392983877 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57ed00d8-4c0b-4f7e-81ca-0f8cf726f53f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[94db5177-4bb5-4895-ba3f-b2f83cdbbbc9]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] <== disconnect_volume: return (319ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iouBVYMd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:35:20 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[10aa48c8-7d17-4096-8b50-7f61e9ab3a3c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad42267-467d-4190-9167-6d776a9f97f8]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:35:20 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:35:20 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:20 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:35:20 user nova-compute[73010]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 (non-flash)
Aug 15 00:35:20 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:20 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec50245000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246'): ({'sdf'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Removing single pathed devices sdf {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02f183b-b94f-4bfe-8659-9124f2e11cae]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[11349955-f284-43b9-a5e3-160cf4b2a089]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Flushing IO for device /dev/sdf {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f740f5f-6769-4a02-93de-da4c48813d3b]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0101d567-3d01-44f5-949c-608a4ad467c8]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] SCSI volumes sdf have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8c4692-bfa4-477f-a308-6fafebb02190]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb8b1f7-d6ca-43b4-a694-11ee7bd0e15e]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246, portal: 172.16.0.220,3260]
Aug 15 00:35:20 user nova-compute[73010]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246, portal: 172.16.0.220,3260] successful.
Aug 15 00:35:20 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-plugged-fb7932f3-05b0-4f25-b8f2-38cd50b29fd9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-plugged-fb7932f3-05b0-4f25-b8f2-38cd50b29fd9 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:20 user nova-compute[73010]: WARNING nova.compute.manager [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received unexpected event network-vif-plugged-fb7932f3-05b0-4f25-b8f2-38cd50b29fd9 for instance with vm_state active and task_state deleting.
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-unplugged-fd5ce0a2-ca8e-422d-b36a-64006d1e8217 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-unplugged-fd5ce0a2-ca8e-422d-b36a-64006d1e8217 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-unplugged-fd5ce0a2-ca8e-422d-b36a-64006d1e8217 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-plugged-fd5ce0a2-ca8e-422d-b36a-64006d1e8217 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-plugged-fd5ce0a2-ca8e-422d-b36a-64006d1e8217 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:20 user nova-compute[73010]: WARNING nova.compute.manager [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received unexpected event network-vif-plugged-fd5ce0a2-ca8e-422d-b36a-64006d1e8217 for instance with vm_state active and task_state deleting.
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-unplugged-dc702c0a-c79d-48b8-8cc0-7bb18931b11d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-unplugged-dc702c0a-c79d-48b8-8cc0-7bb18931b11d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-unplugged-dc702c0a-c79d-48b8-8cc0-7bb18931b11d for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-plugged-dc702c0a-c79d-48b8-8cc0-7bb18931b11d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-plugged-dc702c0a-c79d-48b8-8cc0-7bb18931b11d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:20 user nova-compute[73010]: WARNING nova.compute.manager [req-e87d711e-5021-4479-abd3-5e832ea35943 req-a2e62f7d-bebd-43b5-a9c7-9ba99f95576d service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received unexpected event network-vif-plugged-dc702c0a-c79d-48b8-8cc0-7bb18931b11d for instance with vm_state active and task_state deleting.
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6127b0fe-bc91-438d-8e0f-b465b3a2e246 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4dec60-4509-44be-bfab-d2da26d2411d]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] <== disconnect_volume: return (293ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MeEwJqdh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:35:20 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[036d3c88-50d9-4ee1-abfb-5a20b962b9c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4835a3f-ad21-43e5-a9cf-ba32bb7e7687]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:35:20 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:20 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b (non-flash)
Aug 15 00:35:20 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:20 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec305acb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b'): ({'sdd'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Removing single pathed devices sdd {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf633b16-ec30-4c63-8fce-53e3a03bd21c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b94dd7e-6f4e-4d77-92e6-53c79dbf2893]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Flushing IO for device /dev/sdd {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[029ac5fb-4aa6-4789-9f21-0f45ad581918]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc689d89-20d7-49ff-84d9-b91574cea970]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] SCSI volumes sdd have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e932c165-42eb-47a5-86b0-6b7afefa7bcc]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:21 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc157ea-573d-48f4-9640-c75a344ef4ef]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:21 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b, portal: 172.16.0.220,3260]
Aug 15 00:35:21 user nova-compute[73010]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b, portal: 172.16.0.220,3260] successful.
Aug 15 00:35:21 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d30d7ee-53a5-48d3-8113-a5172c87455b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:21 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4e8007-0fc2-4293-9b7f-d4886e1928dc]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:21 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:21 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:35:21 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] <== disconnect_volume: return (265ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:35:21 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:35:21 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Deleting instance files /opt/stack/data/nova/instances/4c37ecd1-7a9b-4c77-8a52-c81f56321ca3_del
Aug 15 00:35:21 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Deletion of /opt/stack/data/nova/instances/4c37ecd1-7a9b-4c77-8a52-c81f56321ca3_del complete
Aug 15 00:35:21 user nova-compute[73010]: INFO nova.compute.manager [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Took 3.26 seconds to destroy the instance on the hypervisor.
Aug 15 00:35:21 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:35:21 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:35:21 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:35:21 user nova-compute[73010]: DEBUG nova.compute.manager [req-03034908-58bb-4cc1-8fca-5ece4713032f req-5075bbf1-8119-4992-98e7-fe18197857d1 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-deleted-c0a7a8fb-96d7-4d75-9c81-bebe9861874d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:21 user nova-compute[73010]: INFO nova.compute.manager [req-03034908-58bb-4cc1-8fca-5ece4713032f req-5075bbf1-8119-4992-98e7-fe18197857d1 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Neutron deleted interface c0a7a8fb-96d7-4d75-9c81-bebe9861874d; detaching it from the instance and deleting it from the info cache
Aug 15 00:35:21 user nova-compute[73010]: DEBUG nova.network.neutron [req-03034908-58bb-4cc1-8fca-5ece4713032f req-5075bbf1-8119-4992-98e7-fe18197857d1 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Updating instance_info_cache with network_info: [{"id": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "address": "fa:16:3e:b2:cf:d1", "network": {"id": "fb9d1b69-d351-4867-b15a-09c90bf7c5e4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934474624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe2f2c5-f6", "ovs_interfaceid": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21837e06-6627-4156-8b30-7b1499f01b5d", "address": "fa:16:3e:0a:9f:40", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21837e06-66", "ovs_interfaceid": "21837e06-6627-4156-8b30-7b1499f01b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e45de596-2e5e-4306-a083-181d25a33abd", "address": "fa:16:3e:cb:9c:b6", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45de596-2e", "ovs_interfaceid": "e45de596-2e5e-4306-a083-181d25a33abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "address": "fa:16:3e:20:58:5d", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcef2b29-87", "ovs_interfaceid": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "592d1e12-5844-4034-bd24-c5882b4be109", "address": "fa:16:3e:c2:dd:0f", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592d1e12-58", "ovs_interfaceid": "592d1e12-5844-4034-bd24-c5882b4be109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:35:21 user nova-compute[73010]: DEBUG nova.compute.manager [req-03034908-58bb-4cc1-8fca-5ece4713032f req-5075bbf1-8119-4992-98e7-fe18197857d1 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Detach interface failed, port_id=c0a7a8fb-96d7-4d75-9c81-bebe9861874d, reason: Instance 17237e56-67eb-4a05-b004-d27dacc8e04b could not be found. {{(pid=73010) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 00:35:21 user nova-compute[73010]: DEBUG nova.compute.manager [req-03034908-58bb-4cc1-8fca-5ece4713032f req-5075bbf1-8119-4992-98e7-fe18197857d1 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-deleted-592d1e12-5844-4034-bd24-c5882b4be109 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:21 user nova-compute[73010]: INFO nova.compute.manager [req-03034908-58bb-4cc1-8fca-5ece4713032f req-5075bbf1-8119-4992-98e7-fe18197857d1 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Neutron deleted interface 592d1e12-5844-4034-bd24-c5882b4be109; detaching it from the instance and deleting it from the info cache
Aug 15 00:35:21 user nova-compute[73010]: DEBUG nova.network.neutron [req-03034908-58bb-4cc1-8fca-5ece4713032f req-5075bbf1-8119-4992-98e7-fe18197857d1 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Updating instance_info_cache with network_info: [{"id": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "address": "fa:16:3e:b2:cf:d1", "network": {"id": "fb9d1b69-d351-4867-b15a-09c90bf7c5e4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934474624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe2f2c5-f6", "ovs_interfaceid": "4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21837e06-6627-4156-8b30-7b1499f01b5d", "address": "fa:16:3e:0a:9f:40", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21837e06-66", "ovs_interfaceid": "21837e06-6627-4156-8b30-7b1499f01b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e45de596-2e5e-4306-a083-181d25a33abd", "address": "fa:16:3e:cb:9c:b6", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45de596-2e", "ovs_interfaceid": "e45de596-2e5e-4306-a083-181d25a33abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "address": "fa:16:3e:20:58:5d", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcef2b29-87", "ovs_interfaceid": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:35:21 user nova-compute[73010]: DEBUG nova.compute.manager [req-03034908-58bb-4cc1-8fca-5ece4713032f req-5075bbf1-8119-4992-98e7-fe18197857d1 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Detach interface failed, port_id=592d1e12-5844-4034-bd24-c5882b4be109, reason: Instance 17237e56-67eb-4a05-b004-d27dacc8e04b could not be found. {{(pid=73010) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 00:35:22 user nova-compute[73010]: DEBUG nova.compute.manager [req-66c7d90b-5a16-4ef7-87d0-cdfc6f359f7f req-2b372ee4-cc98-4eb2-858b-52f50f3cacca service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-plugged-df67aaef-5bdd-4a5a-816b-c34392983877 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-66c7d90b-5a16-4ef7-87d0-cdfc6f359f7f req-2b372ee4-cc98-4eb2-858b-52f50f3cacca service nova] Acquiring lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-66c7d90b-5a16-4ef7-87d0-cdfc6f359f7f req-2b372ee4-cc98-4eb2-858b-52f50f3cacca service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-66c7d90b-5a16-4ef7-87d0-cdfc6f359f7f req-2b372ee4-cc98-4eb2-858b-52f50f3cacca service nova] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:22 user nova-compute[73010]: DEBUG nova.compute.manager [req-66c7d90b-5a16-4ef7-87d0-cdfc6f359f7f req-2b372ee4-cc98-4eb2-858b-52f50f3cacca service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] No waiting events found dispatching network-vif-plugged-df67aaef-5bdd-4a5a-816b-c34392983877 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:22 user nova-compute[73010]: WARNING nova.compute.manager [req-66c7d90b-5a16-4ef7-87d0-cdfc6f359f7f req-2b372ee4-cc98-4eb2-858b-52f50f3cacca service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received unexpected event network-vif-plugged-df67aaef-5bdd-4a5a-816b-c34392983877 for instance with vm_state active and task_state deleting.
Aug 15 00:35:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquiring lock "4ba39c23-9f14-4eda-94f7-a07e82c92ec0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "4ba39c23-9f14-4eda-94f7-a07e82c92ec0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:23 user nova-compute[73010]: DEBUG nova.compute.manager [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:35:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:35:23 user nova-compute[73010]: INFO nova.compute.claims [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Claim successful on node user
Aug 15 00:35:23 user nova-compute[73010]: DEBUG nova.compute.manager [req-0b2cf4f3-f9bf-4d37-8c36-7f3931573ab7 req-8f6126e4-e82f-4236-abe6-43f9bc285ccf service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-deleted-4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:23 user nova-compute[73010]: INFO nova.compute.manager [req-0b2cf4f3-f9bf-4d37-8c36-7f3931573ab7 req-8f6126e4-e82f-4236-abe6-43f9bc285ccf service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Neutron deleted interface 4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589; detaching it from the instance and deleting it from the info cache
Aug 15 00:35:23 user nova-compute[73010]: DEBUG nova.network.neutron [req-0b2cf4f3-f9bf-4d37-8c36-7f3931573ab7 req-8f6126e4-e82f-4236-abe6-43f9bc285ccf service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Updating instance_info_cache with network_info: [{"id": "21837e06-6627-4156-8b30-7b1499f01b5d", "address": "fa:16:3e:0a:9f:40", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21837e06-66", "ovs_interfaceid": "21837e06-6627-4156-8b30-7b1499f01b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e45de596-2e5e-4306-a083-181d25a33abd", "address": "fa:16:3e:cb:9c:b6", "network": {"id": "d0e46dc7-2079-4743-acef-693584926ff5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1633415856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45de596-2e", "ovs_interfaceid": "e45de596-2e5e-4306-a083-181d25a33abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "address": "fa:16:3e:20:58:5d", "network": {"id": "4548537a-5eaf-4db4-8e88-179973e7b956", "bridge": "br-int", "label": "tempest-device-tagging-net2-1187300004", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40820fcd77f4dbc8532e4090dd2ca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcef2b29-87", "ovs_interfaceid": "bcef2b29-872a-4cb1-9d3d-80fc04ee8254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:35:23 user nova-compute[73010]: DEBUG nova.compute.manager [req-0b2cf4f3-f9bf-4d37-8c36-7f3931573ab7 req-8f6126e4-e82f-4236-abe6-43f9bc285ccf service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Detach interface failed, port_id=4fe2f2c5-f6ce-4c5c-b1d3-5d7934d48589, reason: Instance 17237e56-67eb-4a05-b004-d27dacc8e04b could not be found. {{(pid=73010) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 00:35:24 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:35:24 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:35:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:35:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:35:24 user nova-compute[73010]: DEBUG nova.network.neutron [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:35:24 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:35:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:35:24 user nova-compute[73010]: DEBUG nova.policy [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8948cbf02ab4061a56a10037186f60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a620c803f76045d6a5b5b78ec1894c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:35:24 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:35:24 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Took 7.55 seconds to deallocate network for instance.
Aug 15 00:35:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:35:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:35:24 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Creating image(s)
Aug 15 00:35:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ba39c23-9f14-4eda-94f7-a07e82c92ec0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "/opt/stack/data/nova/instances/4ba39c23-9f14-4eda-94f7-a07e82c92ec0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "/opt/stack/data/nova/instances/4ba39c23-9f14-4eda-94f7-a07e82c92ec0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.183s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.181s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/4ba39c23-9f14-4eda-94f7-a07e82c92ec0/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/4ba39c23-9f14-4eda-94f7-a07e82c92ec0/disk 1073741824" returned: 0 in 0.050s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:25 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ba39c23-9f14-4eda-94f7-a07e82c92ec0/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:35:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ba39c23-9f14-4eda-94f7-a07e82c92ec0/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:25 user nova-compute[73010]: DEBUG nova.network.neutron [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Successfully created port: f683f262-ea3e-4086-9f68-27f9528a6f77 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:35:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ba39c23-9f14-4eda-94f7-a07e82c92ec0/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:25 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Cannot resize image /opt/stack/data/nova/instances/4ba39c23-9f14-4eda-94f7-a07e82c92ec0/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:35:25 user nova-compute[73010]: DEBUG nova.objects.instance [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lazy-loading 'migration_context' on Instance uuid 4ba39c23-9f14-4eda-94f7-a07e82c92ec0 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:35:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:35:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Ensure instance console log exists: /opt/stack/data/nova/instances/4ba39c23-9f14-4eda-94f7-a07e82c92ec0/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:35:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-6025139a-e329-44a0-be17-08f351b6b5c4 req-128b7996-c5e5-4f94-a96e-bcc513491063 service nova] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Received event network-vif-deleted-bcef2b29-872a-4cb1-9d3d-80fc04ee8254 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-6025139a-e329-44a0-be17-08f351b6b5c4 req-128b7996-c5e5-4f94-a96e-bcc513491063 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-deleted-fd5ce0a2-ca8e-422d-b36a-64006d1e8217 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:25 user nova-compute[73010]: INFO nova.compute.manager [req-6025139a-e329-44a0-be17-08f351b6b5c4 req-128b7996-c5e5-4f94-a96e-bcc513491063 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Neutron deleted interface fd5ce0a2-ca8e-422d-b36a-64006d1e8217; detaching it from the instance and deleting it from the info cache
Aug 15 00:35:25 user nova-compute[73010]: DEBUG nova.network.neutron [req-6025139a-e329-44a0-be17-08f351b6b5c4 req-128b7996-c5e5-4f94-a96e-bcc513491063 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Updating instance_info_cache with network_info: [{"id": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "address": "fa:16:3e:c8:c9:ad", "network": {"id": "7cec561d-d6de-48e3-ab40-d9bff06a031e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1980904641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96202dd8-f6", "ovs_interfaceid": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "address": "fa:16:3e:ee:92:2f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7932f3-05", "ovs_interfaceid": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "address": "fa:16:3e:b7:0b:5e", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba8ecd1-f3", "ovs_interfaceid": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "address": "fa:16:3e:f8:e5:9f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34cb5-4d", "ovs_interfaceid": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc702c0a-c79d-48b8-8cc0-7bb18931b11d", "address": "fa:16:3e:69:12:14", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc702c0a-c7", "ovs_interfaceid": "dc702c0a-c79d-48b8-8cc0-7bb18931b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df67aaef-5bdd-4a5a-816b-c34392983877", "address": "fa:16:3e:cb:39:d3", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf67aaef-5b", "ovs_interfaceid": "df67aaef-5bdd-4a5a-816b-c34392983877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:35:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-6025139a-e329-44a0-be17-08f351b6b5c4 req-128b7996-c5e5-4f94-a96e-bcc513491063 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Detach interface failed, port_id=fd5ce0a2-ca8e-422d-b36a-64006d1e8217, reason: Instance 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3 could not be found. {{(pid=73010) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 00:35:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-6025139a-e329-44a0-be17-08f351b6b5c4 req-128b7996-c5e5-4f94-a96e-bcc513491063 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-deleted-dc702c0a-c79d-48b8-8cc0-7bb18931b11d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:25 user nova-compute[73010]: INFO nova.compute.manager [req-6025139a-e329-44a0-be17-08f351b6b5c4 req-128b7996-c5e5-4f94-a96e-bcc513491063 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Neutron deleted interface dc702c0a-c79d-48b8-8cc0-7bb18931b11d; detaching it from the instance and deleting it from the info cache
Aug 15 00:35:25 user nova-compute[73010]: DEBUG nova.network.neutron [req-6025139a-e329-44a0-be17-08f351b6b5c4 req-128b7996-c5e5-4f94-a96e-bcc513491063 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Updating instance_info_cache with network_info: [{"id": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "address": "fa:16:3e:c8:c9:ad", "network": {"id": "7cec561d-d6de-48e3-ab40-d9bff06a031e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1980904641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96202dd8-f6", "ovs_interfaceid": "96202dd8-f6e5-436d-b8e7-1db0469cf513", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "address": "fa:16:3e:ee:92:2f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7932f3-05", "ovs_interfaceid": "fb7932f3-05b0-4f25-b8f2-38cd50b29fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "address": "fa:16:3e:b7:0b:5e", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba8ecd1-f3", "ovs_interfaceid": "1ba8ecd1-f3a8-460d-9f61-b15d9319d83f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "address": "fa:16:3e:f8:e5:9f", "network": {"id": "72833973-969d-43e2-a74b-445e89f60921", "bridge": "br-int", "label": "tempest-device-tagging-net1-570437052", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34cb5-4d", "ovs_interfaceid": "03a34cb5-4d57-4c59-ba58-b162bf49daa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df67aaef-5bdd-4a5a-816b-c34392983877", "address": "fa:16:3e:cb:39:d3", "network": {"id": "10ff1ca5-f22f-4571-bf99-edcc3ed43828", "bridge": "br-int", "label": "tempest-device-tagging-net2-494121965", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "097516b3ada04de28f172aa5c3ff679f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf67aaef-5b", "ovs_interfaceid": "df67aaef-5bdd-4a5a-816b-c34392983877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:35:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-6025139a-e329-44a0-be17-08f351b6b5c4 req-128b7996-c5e5-4f94-a96e-bcc513491063 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Detach interface failed, port_id=dc702c0a-c79d-48b8-8cc0-7bb18931b11d, reason: Instance 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3 could not be found. {{(pid=73010) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 00:35:26 user nova-compute[73010]: DEBUG nova.network.neutron [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Successfully updated port: f683f262-ea3e-4086-9f68-27f9528a6f77 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:35:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquiring lock "refresh_cache-4ba39c23-9f14-4eda-94f7-a07e82c92ec0" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:35:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquired lock "refresh_cache-4ba39c23-9f14-4eda-94f7-a07e82c92ec0" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:35:26 user nova-compute[73010]: DEBUG nova.network.neutron [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:35:26 user nova-compute[73010]: DEBUG nova.compute.manager [req-4c45b1eb-91c7-439c-9685-03319169104f req-dd75b16b-4f99-48f0-b0c9-0f5c2ae8c89c service nova] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Received event network-changed-f683f262-ea3e-4086-9f68-27f9528a6f77 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:26 user nova-compute[73010]: DEBUG nova.compute.manager [req-4c45b1eb-91c7-439c-9685-03319169104f req-dd75b16b-4f99-48f0-b0c9-0f5c2ae8c89c service nova] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Refreshing instance network info cache due to event network-changed-f683f262-ea3e-4086-9f68-27f9528a6f77. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:35:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4c45b1eb-91c7-439c-9685-03319169104f req-dd75b16b-4f99-48f0-b0c9-0f5c2ae8c89c service nova] Acquiring lock "refresh_cache-4ba39c23-9f14-4eda-94f7-a07e82c92ec0" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:35:26 user nova-compute[73010]: DEBUG nova.network.neutron [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:35:26 user nova-compute[73010]: INFO nova.compute.manager [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Took 2.38 seconds to detach 3 volumes for instance.
Aug 15 00:35:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:35:27 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Took 6.14 seconds to deallocate network for instance.
Aug 15 00:35:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.network.neutron [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Updating instance_info_cache with network_info: [{"id": "f683f262-ea3e-4086-9f68-27f9528a6f77", "address": "fa:16:3e:68:85:e1", "network": {"id": "9aa91991-9d4c-4b0d-a955-652df703cde1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-393715584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a620c803f76045d6a5b5b78ec1894c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf683f262-ea", "ovs_interfaceid": "f683f262-ea3e-4086-9f68-27f9528a6f77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Releasing lock "refresh_cache-4ba39c23-9f14-4eda-94f7-a07e82c92ec0" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Instance network_info: |[{"id": "f683f262-ea3e-4086-9f68-27f9528a6f77", "address": "fa:16:3e:68:85:e1", "network": {"id": "9aa91991-9d4c-4b0d-a955-652df703cde1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-393715584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a620c803f76045d6a5b5b78ec1894c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf683f262-ea", "ovs_interfaceid": "f683f262-ea3e-4086-9f68-27f9528a6f77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4c45b1eb-91c7-439c-9685-03319169104f req-dd75b16b-4f99-48f0-b0c9-0f5c2ae8c89c service nova] Acquired lock "refresh_cache-4ba39c23-9f14-4eda-94f7-a07e82c92ec0" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.network.neutron [req-4c45b1eb-91c7-439c-9685-03319169104f req-dd75b16b-4f99-48f0-b0c9-0f5c2ae8c89c service nova] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Refreshing network info cache for port f683f262-ea3e-4086-9f68-27f9528a6f77 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Start _get_guest_xml network_info=[{"id": "f683f262-ea3e-4086-9f68-27f9528a6f77", "address": "fa:16:3e:68:85:e1", "network": {"id": "9aa91991-9d4c-4b0d-a955-652df703cde1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-393715584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a620c803f76045d6a5b5b78ec1894c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf683f262-ea", "ovs_interfaceid": "f683f262-ea3e-4086-9f68-27f9528a6f77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:35:27 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Deleted allocations for instance 17237e56-67eb-4a05-b004-d27dacc8e04b
Aug 15 00:35:27 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:35:27 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:35:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-298787467',display_name='tempest-VolumesAdminNegativeTest-server-298787467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-298787467',id=13,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a620c803f76045d6a5b5b78ec1894c5f',ramdisk_id='',reservation_id='r-520bnh7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-507850758',owner_user_name='tempest-VolumesAdminNegativeTest-507850758-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:35:24Z,user_data=None,user_id='f8948cbf02ab4061a56a10037186f60e',uuid=4ba39c23-9f14-4eda-94f7-a07e82c92ec0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f683f262-ea3e-4086-9f68-27f9528a6f77", "address": "fa:16:3e:68:85:e1", "network": {"id": "9aa91991-9d4c-4b0d-a955-652df703cde1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-393715584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a620c803f76045d6a5b5b78ec1894c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf683f262-ea", "ovs_interfaceid": "f683f262-ea3e-4086-9f68-27f9528a6f77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Converting VIF {"id": "f683f262-ea3e-4086-9f68-27f9528a6f77", "address": "fa:16:3e:68:85:e1", "network": {"id": "9aa91991-9d4c-4b0d-a955-652df703cde1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-393715584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a620c803f76045d6a5b5b78ec1894c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf683f262-ea", "ovs_interfaceid": "f683f262-ea3e-4086-9f68-27f9528a6f77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:85:e1,bridge_name='br-int',has_traffic_filtering=True,id=f683f262-ea3e-4086-9f68-27f9528a6f77,network=Network(9aa91991-9d4c-4b0d-a955-652df703cde1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf683f262-ea') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.objects.instance [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ba39c23-9f14-4eda-94f7-a07e82c92ec0 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:35:27 user nova-compute[73010]:   <uuid>4ba39c23-9f14-4eda-94f7-a07e82c92ec0</uuid>
Aug 15 00:35:27 user nova-compute[73010]:   <name>instance-0000000d</name>
Aug 15 00:35:27 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:35:27 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:35:27 user nova-compute[73010]:   <metadata>
Aug 15 00:35:27 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:35:27 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:35:27 user nova-compute[73010]:       <nova:name>tempest-VolumesAdminNegativeTest-server-298787467</nova:name>
Aug 15 00:35:27 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:35:27</nova:creationTime>
Aug 15 00:35:27 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:35:27 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:35:27 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:35:27 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:35:27 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:35:27 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:35:27 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:35:27 user nova-compute[73010]:       <nova:owner>
Aug 15 00:35:27 user nova-compute[73010]:         <nova:user uuid="f8948cbf02ab4061a56a10037186f60e">tempest-VolumesAdminNegativeTest-507850758-project-member</nova:user>
Aug 15 00:35:27 user nova-compute[73010]:         <nova:project uuid="a620c803f76045d6a5b5b78ec1894c5f">tempest-VolumesAdminNegativeTest-507850758</nova:project>
Aug 15 00:35:27 user nova-compute[73010]:       </nova:owner>
Aug 15 00:35:27 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:35:27 user nova-compute[73010]:       <nova:ports>
Aug 15 00:35:27 user nova-compute[73010]:         <nova:port uuid="f683f262-ea3e-4086-9f68-27f9528a6f77">
Aug 15 00:35:27 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 00:35:27 user nova-compute[73010]:         </nova:port>
Aug 15 00:35:27 user nova-compute[73010]:       </nova:ports>
Aug 15 00:35:27 user nova-compute[73010]:     </nova:instance>
Aug 15 00:35:27 user nova-compute[73010]:   </metadata>
Aug 15 00:35:27 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:35:27 user nova-compute[73010]:     <system>
Aug 15 00:35:27 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:35:27 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:35:27 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:35:27 user nova-compute[73010]:       <entry name="serial">4ba39c23-9f14-4eda-94f7-a07e82c92ec0</entry>
Aug 15 00:35:27 user nova-compute[73010]:       <entry name="uuid">4ba39c23-9f14-4eda-94f7-a07e82c92ec0</entry>
Aug 15 00:35:27 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:35:27 user nova-compute[73010]:     </system>
Aug 15 00:35:27 user nova-compute[73010]:   </sysinfo>
Aug 15 00:35:27 user nova-compute[73010]:   <os>
Aug 15 00:35:27 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:35:27 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:35:27 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:35:27 user nova-compute[73010]:   </os>
Aug 15 00:35:27 user nova-compute[73010]:   <features>
Aug 15 00:35:27 user nova-compute[73010]:     <acpi/>
Aug 15 00:35:27 user nova-compute[73010]:     <apic/>
Aug 15 00:35:27 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:35:27 user nova-compute[73010]:   </features>
Aug 15 00:35:27 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:35:27 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:35:27 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:35:27 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:35:27 user nova-compute[73010]:   </clock>
Aug 15 00:35:27 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:35:27 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:35:27 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:35:27 user nova-compute[73010]:   </cpu>
Aug 15 00:35:27 user nova-compute[73010]:   <devices>
Aug 15 00:35:27 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:35:27 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:35:27 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/4ba39c23-9f14-4eda-94f7-a07e82c92ec0/disk"/>
Aug 15 00:35:27 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:35:27 user nova-compute[73010]:     </disk>
Aug 15 00:35:27 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:35:27 user nova-compute[73010]:       <mac address="fa:16:3e:68:85:e1"/>
Aug 15 00:35:27 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:35:27 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:35:27 user nova-compute[73010]:       <target dev="tapf683f262-ea"/>
Aug 15 00:35:27 user nova-compute[73010]:     </interface>
Aug 15 00:35:27 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:35:27 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/4ba39c23-9f14-4eda-94f7-a07e82c92ec0/console.log" append="off"/>
Aug 15 00:35:27 user nova-compute[73010]:     </serial>
Aug 15 00:35:27 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:35:27 user nova-compute[73010]:     <video>
Aug 15 00:35:27 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:35:27 user nova-compute[73010]:     </video>
Aug 15 00:35:27 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:35:27 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:35:27 user nova-compute[73010]:     </rng>
Aug 15 00:35:27 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:35:27 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:35:27 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:35:27 user nova-compute[73010]:     </memballoon>
Aug 15 00:35:27 user nova-compute[73010]:   </devices>
Aug 15 00:35:27 user nova-compute[73010]: </domain>
Aug 15 00:35:27 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:35:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-298787467',display_name='tempest-VolumesAdminNegativeTest-server-298787467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-298787467',id=13,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a620c803f76045d6a5b5b78ec1894c5f',ramdisk_id='',reservation_id='r-520bnh7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-507850758',owner_user_name='tempest-VolumesAdminNegativeTest-507850758-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:35:24Z,user_data=None,user_id='f8948cbf02ab4061a56a10037186f60e',uuid=4ba39c23-9f14-4eda-94f7-a07e82c92ec0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f683f262-ea3e-4086-9f68-27f9528a6f77", "address": "fa:16:3e:68:85:e1", "network": {"id": "9aa91991-9d4c-4b0d-a955-652df703cde1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-393715584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a620c803f76045d6a5b5b78ec1894c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf683f262-ea", "ovs_interfaceid": "f683f262-ea3e-4086-9f68-27f9528a6f77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Converting VIF {"id": "f683f262-ea3e-4086-9f68-27f9528a6f77", "address": "fa:16:3e:68:85:e1", "network": {"id": "9aa91991-9d4c-4b0d-a955-652df703cde1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-393715584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a620c803f76045d6a5b5b78ec1894c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf683f262-ea", "ovs_interfaceid": "f683f262-ea3e-4086-9f68-27f9528a6f77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:85:e1,bridge_name='br-int',has_traffic_filtering=True,id=f683f262-ea3e-4086-9f68-27f9528a6f77,network=Network(9aa91991-9d4c-4b0d-a955-652df703cde1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf683f262-ea') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG os_vif [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:85:e1,bridge_name='br-int',has_traffic_filtering=True,id=f683f262-ea3e-4086-9f68-27f9528a6f77,network=Network(9aa91991-9d4c-4b0d-a955-652df703cde1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf683f262-ea') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f77f58f2-f508-4434-9bfc-87b44538ceb5 tempest-TaggedBootDevicesTest_v242-488812863 tempest-TaggedBootDevicesTest_v242-488812863-project-member] Lock "17237e56-67eb-4a05-b004-d27dacc8e04b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.599s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf683f262-ea, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf683f262-ea, col_values=(('external_ids', {'iface-id': 'f683f262-ea3e-4086-9f68-27f9528a6f77', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:85:e1', 'vm-uuid': '4ba39c23-9f14-4eda-94f7-a07e82c92ec0'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:27 user nova-compute[73010]: INFO os_vif [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:85:e1,bridge_name='br-int',has_traffic_filtering=True,id=f683f262-ea3e-4086-9f68-27f9528a6f77,network=Network(9aa91991-9d4c-4b0d-a955-652df703cde1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf683f262-ea')
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] No VIF found with MAC fa:16:3e:68:85:e1, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.compute.manager [req-703e877c-3d62-49cd-9085-ae2177001ccd req-264a79b6-a0d4-4624-8034-f264babadf53 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-deleted-96202dd8-f6e5-436d-b8e7-1db0469cf513 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.compute.manager [req-703e877c-3d62-49cd-9085-ae2177001ccd req-264a79b6-a0d4-4624-8034-f264babadf53 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-deleted-03a34cb5-4d57-4c59-ba58-b162bf49daa3 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:27 user nova-compute[73010]: DEBUG nova.compute.manager [req-703e877c-3d62-49cd-9085-ae2177001ccd req-264a79b6-a0d4-4624-8034-f264babadf53 service nova] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Received event network-vif-deleted-df67aaef-5bdd-4a5a-816b-c34392983877 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:28 user nova-compute[73010]: DEBUG nova.network.neutron [req-4c45b1eb-91c7-439c-9685-03319169104f req-dd75b16b-4f99-48f0-b0c9-0f5c2ae8c89c service nova] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Updated VIF entry in instance network info cache for port f683f262-ea3e-4086-9f68-27f9528a6f77. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:35:28 user nova-compute[73010]: DEBUG nova.network.neutron [req-4c45b1eb-91c7-439c-9685-03319169104f req-dd75b16b-4f99-48f0-b0c9-0f5c2ae8c89c service nova] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Updating instance_info_cache with network_info: [{"id": "f683f262-ea3e-4086-9f68-27f9528a6f77", "address": "fa:16:3e:68:85:e1", "network": {"id": "9aa91991-9d4c-4b0d-a955-652df703cde1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-393715584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a620c803f76045d6a5b5b78ec1894c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf683f262-ea", "ovs_interfaceid": "f683f262-ea3e-4086-9f68-27f9528a6f77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:35:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4c45b1eb-91c7-439c-9685-03319169104f req-dd75b16b-4f99-48f0-b0c9-0f5c2ae8c89c service nova] Releasing lock "refresh_cache-4ba39c23-9f14-4eda-94f7-a07e82c92ec0" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:35:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-627894a9-b00f-4e95-91bb-b10f913b2460 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Acquiring lock "de9297d8-10e8-4244-b25d-54d4c2a83aea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-627894a9-b00f-4e95-91bb-b10f913b2460 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Lock "de9297d8-10e8-4244-b25d-54d4c2a83aea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-627894a9-b00f-4e95-91bb-b10f913b2460 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Acquiring lock "de9297d8-10e8-4244-b25d-54d4c2a83aea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-627894a9-b00f-4e95-91bb-b10f913b2460 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Lock "de9297d8-10e8-4244-b25d-54d4c2a83aea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-627894a9-b00f-4e95-91bb-b10f913b2460 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Lock "de9297d8-10e8-4244-b25d-54d4c2a83aea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:28 user nova-compute[73010]: INFO nova.compute.manager [None req-627894a9-b00f-4e95-91bb-b10f913b2460 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Terminating instance
Aug 15 00:35:28 user nova-compute[73010]: DEBUG nova.compute.manager [None req-627894a9-b00f-4e95-91bb-b10f913b2460 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:35:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:29 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Instance destroyed successfully.
Aug 15 00:35:29 user nova-compute[73010]: DEBUG nova.objects.instance [None req-627894a9-b00f-4e95-91bb-b10f913b2460 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Lazy-loading 'resources' on Instance uuid de9297d8-10e8-4244-b25d-54d4c2a83aea {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:35:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-627894a9-b00f-4e95-91bb-b10f913b2460 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-124624336',display_name='tempest-VolumesAssistedSnapshotsTest-server-124624336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-124624336',id=6,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVmO0tRNeT3IYqGeCuKj6dXSiUJi9p1VCoswpoYi054l+LWpaZFwX+iTUu5KByrJGv/LHSZAGE+4No6Ze1tijb1dxNg3MXTfWv74p7EeSyIYqphY0BQjv1YnumojodCUA==',key_name='tempest-keypair-1311122172',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:32:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d2ef5987cbe4bc0a98749cac9455b6b',ramdisk_id='',reservation_id='r-kuv2q1d7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-987061659',owner_user_name='tempest-VolumesAssistedSnapshotsTest-987061659-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:32:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a155f32fbbb496288e2fd58a8feb4b7',uuid=de9297d8-10e8-4244-b25d-54d4c2a83aea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8325311-2426-4587-b3be-94ebc97c7d9c", "address": "fa:16:3e:3c:07:e1", "network": {"id": "fe36cefd-7a91-4307-92a8-1200af86e04e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-185864758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d2ef5987cbe4bc0a98749cac9455b6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8325311-24", "ovs_interfaceid": "e8325311-2426-4587-b3be-94ebc97c7d9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:35:29 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-627894a9-b00f-4e95-91bb-b10f913b2460 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Converting VIF {"id": "e8325311-2426-4587-b3be-94ebc97c7d9c", "address": "fa:16:3e:3c:07:e1", "network": {"id": "fe36cefd-7a91-4307-92a8-1200af86e04e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-185864758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d2ef5987cbe4bc0a98749cac9455b6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8325311-24", "ovs_interfaceid": "e8325311-2426-4587-b3be-94ebc97c7d9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:35:29 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-627894a9-b00f-4e95-91bb-b10f913b2460 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:07:e1,bridge_name='br-int',has_traffic_filtering=True,id=e8325311-2426-4587-b3be-94ebc97c7d9c,network=Network(fe36cefd-7a91-4307-92a8-1200af86e04e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8325311-24') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:35:29 user nova-compute[73010]: DEBUG os_vif [None req-627894a9-b00f-4e95-91bb-b10f913b2460 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:07:e1,bridge_name='br-int',has_traffic_filtering=True,id=e8325311-2426-4587-b3be-94ebc97c7d9c,network=Network(fe36cefd-7a91-4307-92a8-1200af86e04e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8325311-24') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:35:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8325311-24, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:35:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:35:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:29 user nova-compute[73010]: INFO os_vif [None req-627894a9-b00f-4e95-91bb-b10f913b2460 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:07:e1,bridge_name='br-int',has_traffic_filtering=True,id=e8325311-2426-4587-b3be-94ebc97c7d9c,network=Network(fe36cefd-7a91-4307-92a8-1200af86e04e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8325311-24')
Aug 15 00:35:29 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-627894a9-b00f-4e95-91bb-b10f913b2460 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Deleting instance files /opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea_del
Aug 15 00:35:29 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-627894a9-b00f-4e95-91bb-b10f913b2460 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Deletion of /opt/stack/data/nova/instances/de9297d8-10e8-4244-b25d-54d4c2a83aea_del complete
Aug 15 00:35:29 user nova-compute[73010]: INFO nova.compute.manager [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Took 2.62 seconds to detach 3 volumes for instance.
Aug 15 00:35:29 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692059714.9179912, 17237e56-67eb-4a05-b004-d27dacc8e04b => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:35:29 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] VM Stopped (Lifecycle Event)
Aug 15 00:35:29 user nova-compute[73010]: DEBUG nova.compute.manager [None req-75b396ce-87fe-4882-94c0-df5002e9526f None None] [instance: 17237e56-67eb-4a05-b004-d27dacc8e04b] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:35:29 user nova-compute[73010]: DEBUG nova.compute.manager [req-5023763f-db9f-4289-ae65-a34e8ee540b1 req-f0fcf42d-725c-445c-b0f5-158c1c2dacbe service nova] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Received event network-vif-unplugged-e8325311-2426-4587-b3be-94ebc97c7d9c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5023763f-db9f-4289-ae65-a34e8ee540b1 req-f0fcf42d-725c-445c-b0f5-158c1c2dacbe service nova] Acquiring lock "de9297d8-10e8-4244-b25d-54d4c2a83aea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5023763f-db9f-4289-ae65-a34e8ee540b1 req-f0fcf42d-725c-445c-b0f5-158c1c2dacbe service nova] Lock "de9297d8-10e8-4244-b25d-54d4c2a83aea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5023763f-db9f-4289-ae65-a34e8ee540b1 req-f0fcf42d-725c-445c-b0f5-158c1c2dacbe service nova] Lock "de9297d8-10e8-4244-b25d-54d4c2a83aea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:29 user nova-compute[73010]: DEBUG nova.compute.manager [req-5023763f-db9f-4289-ae65-a34e8ee540b1 req-f0fcf42d-725c-445c-b0f5-158c1c2dacbe service nova] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] No waiting events found dispatching network-vif-unplugged-e8325311-2426-4587-b3be-94ebc97c7d9c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:29 user nova-compute[73010]: DEBUG nova.compute.manager [req-5023763f-db9f-4289-ae65-a34e8ee540b1 req-f0fcf42d-725c-445c-b0f5-158c1c2dacbe service nova] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Received event network-vif-unplugged-e8325311-2426-4587-b3be-94ebc97c7d9c for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:35:29 user nova-compute[73010]: INFO nova.compute.manager [None req-627894a9-b00f-4e95-91bb-b10f913b2460 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 15 00:35:29 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-627894a9-b00f-4e95-91bb-b10f913b2460 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:35:29 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:35:29 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:35:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:30 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:35:30 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:35:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:30 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Deleted allocations for instance 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3
Aug 15 00:35:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b2438010-869b-4e1c-922d-9fb104c943db tempest-TaggedBootDevicesTest-1736972663 tempest-TaggedBootDevicesTest-1736972663-project-member] Lock "4c37ecd1-7a9b-4c77-8a52-c81f56321ca3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.746s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-c6154f45-750f-4313-93f2-f9f1edc5b6bd req-ccb1f2d7-79b7-4477-9cbf-407c8c6edcce service nova] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Received event network-vif-plugged-f683f262-ea3e-4086-9f68-27f9528a6f77 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c6154f45-750f-4313-93f2-f9f1edc5b6bd req-ccb1f2d7-79b7-4477-9cbf-407c8c6edcce service nova] Acquiring lock "4ba39c23-9f14-4eda-94f7-a07e82c92ec0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c6154f45-750f-4313-93f2-f9f1edc5b6bd req-ccb1f2d7-79b7-4477-9cbf-407c8c6edcce service nova] Lock "4ba39c23-9f14-4eda-94f7-a07e82c92ec0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c6154f45-750f-4313-93f2-f9f1edc5b6bd req-ccb1f2d7-79b7-4477-9cbf-407c8c6edcce service nova] Lock "4ba39c23-9f14-4eda-94f7-a07e82c92ec0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-c6154f45-750f-4313-93f2-f9f1edc5b6bd req-ccb1f2d7-79b7-4477-9cbf-407c8c6edcce service nova] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] No waiting events found dispatching network-vif-plugged-f683f262-ea3e-4086-9f68-27f9528a6f77 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:30 user nova-compute[73010]: WARNING nova.compute.manager [req-c6154f45-750f-4313-93f2-f9f1edc5b6bd req-ccb1f2d7-79b7-4477-9cbf-407c8c6edcce service nova] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Received unexpected event network-vif-plugged-f683f262-ea3e-4086-9f68-27f9528a6f77 for instance with vm_state building and task_state spawning.
Aug 15 00:35:31 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:35:31 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Took 1.20 seconds to deallocate network for instance.
Aug 15 00:35:31 user nova-compute[73010]: DEBUG nova.compute.manager [req-b0d2afc6-cee8-4252-9d86-34c2e66156f2 req-d56c2296-d595-4520-8262-48e4b56db794 service nova] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Received event network-vif-deleted-e8325311-2426-4587-b3be-94ebc97c7d9c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-627894a9-b00f-4e95-91bb-b10f913b2460 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-627894a9-b00f-4e95-91bb-b10f913b2460 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:31 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-627894a9-b00f-4e95-91bb-b10f913b2460 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:35:31 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-627894a9-b00f-4e95-91bb-b10f913b2460 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:35:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-627894a9-b00f-4e95-91bb-b10f913b2460 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:31 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-627894a9-b00f-4e95-91bb-b10f913b2460 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Deleted allocations for instance de9297d8-10e8-4244-b25d-54d4c2a83aea
Aug 15 00:35:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-627894a9-b00f-4e95-91bb-b10f913b2460 tempest-VolumesAssistedSnapshotsTest-987061659 tempest-VolumesAssistedSnapshotsTest-987061659-project-member] Lock "de9297d8-10e8-4244-b25d-54d4c2a83aea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.820s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:31 user nova-compute[73010]: DEBUG nova.compute.manager [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:35:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:35:31 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059731.7434256, 4ba39c23-9f14-4eda-94f7-a07e82c92ec0 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:35:31 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] VM Resumed (Lifecycle Event)
Aug 15 00:35:31 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Instance spawned successfully.
Aug 15 00:35:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:35:31 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:35:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:35:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:35:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:35:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:35:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:35:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:35:31 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:35:31 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:35:31 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059731.744295, 4ba39c23-9f14-4eda-94f7-a07e82c92ec0 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:35:31 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] VM Started (Lifecycle Event)
Aug 15 00:35:31 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:35:31 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:35:31 user nova-compute[73010]: INFO nova.compute.manager [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Took 7.38 seconds to spawn the instance on the hypervisor.
Aug 15 00:35:31 user nova-compute[73010]: DEBUG nova.compute.manager [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:35:31 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:35:31 user nova-compute[73010]: INFO nova.compute.manager [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Took 8.36 seconds to build instance.
Aug 15 00:35:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-134f4b07-d6ac-4ebb-b800-cae345e273b4 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "4ba39c23-9f14-4eda-94f7-a07e82c92ec0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.459s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG nova.compute.manager [req-31281296-70dc-4239-8dcc-e53a9f4a6d20 req-b62b8689-c64e-47e6-9b9e-518bb8aaa86c service nova] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Received event network-vif-plugged-e8325311-2426-4587-b3be-94ebc97c7d9c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-31281296-70dc-4239-8dcc-e53a9f4a6d20 req-b62b8689-c64e-47e6-9b9e-518bb8aaa86c service nova] Acquiring lock "de9297d8-10e8-4244-b25d-54d4c2a83aea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-31281296-70dc-4239-8dcc-e53a9f4a6d20 req-b62b8689-c64e-47e6-9b9e-518bb8aaa86c service nova] Lock "de9297d8-10e8-4244-b25d-54d4c2a83aea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-31281296-70dc-4239-8dcc-e53a9f4a6d20 req-b62b8689-c64e-47e6-9b9e-518bb8aaa86c service nova] Lock "de9297d8-10e8-4244-b25d-54d4c2a83aea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG nova.compute.manager [req-31281296-70dc-4239-8dcc-e53a9f4a6d20 req-b62b8689-c64e-47e6-9b9e-518bb8aaa86c service nova] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] No waiting events found dispatching network-vif-plugged-e8325311-2426-4587-b3be-94ebc97c7d9c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:32 user nova-compute[73010]: WARNING nova.compute.manager [req-31281296-70dc-4239-8dcc-e53a9f4a6d20 req-b62b8689-c64e-47e6-9b9e-518bb8aaa86c service nova] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Received unexpected event network-vif-plugged-e8325311-2426-4587-b3be-94ebc97c7d9c for instance with vm_state deleted and task_state None.
Aug 15 00:35:32 user nova-compute[73010]: DEBUG nova.compute.manager [req-31281296-70dc-4239-8dcc-e53a9f4a6d20 req-b62b8689-c64e-47e6-9b9e-518bb8aaa86c service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Received event network-changed-1ba74d11-2708-46c3-b73c-def3200202e4 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG nova.compute.manager [req-31281296-70dc-4239-8dcc-e53a9f4a6d20 req-b62b8689-c64e-47e6-9b9e-518bb8aaa86c service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Refreshing instance network info cache due to event network-changed-1ba74d11-2708-46c3-b73c-def3200202e4. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-31281296-70dc-4239-8dcc-e53a9f4a6d20 req-b62b8689-c64e-47e6-9b9e-518bb8aaa86c service nova] Acquiring lock "refresh_cache-e2410ee7-7351-460a-8d9c-47fe54e08c8b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-31281296-70dc-4239-8dcc-e53a9f4a6d20 req-b62b8689-c64e-47e6-9b9e-518bb8aaa86c service nova] Acquired lock "refresh_cache-e2410ee7-7351-460a-8d9c-47fe54e08c8b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG nova.network.neutron [req-31281296-70dc-4239-8dcc-e53a9f4a6d20 req-b62b8689-c64e-47e6-9b9e-518bb8aaa86c service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Refreshing network info cache for port 1ba74d11-2708-46c3-b73c-def3200202e4 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG nova.objects.instance [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lazy-loading 'flavor' on Instance uuid e2410ee7-7351-460a-8d9c-47fe54e08c8b {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:32 user nova-compute[73010]: INFO nova.compute.manager [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Attaching volume 15d7a4f5-c6a5-4347-a86e-1b1381ce5177 to /dev/vdb
Aug 15 00:35:32 user nova-compute[73010]: DEBUG os_brick.utils [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a7a402-47ba-40a0-a5da-95e513dbed53]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dc8ae1-4e99-48f5-a2f3-97beaa385e7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[553bee50-280d-42cc-ae79-72d17dccc8c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3e96dd-9c25-4dc0-bc34-3804f275d377]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:35:32 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:35:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4612846f-0f28-4c79-a67f-745e54f44ad0]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG os_brick.utils [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:35:32 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Updating existing volume attachment record: 18ac418b-9053-4a37-b5e8-b834498bae06 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:35:33 user nova-compute[73010]: DEBUG nova.network.neutron [req-31281296-70dc-4239-8dcc-e53a9f4a6d20 req-b62b8689-c64e-47e6-9b9e-518bb8aaa86c service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Updated VIF entry in instance network info cache for port 1ba74d11-2708-46c3-b73c-def3200202e4. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:35:33 user nova-compute[73010]: DEBUG nova.network.neutron [req-31281296-70dc-4239-8dcc-e53a9f4a6d20 req-b62b8689-c64e-47e6-9b9e-518bb8aaa86c service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Updating instance_info_cache with network_info: [{"id": "1ba74d11-2708-46c3-b73c-def3200202e4", "address": "fa:16:3e:c5:b2:68", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba74d11-27", "ovs_interfaceid": "1ba74d11-2708-46c3-b73c-def3200202e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:35:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:33 user nova-compute[73010]: DEBUG nova.compute.manager [req-21dd0257-d142-4658-9ec9-a3461fefc336 req-c82183ec-89b0-4fae-bf52-60faa0544769 service nova] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Received event network-vif-plugged-f683f262-ea3e-4086-9f68-27f9528a6f77 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-21dd0257-d142-4658-9ec9-a3461fefc336 req-c82183ec-89b0-4fae-bf52-60faa0544769 service nova] Acquiring lock "4ba39c23-9f14-4eda-94f7-a07e82c92ec0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-21dd0257-d142-4658-9ec9-a3461fefc336 req-c82183ec-89b0-4fae-bf52-60faa0544769 service nova] Lock "4ba39c23-9f14-4eda-94f7-a07e82c92ec0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-21dd0257-d142-4658-9ec9-a3461fefc336 req-c82183ec-89b0-4fae-bf52-60faa0544769 service nova] Lock "4ba39c23-9f14-4eda-94f7-a07e82c92ec0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:33 user nova-compute[73010]: DEBUG nova.compute.manager [req-21dd0257-d142-4658-9ec9-a3461fefc336 req-c82183ec-89b0-4fae-bf52-60faa0544769 service nova] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] No waiting events found dispatching network-vif-plugged-f683f262-ea3e-4086-9f68-27f9528a6f77 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:33 user nova-compute[73010]: WARNING nova.compute.manager [req-21dd0257-d142-4658-9ec9-a3461fefc336 req-c82183ec-89b0-4fae-bf52-60faa0544769 service nova] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Received unexpected event network-vif-plugged-f683f262-ea3e-4086-9f68-27f9528a6f77 for instance with vm_state active and task_state None.
Aug 15 00:35:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-31281296-70dc-4239-8dcc-e53a9f4a6d20 req-b62b8689-c64e-47e6-9b9e-518bb8aaa86c service nova] Releasing lock "refresh_cache-e2410ee7-7351-460a-8d9c-47fe54e08c8b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:35:34 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692059719.6938848, 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:35:34 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] VM Stopped (Lifecycle Event)
Aug 15 00:35:34 user nova-compute[73010]: DEBUG nova.compute.manager [None req-fb61a469-d8c5-4551-b0f6-e34505acf74e None None] [instance: 4c37ecd1-7a9b-4c77-8a52-c81f56321ca3] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:35:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-3faf3347-3c20-496a-8248-d18c4df1306b req-b96b1d82-2873-456a-9394-b52553428324 service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Received event network-changed-0c7bfe51-bb5e-4147-8013-a2f175ac4e26 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-3faf3347-3c20-496a-8248-d18c4df1306b req-b96b1d82-2873-456a-9394-b52553428324 service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Refreshing instance network info cache due to event network-changed-0c7bfe51-bb5e-4147-8013-a2f175ac4e26. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:35:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3faf3347-3c20-496a-8248-d18c4df1306b req-b96b1d82-2873-456a-9394-b52553428324 service nova] Acquiring lock "refresh_cache-da32613e-b1a9-4733-831f-e4fb1f34995f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:35:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3faf3347-3c20-496a-8248-d18c4df1306b req-b96b1d82-2873-456a-9394-b52553428324 service nova] Acquired lock "refresh_cache-da32613e-b1a9-4733-831f-e4fb1f34995f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:35:41 user nova-compute[73010]: DEBUG nova.network.neutron [req-3faf3347-3c20-496a-8248-d18c4df1306b req-b96b1d82-2873-456a-9394-b52553428324 service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Refreshing network info cache for port 0c7bfe51-bb5e-4147-8013-a2f175ac4e26 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Acquiring lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'baseCjSD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:35:42 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:35:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:35:42 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:35:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:35:42 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2be7b51-a9ce-4988-98c3-cf7d906a6d22]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:35:42 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:35:42 user nova-compute[73010]: INFO nova.compute.claims [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Claim successful on node user
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59ef423-2463-4c10-8eb2-4267102d7724]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177] added
Aug 15 00:35:42 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9387e549-1358-40c7-bf29-ca579c574abb]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d78f5d-cd8c-4c7e-bc0f-729d07156bef]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v baseCjSD {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v baseCjSD" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19d7a77-53a5-4319-8fc4-0a4a9e1297a6]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'baseCjSD'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff8e080-def6-4c19-9a06-51d4c3f9fcfb]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dced46f-5d36-4143-8841-1c568a5806fe]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:42 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:42 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e27c341-5858-4283-a5a2-4656f9b9e30b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177, portal: 172.16.0.220,3260]
Aug 15 00:35:42 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177, portal: 172.16.0.220,3260] successful.
Aug 15 00:35:42 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG nova.network.neutron [req-3faf3347-3c20-496a-8248-d18c4df1306b req-b96b1d82-2873-456a-9394-b52553428324 service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Updated VIF entry in instance network info cache for port 0c7bfe51-bb5e-4147-8013-a2f175ac4e26. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG nova.network.neutron [req-3faf3347-3c20-496a-8248-d18c4df1306b req-b96b1d82-2873-456a-9394-b52553428324 service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Updating instance_info_cache with network_info: [{"id": "0c7bfe51-bb5e-4147-8013-a2f175ac4e26", "address": "fa:16:3e:5a:3b:0f", "network": {"id": "830487d5-0366-4d38-a7f2-10c0c754c6df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1078972361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eb4bd98cbb410d81ae8a21d01056fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7bfe51-bb", "ovs_interfaceid": "0c7bfe51-bb5e-4147-8013-a2f175ac4e26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f12908-6b8c-4fe0-aa8d-2d998d24553a]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3faf3347-3c20-496a-8248-d18c4df1306b req-b96b1d82-2873-456a-9394-b52553428324 service nova] Releasing lock "refresh_cache-da32613e-b1a9-4733-831f-e4fb1f34995f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[05727508-1f97-414d-a8e6-bcfb7a854d46]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 (non-flash)
Aug 15 00:35:42 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:42 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 (non-flash)
Aug 15 00:35:42 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:42 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[db37ec4a-fd66-4791-ae9c-3d63ee59557f]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'baseCjSD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG nova.network.neutron [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Acquiring lock "da32613e-b1a9-4733-831f-e4fb1f34995f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:42 user nova-compute[73010]: DEBUG nova.objects.instance [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lazy-loading 'flavor' on Instance uuid da32613e-b1a9-4733-831f-e4fb1f34995f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:35:42 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:35:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG nova.policy [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca2df8041ee64a82a97814ab342008b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05feaf1f5e24465d9e3560741bb5f595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Acquiring lock "da32613e-b1a9-4733-831f-e4fb1f34995f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:43 user nova-compute[73010]: INFO nova.compute.manager [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Attaching volume 133a19e3-93e2-430c-8ae3-d3942f749ee7 to /dev/vdb
Aug 15 00:35:43 user nova-compute[73010]: DEBUG nova.compute.manager [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:35:43 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Creating image(s)
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Acquiring lock "/opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "/opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "/opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG os_brick.utils [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5653a464-b104-4c22-8684-9794ec61dee3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.178s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bb2bd1-da7a-43c5-9361-87f8deeccfec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d635c8-deac-44d3-83c9-076264b0be9c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa09ec72-4717-4fe2-8be1-a9c29f33696a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:35:43 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d3f434-3520-4b68-91d0-20f705f00087]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG os_brick.utils [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Updating existing volume attachment record: 32cc8681-ad4f-48f2-9306-23f59aa37226 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.201s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk 1073741824" returned: 0 in 0.057s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26238613932333736', 'path': '/dev/sdb'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238613932333736', 'path': '/dev/sdb'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:35:43 user nova-compute[73010]: DEBUG nova.objects.instance [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lazy-loading 'flavor' on Instance uuid e2410ee7-7351-460a-8d9c-47fe54e08c8b {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:35:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.368s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:44 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:35:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:44 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:35:44 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:35:44 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:35:44 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:35:44 user nova-compute[73010]:   <serial>15d7a4f5-c6a5-4347-a86e-1b1381ce5177</serial>
Aug 15 00:35:44 user nova-compute[73010]: </disk>
Aug 15 00:35:44 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:35:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:44 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Cannot resize image /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:35:44 user nova-compute[73010]: DEBUG nova.objects.instance [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lazy-loading 'migration_context' on Instance uuid 52878f3e-3ffa-4b1b-b842-ca2215454a3e {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:35:44 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:35:44 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Ensure instance console log exists: /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:35:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:44 user nova-compute[73010]: DEBUG nova.network.neutron [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Successfully created port: 30aa2ade-cfae-4c5a-aecc-3ddfadea1000 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:35:44 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:35:44 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:35:44 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] No VIF found with MAC fa:16:3e:c5:b2:68, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:35:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d9843acc-4c08-4fb1-879d-3c34a31d426f tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.950s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:44 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692059729.8202324, de9297d8-10e8-4244-b25d-54d4c2a83aea => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:35:44 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] VM Stopped (Lifecycle Event)
Aug 15 00:35:44 user nova-compute[73010]: DEBUG nova.compute.manager [None req-788978e7-e3b5-42df-bb92-836819b284c0 None None] [instance: de9297d8-10e8-4244-b25d-54d4c2a83aea] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:35:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.network.neutron [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Successfully updated port: 30aa2ade-cfae-4c5a-aecc-3ddfadea1000 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Acquiring lock "refresh_cache-52878f3e-3ffa-4b1b-b842-ca2215454a3e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Acquired lock "refresh_cache-52878f3e-3ffa-4b1b-b842-ca2215454a3e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.network.neutron [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.compute.manager [req-b7372071-f2e1-4160-bc09-f688a0741b53 req-8598cb4d-f837-485b-913e-26864d61eddf service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Received event network-changed-30aa2ade-cfae-4c5a-aecc-3ddfadea1000 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.compute.manager [req-b7372071-f2e1-4160-bc09-f688a0741b53 req-8598cb4d-f837-485b-913e-26864d61eddf service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Refreshing instance network info cache due to event network-changed-30aa2ade-cfae-4c5a-aecc-3ddfadea1000. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b7372071-f2e1-4160-bc09-f688a0741b53 req-8598cb4d-f837-485b-913e-26864d61eddf service nova] Acquiring lock "refresh_cache-52878f3e-3ffa-4b1b-b842-ca2215454a3e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.network.neutron [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.network.neutron [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Updating instance_info_cache with network_info: [{"id": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "address": "fa:16:3e:4d:03:9e", "network": {"id": "35a82886-0b11-43bd-adcf-7d64cd9afdc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719337962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05feaf1f5e24465d9e3560741bb5f595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30aa2ade-cf", "ovs_interfaceid": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Releasing lock "refresh_cache-52878f3e-3ffa-4b1b-b842-ca2215454a3e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.compute.manager [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Instance network_info: |[{"id": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "address": "fa:16:3e:4d:03:9e", "network": {"id": "35a82886-0b11-43bd-adcf-7d64cd9afdc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719337962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05feaf1f5e24465d9e3560741bb5f595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30aa2ade-cf", "ovs_interfaceid": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b7372071-f2e1-4160-bc09-f688a0741b53 req-8598cb4d-f837-485b-913e-26864d61eddf service nova] Acquired lock "refresh_cache-52878f3e-3ffa-4b1b-b842-ca2215454a3e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.network.neutron [req-b7372071-f2e1-4160-bc09-f688a0741b53 req-8598cb4d-f837-485b-913e-26864d61eddf service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Refreshing network info cache for port 30aa2ade-cfae-4c5a-aecc-3ddfadea1000 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Start _get_guest_xml network_info=[{"id": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "address": "fa:16:3e:4d:03:9e", "network": {"id": "35a82886-0b11-43bd-adcf-7d64cd9afdc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719337962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05feaf1f5e24465d9e3560741bb5f595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30aa2ade-cf", "ovs_interfaceid": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:35:45 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:35:45 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1403916647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1403916647',id=14,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTpqd0AO5cR/8y8DOTel0pu1KfJ9BbuQ2tYkoDS5WHMZgu+jFCinV11caUfGX5tzP78Z/KTQ4jpvDxB89/wwhV2id1x6y1BOAyCNEVTVJLgpj3ceNjhqPbgEXUOXteS+w==',key_name='tempest-keypair-434770644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05feaf1f5e24465d9e3560741bb5f595',ramdisk_id='',reservation_id='r-wnii2rsz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1572033819',owner_user_name='tempest-TaggedAttachmentsTest-1572033819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:35:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca2df8041ee64a82a97814ab342008b4',uuid=52878f3e-3ffa-4b1b-b842-ca2215454a3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "address": "fa:16:3e:4d:03:9e", "network": {"id": "35a82886-0b11-43bd-adcf-7d64cd9afdc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719337962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05feaf1f5e24465d9e3560741bb5f595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30aa2ade-cf", "ovs_interfaceid": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Converting VIF {"id": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "address": "fa:16:3e:4d:03:9e", "network": {"id": "35a82886-0b11-43bd-adcf-7d64cd9afdc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719337962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05feaf1f5e24465d9e3560741bb5f595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30aa2ade-cf", "ovs_interfaceid": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:03:9e,bridge_name='br-int',has_traffic_filtering=True,id=30aa2ade-cfae-4c5a-aecc-3ddfadea1000,network=Network(35a82886-0b11-43bd-adcf-7d64cd9afdc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30aa2ade-cf') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.objects.instance [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lazy-loading 'pci_devices' on Instance uuid 52878f3e-3ffa-4b1b-b842-ca2215454a3e {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:35:45 user nova-compute[73010]:   <uuid>52878f3e-3ffa-4b1b-b842-ca2215454a3e</uuid>
Aug 15 00:35:45 user nova-compute[73010]:   <name>instance-0000000e</name>
Aug 15 00:35:45 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:35:45 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:35:45 user nova-compute[73010]:   <metadata>
Aug 15 00:35:45 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:35:45 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:35:45 user nova-compute[73010]:       <nova:name>tempest-device-tagging-server-1403916647</nova:name>
Aug 15 00:35:45 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:35:45</nova:creationTime>
Aug 15 00:35:45 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:35:45 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:35:45 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:35:45 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:35:45 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:35:45 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:35:45 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:35:45 user nova-compute[73010]:       <nova:owner>
Aug 15 00:35:45 user nova-compute[73010]:         <nova:user uuid="ca2df8041ee64a82a97814ab342008b4">tempest-TaggedAttachmentsTest-1572033819-project-member</nova:user>
Aug 15 00:35:45 user nova-compute[73010]:         <nova:project uuid="05feaf1f5e24465d9e3560741bb5f595">tempest-TaggedAttachmentsTest-1572033819</nova:project>
Aug 15 00:35:45 user nova-compute[73010]:       </nova:owner>
Aug 15 00:35:45 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:35:45 user nova-compute[73010]:       <nova:ports>
Aug 15 00:35:45 user nova-compute[73010]:         <nova:port uuid="30aa2ade-cfae-4c5a-aecc-3ddfadea1000">
Aug 15 00:35:45 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 00:35:45 user nova-compute[73010]:         </nova:port>
Aug 15 00:35:45 user nova-compute[73010]:       </nova:ports>
Aug 15 00:35:45 user nova-compute[73010]:     </nova:instance>
Aug 15 00:35:45 user nova-compute[73010]:   </metadata>
Aug 15 00:35:45 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:35:45 user nova-compute[73010]:     <system>
Aug 15 00:35:45 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:35:45 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:35:45 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:35:45 user nova-compute[73010]:       <entry name="serial">52878f3e-3ffa-4b1b-b842-ca2215454a3e</entry>
Aug 15 00:35:45 user nova-compute[73010]:       <entry name="uuid">52878f3e-3ffa-4b1b-b842-ca2215454a3e</entry>
Aug 15 00:35:45 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:35:45 user nova-compute[73010]:     </system>
Aug 15 00:35:45 user nova-compute[73010]:   </sysinfo>
Aug 15 00:35:45 user nova-compute[73010]:   <os>
Aug 15 00:35:45 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:35:45 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:35:45 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:35:45 user nova-compute[73010]:   </os>
Aug 15 00:35:45 user nova-compute[73010]:   <features>
Aug 15 00:35:45 user nova-compute[73010]:     <acpi/>
Aug 15 00:35:45 user nova-compute[73010]:     <apic/>
Aug 15 00:35:45 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:35:45 user nova-compute[73010]:   </features>
Aug 15 00:35:45 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:35:45 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:35:45 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:35:45 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:35:45 user nova-compute[73010]:   </clock>
Aug 15 00:35:45 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:35:45 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:35:45 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:35:45 user nova-compute[73010]:   </cpu>
Aug 15 00:35:45 user nova-compute[73010]:   <devices>
Aug 15 00:35:45 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:35:45 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:35:45 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk"/>
Aug 15 00:35:45 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:35:45 user nova-compute[73010]:     </disk>
Aug 15 00:35:45 user nova-compute[73010]:     <disk type="file" device="cdrom">
Aug 15 00:35:45 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 00:35:45 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk.config"/>
Aug 15 00:35:45 user nova-compute[73010]:       <target dev="hda" bus="ide"/>
Aug 15 00:35:45 user nova-compute[73010]:     </disk>
Aug 15 00:35:45 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:35:45 user nova-compute[73010]:       <mac address="fa:16:3e:4d:03:9e"/>
Aug 15 00:35:45 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:35:45 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:35:45 user nova-compute[73010]:       <target dev="tap30aa2ade-cf"/>
Aug 15 00:35:45 user nova-compute[73010]:     </interface>
Aug 15 00:35:45 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:35:45 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/console.log" append="off"/>
Aug 15 00:35:45 user nova-compute[73010]:     </serial>
Aug 15 00:35:45 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:35:45 user nova-compute[73010]:     <video>
Aug 15 00:35:45 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:35:45 user nova-compute[73010]:     </video>
Aug 15 00:35:45 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:35:45 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:35:45 user nova-compute[73010]:     </rng>
Aug 15 00:35:45 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:35:45 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:35:45 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:35:45 user nova-compute[73010]:     </memballoon>
Aug 15 00:35:45 user nova-compute[73010]:   </devices>
Aug 15 00:35:45 user nova-compute[73010]: </domain>
Aug 15 00:35:45 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1403916647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1403916647',id=14,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTpqd0AO5cR/8y8DOTel0pu1KfJ9BbuQ2tYkoDS5WHMZgu+jFCinV11caUfGX5tzP78Z/KTQ4jpvDxB89/wwhV2id1x6y1BOAyCNEVTVJLgpj3ceNjhqPbgEXUOXteS+w==',key_name='tempest-keypair-434770644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05feaf1f5e24465d9e3560741bb5f595',ramdisk_id='',reservation_id='r-wnii2rsz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1572033819',owner_user_name='tempest-TaggedAttachmentsTest-1572033819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:35:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca2df8041ee64a82a97814ab342008b4',uuid=52878f3e-3ffa-4b1b-b842-ca2215454a3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "address": "fa:16:3e:4d:03:9e", "network": {"id": "35a82886-0b11-43bd-adcf-7d64cd9afdc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719337962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05feaf1f5e24465d9e3560741bb5f595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30aa2ade-cf", "ovs_interfaceid": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Converting VIF {"id": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "address": "fa:16:3e:4d:03:9e", "network": {"id": "35a82886-0b11-43bd-adcf-7d64cd9afdc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719337962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05feaf1f5e24465d9e3560741bb5f595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30aa2ade-cf", "ovs_interfaceid": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:03:9e,bridge_name='br-int',has_traffic_filtering=True,id=30aa2ade-cfae-4c5a-aecc-3ddfadea1000,network=Network(35a82886-0b11-43bd-adcf-7d64cd9afdc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30aa2ade-cf') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG os_vif [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:03:9e,bridge_name='br-int',has_traffic_filtering=True,id=30aa2ade-cfae-4c5a-aecc-3ddfadea1000,network=Network(35a82886-0b11-43bd-adcf-7d64cd9afdc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30aa2ade-cf') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30aa2ade-cf, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap30aa2ade-cf, col_values=(('external_ids', {'iface-id': '30aa2ade-cfae-4c5a-aecc-3ddfadea1000', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:03:9e', 'vm-uuid': '52878f3e-3ffa-4b1b-b842-ca2215454a3e'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:35:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:45 user nova-compute[73010]: INFO os_vif [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:03:9e,bridge_name='br-int',has_traffic_filtering=True,id=30aa2ade-cfae-4c5a-aecc-3ddfadea1000,network=Network(35a82886-0b11-43bd-adcf-7d64cd9afdc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30aa2ade-cf')
Aug 15 00:35:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:35:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] No BDM found with device name hda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:35:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] No VIF found with MAC fa:16:3e:4d:03:9e, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:35:46 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Using config drive
Aug 15 00:35:46 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Creating config drive at /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk.config
Aug 15 00:35:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprw2yhzvf {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprw2yhzvf" returned: 0 in 0.056s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:46 user nova-compute[73010]: DEBUG nova.network.neutron [req-b7372071-f2e1-4160-bc09-f688a0741b53 req-8598cb4d-f837-485b-913e-26864d61eddf service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Updated VIF entry in instance network info cache for port 30aa2ade-cfae-4c5a-aecc-3ddfadea1000. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:35:46 user nova-compute[73010]: DEBUG nova.network.neutron [req-b7372071-f2e1-4160-bc09-f688a0741b53 req-8598cb4d-f837-485b-913e-26864d61eddf service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Updating instance_info_cache with network_info: [{"id": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "address": "fa:16:3e:4d:03:9e", "network": {"id": "35a82886-0b11-43bd-adcf-7d64cd9afdc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719337962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05feaf1f5e24465d9e3560741bb5f595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30aa2ade-cf", "ovs_interfaceid": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:35:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b7372071-f2e1-4160-bc09-f688a0741b53 req-8598cb4d-f837-485b-913e-26864d61eddf service nova] Releasing lock "refresh_cache-52878f3e-3ffa-4b1b-b842-ca2215454a3e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:35:46 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:35:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:46 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:35:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:47 user nova-compute[73010]: INFO nova.compute.manager [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Detaching volume 15d7a4f5-c6a5-4347-a86e-1b1381ce5177
Aug 15 00:35:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:47 user nova-compute[73010]: INFO nova.virt.block_device [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Attempting to driver detach volume 15d7a4f5-c6a5-4347-a86e-1b1381ce5177 from mountpoint /dev/vdb
Aug 15 00:35:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Attempting to detach device vdb from instance e2410ee7-7351-460a-8d9c-47fe54e08c8b from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:35:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:35:47 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:35:47 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:35:47 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:35:47 user nova-compute[73010]:   <serial>15d7a4f5-c6a5-4347-a86e-1b1381ce5177</serial>
Aug 15 00:35:47 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:35:47 user nova-compute[73010]: </disk>
Aug 15 00:35:47 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:35:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:47 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Successfully detached device vdb from instance e2410ee7-7351-460a-8d9c-47fe54e08c8b from the persistent domain config.
Aug 15 00:35:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e2410ee7-7351-460a-8d9c-47fe54e08c8b from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:35:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:35:47 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:35:47 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:35:47 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:35:47 user nova-compute[73010]:   <serial>15d7a4f5-c6a5-4347-a86e-1b1381ce5177</serial>
Aug 15 00:35:47 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:35:47 user nova-compute[73010]: </disk>
Aug 15 00:35:47 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:35:47 user nova-compute[73010]: DEBUG nova.compute.manager [req-ab5366b5-6f59-471d-959f-42f34340bce4 req-27b1e96e-57dd-4fd9-a6fc-fc0f05b218dc service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Received event network-vif-plugged-30aa2ade-cfae-4c5a-aecc-3ddfadea1000 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ab5366b5-6f59-471d-959f-42f34340bce4 req-27b1e96e-57dd-4fd9-a6fc-fc0f05b218dc service nova] Acquiring lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ab5366b5-6f59-471d-959f-42f34340bce4 req-27b1e96e-57dd-4fd9-a6fc-fc0f05b218dc service nova] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ab5366b5-6f59-471d-959f-42f34340bce4 req-27b1e96e-57dd-4fd9-a6fc-fc0f05b218dc service nova] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:47 user nova-compute[73010]: DEBUG nova.compute.manager [req-ab5366b5-6f59-471d-959f-42f34340bce4 req-27b1e96e-57dd-4fd9-a6fc-fc0f05b218dc service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] No waiting events found dispatching network-vif-plugged-30aa2ade-cfae-4c5a-aecc-3ddfadea1000 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:47 user nova-compute[73010]: WARNING nova.compute.manager [req-ab5366b5-6f59-471d-959f-42f34340bce4 req-27b1e96e-57dd-4fd9-a6fc-fc0f05b218dc service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Received unexpected event network-vif-plugged-30aa2ade-cfae-4c5a-aecc-3ddfadea1000 for instance with vm_state building and task_state spawning.
Aug 15 00:35:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692059748.209356, e2410ee7-7351-460a-8d9c-47fe54e08c8b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e2410ee7-7351-460a-8d9c-47fe54e08c8b {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:35:48 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Successfully detached device vdb from instance e2410ee7-7351-460a-8d9c-47fe54e08c8b from the live domain config.
Aug 15 00:35:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'baseCjSD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:35:48 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:35:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[69141925-c332-4126-925b-a2572b634523]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1df844c-3487-4637-80bc-63e971d51ae4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 (non-flash)
Aug 15 00:35:48 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:48 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 (non-flash)
Aug 15 00:35:48 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:48 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec30649d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177'): ({'sdb'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Removing single pathed devices sdb {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "983577b5-4abb-4280-b8e8-a63f42d8f796" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG nova.objects.instance [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lazy-loading 'flavor' on Instance uuid 983577b5-4abb-4280-b8e8-a63f42d8f796 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[24adb2da-5bc4-44b5-a8b4-5381113a5e6c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae76fa9b-1082-41e4-983d-fa8d9138284b]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Flushing IO for device /dev/sdb {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c2d3d6-a0e7-447f-a69a-ea498df95a75]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3735c55a-f8b0-4775-8c83-ee8882bd4f6a]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e96becf-bdb8-4313-97aa-7834bc6d41eb]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28daf4b-3eee-4ea4-86bf-23c6d4e8bf69]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177, portal: 172.16.0.220,3260]
Aug 15 00:35:48 user nova-compute[73010]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177, portal: 172.16.0.220,3260] successful.
Aug 15 00:35:48 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "983577b5-4abb-4280-b8e8-a63f42d8f796" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:48 user nova-compute[73010]: INFO nova.compute.manager [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Attaching volume e4ddadda-c939-425a-bcb3-4e454e0db7f4 to /dev/vdb
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d7a4f5-c6a5-4347-a86e-1b1381ce5177 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad93fb9-6433-4c24-96e8-f983bead0e53]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] <== disconnect_volume: return (316ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG os_brick.utils [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1325955-fb9d-4b41-8fe6-6610cea73627]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad114f0-ce21-4357-b5b7-19016a8b280c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceba52c9-2e07-43b2-9f12-fd3806826033]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0aa29cb-78cb-4a2d-b0ef-92819fffc41f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:35:48 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cbeb28-6ff8-4621-945f-40fdacd78e5e]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG os_brick.utils [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Updating existing volume attachment record: 7bca437a-3a12-4752-a3b8-38d08a0b0d6c {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:49 user nova-compute[73010]: DEBUG nova.objects.instance [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lazy-loading 'flavor' on Instance uuid e2410ee7-7351-460a-8d9c-47fe54e08c8b {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:35:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-90aa95c5-c501-44e4-afb0-8bc804d6b362 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.022s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:35:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:49 user nova-compute[73010]: DEBUG nova.compute.manager [req-0a229422-9c26-46cc-8a71-b66c7de44f01 req-71bfe6f3-8b5a-4944-a80e-7a9f12317389 service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Received event network-vif-plugged-30aa2ade-cfae-4c5a-aecc-3ddfadea1000 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0a229422-9c26-46cc-8a71-b66c7de44f01 req-71bfe6f3-8b5a-4944-a80e-7a9f12317389 service nova] Acquiring lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0a229422-9c26-46cc-8a71-b66c7de44f01 req-71bfe6f3-8b5a-4944-a80e-7a9f12317389 service nova] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0a229422-9c26-46cc-8a71-b66c7de44f01 req-71bfe6f3-8b5a-4944-a80e-7a9f12317389 service nova] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:49 user nova-compute[73010]: DEBUG nova.compute.manager [req-0a229422-9c26-46cc-8a71-b66c7de44f01 req-71bfe6f3-8b5a-4944-a80e-7a9f12317389 service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] No waiting events found dispatching network-vif-plugged-30aa2ade-cfae-4c5a-aecc-3ddfadea1000 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:35:49 user nova-compute[73010]: WARNING nova.compute.manager [req-0a229422-9c26-46cc-8a71-b66c7de44f01 req-71bfe6f3-8b5a-4944-a80e-7a9f12317389 service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Received unexpected event network-vif-plugged-30aa2ade-cfae-4c5a-aecc-3ddfadea1000 for instance with vm_state building and task_state spawning.
Aug 15 00:35:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:50 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059750.1970227, 52878f3e-3ffa-4b1b-b842-ca2215454a3e => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:35:50 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] VM Resumed (Lifecycle Event)
Aug 15 00:35:50 user nova-compute[73010]: DEBUG nova.compute.manager [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:35:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:35:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ba39c23-9f14-4eda-94f7-a07e82c92ec0/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:50 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:35:50 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Instance spawned successfully.
Aug 15 00:35:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:35:50 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:35:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:35:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:35:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:35:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:35:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:35:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:35:50 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:35:50 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059750.2056215, 52878f3e-3ffa-4b1b-b842-ca2215454a3e => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:35:50 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] VM Started (Lifecycle Event)
Aug 15 00:35:50 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:35:50 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:35:50 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:35:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ba39c23-9f14-4eda-94f7-a07e82c92ec0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ba39c23-9f14-4eda-94f7-a07e82c92ec0/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:50 user nova-compute[73010]: INFO nova.compute.manager [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Took 7.28 seconds to spawn the instance on the hypervisor.
Aug 15 00:35:50 user nova-compute[73010]: DEBUG nova.compute.manager [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:35:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ba39c23-9f14-4eda-94f7-a07e82c92ec0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:50 user nova-compute[73010]: INFO nova.compute.manager [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Took 8.20 seconds to build instance.
Aug 15 00:35:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-904b91c5-a622-4796-b24f-f5815cffe8fb tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.343s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:52 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:35:52 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:35:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=7804MB free_disk=25.882217407226562GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:35:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 983577b5-4abb-4280-b8e8-a63f42d8f796 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:35:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance afcd0a05-e035-492e-9fbe-cd63f4c3ea42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:35:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 0588a46c-2314-47e3-b984-1e04518e8a63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:35:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance b1d5a938-3f1e-4e8c-bdda-0786d4e27d98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:35:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance e2410ee7-7351-460a-8d9c-47fe54e08c8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:35:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance da32613e-b1a9-4733-831f-e4fb1f34995f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:35:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4ba39c23-9f14-4eda-94f7-a07e82c92ec0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:35:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 52878f3e-3ffa-4b1b-b842-ca2215454a3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:35:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:35:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.604s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LicNyxGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:35:53 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:35:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:35:53 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:35:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:35:53 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[86141149-5a7b-4ac5-8e1a-17df6b18c059]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:35:53 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c09a475-301a-4d7d-89ea-7085002abed0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7] added
Aug 15 00:35:53 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83b33a1-406d-4dd5-892d-b9cc9813b949]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[616bb758-3ee0-4a9b-9bb2-77ee38012fde]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LicNyxGH {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LicNyxGH" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc9880a-3b3e-4eef-a05d-4e5089ddf94c]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LicNyxGH'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7faf3da-c3ce-471e-a894-c37093d167d0]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a09ec2-a863-4ac4-b329-fc0217568fd0]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:53 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:53 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4151f5bf-1cb2-4e8f-b4cf-4421a3ab05a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7, portal: 172.16.0.220,3260]
Aug 15 00:35:53 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7, portal: 172.16.0.220,3260] successful.
Aug 15 00:35:53 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f161d4d7-1aa9-437c-a3b6-997c69419061]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e5901c-460e-408c-a4f9-3eb9f86f73d7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:35:53 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:53 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:35:53 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:53 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc7902c-0e6e-43fc-9bcf-b5cda0199830]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:35:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LicNyxGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:35:54 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:35:54 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:35:54 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:35:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:35:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-0588a46c-2314-47e3-b984-1e04518e8a63" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:35:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-0588a46c-2314-47e3-b984-1e04518e8a63" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:35:54 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 00:35:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:35:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23033306662376437', 'path': '/dev/sdb'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:35:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033306662376437', 'path': '/dev/sdb'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:35:54 user nova-compute[73010]: DEBUG nova.objects.instance [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lazy-loading 'flavor' on Instance uuid da32613e-b1a9-4733-831f-e4fb1f34995f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:35:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:35:54 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:35:54 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:35:54 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:35:54 user nova-compute[73010]:   <serial>133a19e3-93e2-430c-8ae3-d3942f749ee7</serial>
Aug 15 00:35:54 user nova-compute[73010]: </disk>
Aug 15 00:35:54 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:35:55 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Updating instance_info_cache with network_info: [{"id": "61021aff-d0dd-4ba3-b862-d989711f4b33", "address": "fa:16:3e:8d:63:82", "network": {"id": "9aa91991-9d4c-4b0d-a955-652df703cde1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-393715584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a620c803f76045d6a5b5b78ec1894c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61021aff-d0", "ovs_interfaceid": "61021aff-d0dd-4ba3-b862-d989711f4b33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:35:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-0588a46c-2314-47e3-b984-1e04518e8a63" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:35:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 00:35:55 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:35:55 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:35:55 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:35:55 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:35:55 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:35:55 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:35:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:35:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:35:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:35:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] No VIF found with MAC fa:16:3e:5a:3b:0f, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:35:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-13496a11-f422-4f96-8823-81fd33ef1ae3 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.313s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "dde74512-c8c3-436c-a6dc-a9327340229e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "dde74512-c8c3-436c-a6dc-a9327340229e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:56 user nova-compute[73010]: DEBUG nova.compute.manager [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:35:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:56 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:35:56 user nova-compute[73010]: INFO nova.compute.claims [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Claim successful on node user
Aug 15 00:35:56 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:35:56 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:35:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:56 user nova-compute[73010]: DEBUG nova.compute.manager [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:35:56 user nova-compute[73010]: DEBUG nova.compute.manager [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:35:56 user nova-compute[73010]: DEBUG nova.network.neutron [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:35:56 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:35:56 user nova-compute[73010]: DEBUG nova.compute.manager [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:35:57 user nova-compute[73010]: DEBUG nova.policy [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '928ab235d55d4bfc86de82f2387c9d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e962745e3a554f2b8f42d97434173a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:35:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:35:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:35:57 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Creating image(s)
Aug 15 00:35:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "/opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "/opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "/opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.183s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.174s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk 1073741824" returned: 0 in 0.051s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.192s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:57 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:35:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:57 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Cannot resize image /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:35:57 user nova-compute[73010]: DEBUG nova.objects.instance [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lazy-loading 'migration_context' on Instance uuid dde74512-c8c3-436c-a6dc-a9327340229e {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:35:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:35:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Ensure instance console log exists: /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:35:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:58 user nova-compute[73010]: DEBUG nova.network.neutron [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Successfully created port: 68f235d2-055a-40e8-a4ab-09e33974f4ac {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:35:58 user nova-compute[73010]: DEBUG nova.network.neutron [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Successfully updated port: 68f235d2-055a-40e8-a4ab-09e33974f4ac {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:35:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "refresh_cache-dde74512-c8c3-436c-a6dc-a9327340229e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:35:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquired lock "refresh_cache-dde74512-c8c3-436c-a6dc-a9327340229e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:35:58 user nova-compute[73010]: DEBUG nova.network.neutron [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:35:58 user nova-compute[73010]: DEBUG nova.compute.manager [req-1e53f5ea-0c84-45ee-af4c-da1b8127cb2c req-1737c839-8bb7-4dd9-9d44-50dc4c742cdd service nova] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Received event network-changed-68f235d2-055a-40e8-a4ab-09e33974f4ac {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:35:58 user nova-compute[73010]: DEBUG nova.compute.manager [req-1e53f5ea-0c84-45ee-af4c-da1b8127cb2c req-1737c839-8bb7-4dd9-9d44-50dc4c742cdd service nova] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Refreshing instance network info cache due to event network-changed-68f235d2-055a-40e8-a4ab-09e33974f4ac. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:35:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1e53f5ea-0c84-45ee-af4c-da1b8127cb2c req-1737c839-8bb7-4dd9-9d44-50dc4c742cdd service nova] Acquiring lock "refresh_cache-dde74512-c8c3-436c-a6dc-a9327340229e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:35:58 user nova-compute[73010]: DEBUG nova.network.neutron [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AZTKRHrL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:35:59 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:35:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:35:59 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:35:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:35:59 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3476f466-0140-403f-94cf-6e6bc1c4ced3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:35:59 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3706cc7b-ed29-4832-b2db-523247a6b59a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4] added
Aug 15 00:35:59 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[57af635e-2727-4402-acae-5a8778497b27]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.network.neutron [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Updating instance_info_cache with network_info: [{"id": "68f235d2-055a-40e8-a4ab-09e33974f4ac", "address": "fa:16:3e:8b:20:c2", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f235d2-05", "ovs_interfaceid": "68f235d2-055a-40e8-a4ab-09e33974f4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed30bf3-9392-4d69-82ed-4c036e7812a9]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AZTKRHrL {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Releasing lock "refresh_cache-dde74512-c8c3-436c-a6dc-a9327340229e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.compute.manager [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Instance network_info: |[{"id": "68f235d2-055a-40e8-a4ab-09e33974f4ac", "address": "fa:16:3e:8b:20:c2", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f235d2-05", "ovs_interfaceid": "68f235d2-055a-40e8-a4ab-09e33974f4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1e53f5ea-0c84-45ee-af4c-da1b8127cb2c req-1737c839-8bb7-4dd9-9d44-50dc4c742cdd service nova] Acquired lock "refresh_cache-dde74512-c8c3-436c-a6dc-a9327340229e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.network.neutron [req-1e53f5ea-0c84-45ee-af4c-da1b8127cb2c req-1737c839-8bb7-4dd9-9d44-50dc4c742cdd service nova] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Refreshing network info cache for port 68f235d2-055a-40e8-a4ab-09e33974f4ac {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Start _get_guest_xml network_info=[{"id": "68f235d2-055a-40e8-a4ab-09e33974f4ac", "address": "fa:16:3e:8b:20:c2", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f235d2-05", "ovs_interfaceid": "68f235d2-055a-40e8-a4ab-09e33974f4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AZTKRHrL" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf5e036-a3cb-46bf-a6b8-8b96d4b274ad]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AZTKRHrL'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:59 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:35:59 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:35:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1404970930',display_name='tempest-AttachVolumeNegativeTest-server-1404970930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1404970930',id=15,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo9q3vez3IawJePyv8/WuxnQFlvrHxSFHQXJZrX+oikydz8qetTyB6DUZqr/hRlckAl++ufoDtS7flou8Bh3JIwtLolXM5jKh7j2Wt0OLlK+oHeS31AJ1A0+b4nKeCaBQ==',key_name='tempest-keypair-2086446881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e962745e3a554f2b8f42d97434173a7a',ramdisk_id='',reservation_id='r-m86v4sf4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-865469153',owner_user_name='tempest-AttachVolumeNegativeTest-865469153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:35:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928ab235d55d4bfc86de82f2387c9d06',uuid=dde74512-c8c3-436c-a6dc-a9327340229e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68f235d2-055a-40e8-a4ab-09e33974f4ac", "address": "fa:16:3e:8b:20:c2", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f235d2-05", "ovs_interfaceid": "68f235d2-055a-40e8-a4ab-09e33974f4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Converting VIF {"id": "68f235d2-055a-40e8-a4ab-09e33974f4ac", "address": "fa:16:3e:8b:20:c2", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f235d2-05", "ovs_interfaceid": "68f235d2-055a-40e8-a4ab-09e33974f4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:20:c2,bridge_name='br-int',has_traffic_filtering=True,id=68f235d2-055a-40e8-a4ab-09e33974f4ac,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68f235d2-05') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.objects.instance [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lazy-loading 'pci_devices' on Instance uuid dde74512-c8c3-436c-a6dc-a9327340229e {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[23979a3c-90a9-4e6f-9a43-6a8440a432f6]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:35:59 user nova-compute[73010]:   <uuid>dde74512-c8c3-436c-a6dc-a9327340229e</uuid>
Aug 15 00:35:59 user nova-compute[73010]:   <name>instance-0000000f</name>
Aug 15 00:35:59 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:35:59 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:35:59 user nova-compute[73010]:   <metadata>
Aug 15 00:35:59 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:35:59 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:35:59 user nova-compute[73010]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1404970930</nova:name>
Aug 15 00:35:59 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:35:59</nova:creationTime>
Aug 15 00:35:59 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:35:59 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:35:59 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:35:59 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:35:59 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:35:59 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:35:59 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:35:59 user nova-compute[73010]:       <nova:owner>
Aug 15 00:35:59 user nova-compute[73010]:         <nova:user uuid="928ab235d55d4bfc86de82f2387c9d06">tempest-AttachVolumeNegativeTest-865469153-project-member</nova:user>
Aug 15 00:35:59 user nova-compute[73010]:         <nova:project uuid="e962745e3a554f2b8f42d97434173a7a">tempest-AttachVolumeNegativeTest-865469153</nova:project>
Aug 15 00:35:59 user nova-compute[73010]:       </nova:owner>
Aug 15 00:35:59 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:35:59 user nova-compute[73010]:       <nova:ports>
Aug 15 00:35:59 user nova-compute[73010]:         <nova:port uuid="68f235d2-055a-40e8-a4ab-09e33974f4ac">
Aug 15 00:35:59 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 00:35:59 user nova-compute[73010]:         </nova:port>
Aug 15 00:35:59 user nova-compute[73010]:       </nova:ports>
Aug 15 00:35:59 user nova-compute[73010]:     </nova:instance>
Aug 15 00:35:59 user nova-compute[73010]:   </metadata>
Aug 15 00:35:59 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:35:59 user nova-compute[73010]:     <system>
Aug 15 00:35:59 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:35:59 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:35:59 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:35:59 user nova-compute[73010]:       <entry name="serial">dde74512-c8c3-436c-a6dc-a9327340229e</entry>
Aug 15 00:35:59 user nova-compute[73010]:       <entry name="uuid">dde74512-c8c3-436c-a6dc-a9327340229e</entry>
Aug 15 00:35:59 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:35:59 user nova-compute[73010]:     </system>
Aug 15 00:35:59 user nova-compute[73010]:   </sysinfo>
Aug 15 00:35:59 user nova-compute[73010]:   <os>
Aug 15 00:35:59 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:35:59 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:35:59 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:35:59 user nova-compute[73010]:   </os>
Aug 15 00:35:59 user nova-compute[73010]:   <features>
Aug 15 00:35:59 user nova-compute[73010]:     <acpi/>
Aug 15 00:35:59 user nova-compute[73010]:     <apic/>
Aug 15 00:35:59 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:35:59 user nova-compute[73010]:   </features>
Aug 15 00:35:59 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:35:59 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:35:59 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:35:59 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:35:59 user nova-compute[73010]:   </clock>
Aug 15 00:35:59 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:35:59 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:35:59 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:35:59 user nova-compute[73010]:   </cpu>
Aug 15 00:35:59 user nova-compute[73010]:   <devices>
Aug 15 00:35:59 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:35:59 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:35:59 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk"/>
Aug 15 00:35:59 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:35:59 user nova-compute[73010]:     </disk>
Aug 15 00:35:59 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:35:59 user nova-compute[73010]:       <mac address="fa:16:3e:8b:20:c2"/>
Aug 15 00:35:59 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:35:59 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:35:59 user nova-compute[73010]:       <target dev="tap68f235d2-05"/>
Aug 15 00:35:59 user nova-compute[73010]:     </interface>
Aug 15 00:35:59 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:35:59 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/console.log" append="off"/>
Aug 15 00:35:59 user nova-compute[73010]:     </serial>
Aug 15 00:35:59 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:35:59 user nova-compute[73010]:     <video>
Aug 15 00:35:59 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:35:59 user nova-compute[73010]:     </video>
Aug 15 00:35:59 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:35:59 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:35:59 user nova-compute[73010]:     </rng>
Aug 15 00:35:59 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:35:59 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:35:59 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:35:59 user nova-compute[73010]:     </memballoon>
Aug 15 00:35:59 user nova-compute[73010]:   </devices>
Aug 15 00:35:59 user nova-compute[73010]: </domain>
Aug 15 00:35:59 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:35:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1404970930',display_name='tempest-AttachVolumeNegativeTest-server-1404970930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1404970930',id=15,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo9q3vez3IawJePyv8/WuxnQFlvrHxSFHQXJZrX+oikydz8qetTyB6DUZqr/hRlckAl++ufoDtS7flou8Bh3JIwtLolXM5jKh7j2Wt0OLlK+oHeS31AJ1A0+b4nKeCaBQ==',key_name='tempest-keypair-2086446881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e962745e3a554f2b8f42d97434173a7a',ramdisk_id='',reservation_id='r-m86v4sf4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-865469153',owner_user_name='tempest-AttachVolumeNegativeTest-865469153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:35:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928ab235d55d4bfc86de82f2387c9d06',uuid=dde74512-c8c3-436c-a6dc-a9327340229e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68f235d2-055a-40e8-a4ab-09e33974f4ac", "address": "fa:16:3e:8b:20:c2", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f235d2-05", "ovs_interfaceid": "68f235d2-055a-40e8-a4ab-09e33974f4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Converting VIF {"id": "68f235d2-055a-40e8-a4ab-09e33974f4ac", "address": "fa:16:3e:8b:20:c2", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f235d2-05", "ovs_interfaceid": "68f235d2-055a-40e8-a4ab-09e33974f4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:20:c2,bridge_name='br-int',has_traffic_filtering=True,id=68f235d2-055a-40e8-a4ab-09e33974f4ac,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68f235d2-05') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG os_vif [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:20:c2,bridge_name='br-int',has_traffic_filtering=True,id=68f235d2-055a-40e8-a4ab-09e33974f4ac,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68f235d2-05') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68f235d2-05, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap68f235d2-05, col_values=(('external_ids', {'iface-id': '68f235d2-055a-40e8-a4ab-09e33974f4ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:20:c2', 'vm-uuid': 'dde74512-c8c3-436c-a6dc-a9327340229e'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb37fd2a-b39e-4875-9591-83f0d3688bca]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:35:59 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:59 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:35:59 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:59 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:35:59 user nova-compute[73010]: INFO os_vif [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:20:c2,bridge_name='br-int',has_traffic_filtering=True,id=68f235d2-055a-40e8-a4ab-09e33974f4ac,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68f235d2-05')
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf09734-fe37-4a71-b65f-c50684a8c5dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4, portal: 172.16.0.220,3260]
Aug 15 00:35:59 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4, portal: 172.16.0.220,3260] successful.
Aug 15 00:35:59 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] No VIF found with MAC fa:16:3e:8b:20:c2, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebabc5a-c331-43c6-95ec-963749c695a8]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f25af5-7817-469f-9a0d-cf6bd60f6c2d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:35:59 user nova-compute[73010]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:35:59 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:59 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:35:59 user nova-compute[73010]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:35:59 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:35:59 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[43767616-964a-4272-b4f6-e252a9d9ad2d]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AZTKRHrL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Acquiring lock "da32613e-b1a9-4733-831f-e4fb1f34995f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.objects.instance [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lazy-loading 'flavor' on Instance uuid da32613e-b1a9-4733-831f-e4fb1f34995f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.network.neutron [req-1e53f5ea-0c84-45ee-af4c-da1b8127cb2c req-1737c839-8bb7-4dd9-9d44-50dc4c742cdd service nova] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Updated VIF entry in instance network info cache for port 68f235d2-055a-40e8-a4ab-09e33974f4ac. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG nova.network.neutron [req-1e53f5ea-0c84-45ee-af4c-da1b8127cb2c req-1737c839-8bb7-4dd9-9d44-50dc4c742cdd service nova] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Updating instance_info_cache with network_info: [{"id": "68f235d2-055a-40e8-a4ab-09e33974f4ac", "address": "fa:16:3e:8b:20:c2", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f235d2-05", "ovs_interfaceid": "68f235d2-055a-40e8-a4ab-09e33974f4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:35:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1e53f5ea-0c84-45ee-af4c-da1b8127cb2c req-1737c839-8bb7-4dd9-9d44-50dc4c742cdd service nova] Releasing lock "refresh_cache-dde74512-c8c3-436c-a6dc-a9327340229e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Acquiring lock "da32613e-b1a9-4733-831f-e4fb1f34995f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:00 user nova-compute[73010]: INFO nova.compute.manager [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Attaching volume 0fc0fb03-0fad-4198-8399-7a55d328b0d7 to /dev/vdc
Aug 15 00:36:00 user nova-compute[73010]: DEBUG os_brick.utils [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb39e16-38a2-44ce-9b50-e07e9199e9ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d00281-3653-47fe-a2a4-be6314277672]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9ba6c3-10a1-4175-ad2d-db4303142ea4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed989b63-6bed-4dea-a8dd-c09939a36cb6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:36:00 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:36:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a229e5b4-8a47-4277-9398-a1942b115f6c]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG os_brick.utils [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Updating existing volume attachment record: c2adb2ad-f92b-4abb-ba7a-d60c7e6d8595 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '26466376665656565', 'path': '/dev/sdc'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466376665656565', 'path': '/dev/sdc'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG nova.objects.instance [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lazy-loading 'flavor' on Instance uuid 983577b5-4abb-4280-b8e8-a63f42d8f796 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:36:00 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:36:00 user nova-compute[73010]:   <source dev="/dev/sdc"/>
Aug 15 00:36:00 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:36:00 user nova-compute[73010]:   <serial>e4ddadda-c939-425a-bcb3-4e454e0db7f4</serial>
Aug 15 00:36:00 user nova-compute[73010]: </disk>
Aug 15 00:36:00 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:36:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:01 user nova-compute[73010]: DEBUG nova.compute.manager [req-86e8c14e-7464-41db-9406-9cdb73d1a6ae req-9ad47f5d-c278-499f-a1ff-428776b3a217 service nova] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Received event network-vif-plugged-68f235d2-055a-40e8-a4ab-09e33974f4ac {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:36:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-86e8c14e-7464-41db-9406-9cdb73d1a6ae req-9ad47f5d-c278-499f-a1ff-428776b3a217 service nova] Acquiring lock "dde74512-c8c3-436c-a6dc-a9327340229e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-86e8c14e-7464-41db-9406-9cdb73d1a6ae req-9ad47f5d-c278-499f-a1ff-428776b3a217 service nova] Lock "dde74512-c8c3-436c-a6dc-a9327340229e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-86e8c14e-7464-41db-9406-9cdb73d1a6ae req-9ad47f5d-c278-499f-a1ff-428776b3a217 service nova] Lock "dde74512-c8c3-436c-a6dc-a9327340229e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:01 user nova-compute[73010]: DEBUG nova.compute.manager [req-86e8c14e-7464-41db-9406-9cdb73d1a6ae req-9ad47f5d-c278-499f-a1ff-428776b3a217 service nova] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] No waiting events found dispatching network-vif-plugged-68f235d2-055a-40e8-a4ab-09e33974f4ac {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:36:01 user nova-compute[73010]: WARNING nova.compute.manager [req-86e8c14e-7464-41db-9406-9cdb73d1a6ae req-9ad47f5d-c278-499f-a1ff-428776b3a217 service nova] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Received unexpected event network-vif-plugged-68f235d2-055a-40e8-a4ab-09e33974f4ac for instance with vm_state building and task_state spawning.
Aug 15 00:36:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:36:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:36:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] No VIF found with MAC fa:16:3e:b9:64:22, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:36:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-40ce0684-01ca-48f7-90e1-38f926073a32 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.213s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:03 user nova-compute[73010]: DEBUG nova.compute.manager [req-ffc94709-e6b2-4acf-834b-f3e0282e2816 req-79cd5524-26ac-4099-9581-c0b28640d5ad service nova] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Received event network-vif-plugged-68f235d2-055a-40e8-a4ab-09e33974f4ac {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:36:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ffc94709-e6b2-4acf-834b-f3e0282e2816 req-79cd5524-26ac-4099-9581-c0b28640d5ad service nova] Acquiring lock "dde74512-c8c3-436c-a6dc-a9327340229e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ffc94709-e6b2-4acf-834b-f3e0282e2816 req-79cd5524-26ac-4099-9581-c0b28640d5ad service nova] Lock "dde74512-c8c3-436c-a6dc-a9327340229e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ffc94709-e6b2-4acf-834b-f3e0282e2816 req-79cd5524-26ac-4099-9581-c0b28640d5ad service nova] Lock "dde74512-c8c3-436c-a6dc-a9327340229e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:03 user nova-compute[73010]: DEBUG nova.compute.manager [req-ffc94709-e6b2-4acf-834b-f3e0282e2816 req-79cd5524-26ac-4099-9581-c0b28640d5ad service nova] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] No waiting events found dispatching network-vif-plugged-68f235d2-055a-40e8-a4ab-09e33974f4ac {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:36:03 user nova-compute[73010]: WARNING nova.compute.manager [req-ffc94709-e6b2-4acf-834b-f3e0282e2816 req-79cd5524-26ac-4099-9581-c0b28640d5ad service nova] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Received unexpected event network-vif-plugged-68f235d2-055a-40e8-a4ab-09e33974f4ac for instance with vm_state building and task_state spawning.
Aug 15 00:36:03 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059763.7689395, dde74512-c8c3-436c-a6dc-a9327340229e => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:36:03 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] VM Resumed (Lifecycle Event)
Aug 15 00:36:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:36:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:36:03 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Instance spawned successfully.
Aug 15 00:36:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:36:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:36:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:36:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:36:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:36:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:36:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:36:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:36:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:36:03 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:36:03 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059763.7705703, dde74512-c8c3-436c-a6dc-a9327340229e => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:36:03 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] VM Started (Lifecycle Event)
Aug 15 00:36:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:36:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:36:03 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:36:03 user nova-compute[73010]: INFO nova.compute.manager [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Took 6.76 seconds to spawn the instance on the hypervisor.
Aug 15 00:36:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:36:04 user nova-compute[73010]: DEBUG nova.compute.manager [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Stashing vm_state: active {{(pid=73010) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 15 00:36:04 user nova-compute[73010]: INFO nova.compute.manager [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Took 7.73 seconds to build instance.
Aug 15 00:36:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ef29c79a-b1b3-49b8-9025-20e5dcf0cec0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "dde74512-c8c3-436c-a6dc-a9327340229e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.878s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:04 user nova-compute[73010]: DEBUG nova.objects.instance [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lazy-loading 'pci_requests' on Instance uuid 983577b5-4abb-4280-b8e8-a63f42d8f796 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:36:04 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:36:04 user nova-compute[73010]: INFO nova.compute.claims [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Claim successful on node user
Aug 15 00:36:04 user nova-compute[73010]: DEBUG nova.objects.instance [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lazy-loading 'resources' on Instance uuid 983577b5-4abb-4280-b8e8-a63f42d8f796 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:36:04 user nova-compute[73010]: DEBUG nova.objects.instance [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lazy-loading 'pci_devices' on Instance uuid 983577b5-4abb-4280-b8e8-a63f42d8f796 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:36:04 user nova-compute[73010]: INFO nova.compute.resource_tracker [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Updating resource usage from migration 29f41887-4ebb-4d2f-a4e9-270027a77f26
Aug 15 00:36:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:04 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:36:04 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:36:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.513s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:04 user nova-compute[73010]: INFO nova.compute.manager [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Migrating
Aug 15 00:36:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:36:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:36:04 user nova-compute[73010]: INFO nova.compute.rpcapi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 15 00:36:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:36:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:36:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquired lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:36:04 user nova-compute[73010]: DEBUG nova.network.neutron [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:36:05 user nova-compute[73010]: DEBUG nova.network.neutron [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Updating instance_info_cache with network_info: [{"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:36:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Releasing lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:36:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Starting migrate_disk_and_power_off {{(pid=73010) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 15 00:36:06 user nova-compute[73010]: DEBUG nova.objects.instance [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'flavor' on Instance uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:36:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "refresh_cache-afcd0a05-e035-492e-9fbe-cd63f4c3ea42" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:36:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquired lock "refresh_cache-afcd0a05-e035-492e-9fbe-cd63f4c3ea42" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:36:06 user nova-compute[73010]: DEBUG nova.network.neutron [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:36:06 user nova-compute[73010]: DEBUG nova.objects.instance [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'info_cache' on Instance uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:36:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-c330e5bd-c676-4c24-96dc-bf0905c6578a req-d971f957-db3c-49fb-8f98-b255c5617186 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received event network-vif-unplugged-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:36:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c330e5bd-c676-4c24-96dc-bf0905c6578a req-d971f957-db3c-49fb-8f98-b255c5617186 service nova] Acquiring lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c330e5bd-c676-4c24-96dc-bf0905c6578a req-d971f957-db3c-49fb-8f98-b255c5617186 service nova] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c330e5bd-c676-4c24-96dc-bf0905c6578a req-d971f957-db3c-49fb-8f98-b255c5617186 service nova] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-c330e5bd-c676-4c24-96dc-bf0905c6578a req-d971f957-db3c-49fb-8f98-b255c5617186 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] No waiting events found dispatching network-vif-unplugged-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:36:06 user nova-compute[73010]: WARNING nova.compute.manager [req-c330e5bd-c676-4c24-96dc-bf0905c6578a req-d971f957-db3c-49fb-8f98-b255c5617186 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received unexpected event network-vif-unplugged-ba4444c9-ca0d-4265-a567-f931f42b3115 for instance with vm_state active and task_state resize_migrating.
Aug 15 00:36:06 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Instance destroyed successfully.
Aug 15 00:36:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1216295700',display_name='tempest-ServerActionsTestOtherB-server-1216295700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1216295700',id=2,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVoikkIiX9fqlWUgAuNi/64W1pPax2fim7TT4ZilB7kZJFBTddrjL8mZ+9EedRXSwMMm3xZIb3UP53hHNu173Z0/TxgKI44bIEdZkISEoJSalzaVJQjVXA5W+j4ISJAVA==',key_name='tempest-keypair-1664333158',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:32:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1588cfc0b04643a881de076bea2e23b5',ramdisk_id='',reservation_id='r-t3ok78f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-594907864',owner_user_name='tempest-ServerActionsTestOtherB-594907864-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5e4be2f71154849a225adb0628fa70e',uuid=983577b5-4abb-4280-b8e8-a63f42d8f796,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-176102819-network", "vif_mac": "fa:16:3e:b9:64:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:36:06 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Converting VIF {"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-176102819-network", "vif_mac": "fa:16:3e:b9:64:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:36:06 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:64:22,bridge_name='br-int',has_traffic_filtering=True,id=ba4444c9-ca0d-4265-a567-f931f42b3115,network=Network(25ddd6d0-e3f6-4a35-b15f-a41da18091ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4444c9-ca') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:36:06 user nova-compute[73010]: DEBUG os_vif [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:64:22,bridge_name='br-int',has_traffic_filtering=True,id=ba4444c9-ca0d-4265-a567-f931f42b3115,network=Network(25ddd6d0-e3f6-4a35-b15f-a41da18091ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4444c9-ca') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:36:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba4444c9-ca, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:36:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:36:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:06 user nova-compute[73010]: INFO os_vif [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:64:22,bridge_name='br-int',has_traffic_filtering=True,id=ba4444c9-ca0d-4265-a567-f931f42b3115,network=Network(25ddd6d0-e3f6-4a35-b15f-a41da18091ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4444c9-ca')
Aug 15 00:36:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AZTKRHrL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:36:07 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dea8df-aead-4ec1-94bb-682c2e863ebd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e29edbf-cc6e-44b1-ae75-3d380caea6b6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:36:07 user nova-compute[73010]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:36:07 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:36:07 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:36:07 user nova-compute[73010]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:36:07 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:36:07 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec506a5b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4'): ({'sdc'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Removing single pathed devices sdc {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[605fcbab-425f-4e8e-8fd5-b9f047389d14]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f025d35e-9e07-4f91-904b-74d9b5a4d50a]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Flushing IO for device /dev/sdc {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32fb5df-816f-47ca-86f4-5c8b324b5964]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[59902502-3d0e-45b1-bc75-3ad41666fd6c]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] SCSI volumes sdc have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f063e0-ec5f-4a51-bbb1-e5c861d48f49]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a12030-168b-4043-93c3-966e87c86d16]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4, portal: 172.16.0.220,3260]
Aug 15 00:36:07 user nova-compute[73010]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4, portal: 172.16.0.220,3260] successful.
Aug 15 00:36:07 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6dc672-654b-4035-81a8-e0a8bd2daf96]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] <== disconnect_volume: return (357ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG nova.network.neutron [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Updating instance_info_cache with network_info: [{"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Releasing lock "refresh_cache-afcd0a05-e035-492e-9fbe-cd63f4c3ea42" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:36:07 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Instance destroyed successfully.
Aug 15 00:36:07 user nova-compute[73010]: DEBUG nova.objects.instance [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'resources' on Instance uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1899570606',display_name='tempest-AttachVolumeTestJSON-server-1899570606',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1899570606',id=3,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMV9Ia1g6S1Dqv5u52uv7YpM19NUmr26Hj+tCSO6tG0aZL4zk5VCqdKIe6IWKX3KiHIXyqR1c1NApawOfSvd8OOhU+aA7fYaPBkxC185NYPaDo0+I9Vsdwf99lfNe8lrhw==',key_name='tempest-keypair-1489578241',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:32:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e50aaf528c8c4d4ba8d39b3b203b5a52',ramdisk_id='',reservation_id='r-abzuan7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-338922600',owner_user_name='tempest-AttachVolumeTestJSON-338922600-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:34:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53c8150819854d29b1d8c865da2642ca',uuid=afcd0a05-e035-492e-9fbe-cd63f4c3ea42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Converting VIF {"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:68:0b,bridge_name='br-int',has_traffic_filtering=True,id=2f2b345b-67b5-4d95-bbd3-3fe48aafaee5,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b345b-67') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_vif [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:68:0b,bridge_name='br-int',has_traffic_filtering=True,id=2f2b345b-67b5-4d95-bbd3-3fe48aafaee5,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b345b-67') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f2b345b-67, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:36:07 user nova-compute[73010]: INFO os_vif [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:68:0b,bridge_name='br-int',has_traffic_filtering=True,id=2f2b345b-67b5-4d95-bbd3-3fe48aafaee5,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b345b-67')
Aug 15 00:36:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpgnlPGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:36:07 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796_resize/disk /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe9efd9-565e-4034-ba19-29df1a990a30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed93b28d-ca76-4cb3-984d-f7ed44a37685]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:36:07 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:36:07 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:36:07 user nova-compute[73010]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:36:07 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec305eb250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c'): ({'sdh'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Removing single pathed devices sdh {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e0b895-5a2e-4d0c-b00a-5ac7238ea558]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.028s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[15345aa3-db1e-40de-b118-587185181296]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Flushing IO for device /dev/sdh {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:36:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7011ab0-c8ad-47d3-b539-e255512e2d72]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.052s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9d8009-4b14-4d40-870a-6a6e5abef557]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] SCSI volumes sdh have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba87acc9-ddd2-4957-a21a-24620c640c69]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c64851d-f952-4192-8b77-c972a37558ed]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c, portal: 172.16.0.220,3260]
Aug 15 00:36:08 user nova-compute[73010]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c, portal: 172.16.0.220,3260] successful.
Aug 15 00:36:08 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6f6dd2-d6ed-4827-b3de-8fcf518270b2]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] <== disconnect_volume: return (395ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Start _get_guest_xml network_info=[{"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpgnlPGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'afcd0a05-e035-492e-9fbe-cd63f4c3ea42', 'attached_at': '', 'detached_at': '', 'volume_id': '4b15bb6b-3a19-4857-b779-8264e831296c', 'serial': '4b15bb6b-3a19-4857-b779-8264e831296c'}, 'disk_bus': 'virtio', 'attachment_id': '003e98d1-db2c-4c3b-817b-cd700878d40f', 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG nova.objects.instance [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'numa_topology' on Instance uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:36:08 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:36:08 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:36:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG nova.objects.instance [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'vcpu_model' on Instance uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpgnlPGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:36:08 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:36:08 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:36:08 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] CMD "cp -r /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796_resize/disk /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk" returned: 0 in 0.512s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796_resize/disk.info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk.info {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fc3687-b385-44c9-8c3d-01d09f523fec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] CMD "cp -r /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796_resize/disk.info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk.info" returned: 0 in 0.042s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:36:08 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ca35c8-85e7-4062-b022-7091a131802d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c] added
Aug 15 00:36:08 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9272a5-5f19-4ed7-8d9a-a9a583d67a7c]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[990afe50-cfb2-43b1-b02c-924eba88f428]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EpgnlPGB {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EpgnlPGB" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7451be-f47b-4e74-b3f4-42e05441b5cc]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EpgnlPGB'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[575c627f-3df2-4743-8e4f-8318be5b02b8]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bff8ce9-65b0-4502-bc14-da0c56c82589]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:36:08 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:36:08 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3978e1-17c8-491f-a48a-e429cda468da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c, portal: 172.16.0.220,3260]
Aug 15 00:36:08 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c, portal: 172.16.0.220,3260] successful.
Aug 15 00:36:08 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bbcdeb-49c1-49c1-9570-93127d483aaa]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77f352f-f936-4751-b3f3-d5c09a321b74]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:36:08 user nova-compute[73010]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:36:08 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:36:08 user nova-compute[73010]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:36:08 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a6fc25-aada-406d-97a8-98252f8b289f]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: None {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b3c3872e-73f3-4805-95be-375003072828 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Acquiring lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b3c3872e-73f3-4805-95be-375003072828 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b3c3872e-73f3-4805-95be-375003072828 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Acquiring lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b3c3872e-73f3-4805-95be-375003072828 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b3c3872e-73f3-4805-95be-375003072828 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:08 user nova-compute[73010]: INFO nova.compute.manager [None req-b3c3872e-73f3-4805-95be-375003072828 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Terminating instance
Aug 15 00:36:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-b3c3872e-73f3-4805-95be-375003072828 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG nova.compute.manager [req-c954d21a-2012-4e73-a73b-51ca8794f2da req-69870d4c-b6e9-4010-9045-5196e9824bca service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received event network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c954d21a-2012-4e73-a73b-51ca8794f2da req-69870d4c-b6e9-4010-9045-5196e9824bca service nova] Acquiring lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c954d21a-2012-4e73-a73b-51ca8794f2da req-69870d4c-b6e9-4010-9045-5196e9824bca service nova] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c954d21a-2012-4e73-a73b-51ca8794f2da req-69870d4c-b6e9-4010-9045-5196e9824bca service nova] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:08 user nova-compute[73010]: DEBUG nova.compute.manager [req-c954d21a-2012-4e73-a73b-51ca8794f2da req-69870d4c-b6e9-4010-9045-5196e9824bca service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] No waiting events found dispatching network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:36:08 user nova-compute[73010]: WARNING nova.compute.manager [req-c954d21a-2012-4e73-a73b-51ca8794f2da req-69870d4c-b6e9-4010-9045-5196e9824bca service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received unexpected event network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 for instance with vm_state active and task_state resize_migrating.
Aug 15 00:36:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG nova.compute.manager [req-c9e4b373-74d4-46c4-8985-378df91ecd36 req-17b2dc25-0e5f-4759-96fa-c4941dd6ca95 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Received event network-vif-unplugged-cd4cdfd2-7917-4c56-b348-6856691dec61 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c9e4b373-74d4-46c4-8985-378df91ecd36 req-17b2dc25-0e5f-4759-96fa-c4941dd6ca95 service nova] Acquiring lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c9e4b373-74d4-46c4-8985-378df91ecd36 req-17b2dc25-0e5f-4759-96fa-c4941dd6ca95 service nova] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c9e4b373-74d4-46c4-8985-378df91ecd36 req-17b2dc25-0e5f-4759-96fa-c4941dd6ca95 service nova] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG nova.compute.manager [req-c9e4b373-74d4-46c4-8985-378df91ecd36 req-17b2dc25-0e5f-4759-96fa-c4941dd6ca95 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] No waiting events found dispatching network-vif-unplugged-cd4cdfd2-7917-4c56-b348-6856691dec61 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG nova.compute.manager [req-c9e4b373-74d4-46c4-8985-378df91ecd36 req-17b2dc25-0e5f-4759-96fa-c4941dd6ca95 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Received event network-vif-unplugged-cd4cdfd2-7917-4c56-b348-6856691dec61 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpgnlPGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.466s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] <== connect_volume: return (1468ms) {'type': 'block', 'scsi_wwn': '26330346331363330', 'path': '/dev/sdc'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330346331363330', 'path': '/dev/sdc'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:09 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Instance destroyed successfully.
Aug 15 00:36:09 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b3c3872e-73f3-4805-95be-375003072828 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lazy-loading 'resources' on Instance uuid b1d5a938-3f1e-4e8c-bdda-0786d4e27d98 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1899570606',display_name='tempest-AttachVolumeTestJSON-server-1899570606',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1899570606',id=3,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMV9Ia1g6S1Dqv5u52uv7YpM19NUmr26Hj+tCSO6tG0aZL4zk5VCqdKIe6IWKX3KiHIXyqR1c1NApawOfSvd8OOhU+aA7fYaPBkxC185NYPaDo0+I9Vsdwf99lfNe8lrhw==',key_name='tempest-keypair-1489578241',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:32:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e50aaf528c8c4d4ba8d39b3b203b5a52',ramdisk_id='',reservation_id='r-abzuan7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-338922600',owner_user_name='tempest-AttachVolumeTestJSON-338922600-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:34:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53c8150819854d29b1d8c865da2642ca',uuid=afcd0a05-e035-492e-9fbe-cd63f4c3ea42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Converting VIF {"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:68:0b,bridge_name='br-int',has_traffic_filtering=True,id=2f2b345b-67b5-4d95-bbd3-3fe48aafaee5,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b345b-67') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG nova.objects.instance [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'pci_devices' on Instance uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-b3c3872e-73f3-4805-95be-375003072828 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1646459107',display_name='tempest-TestVolumeSwap-server-1646459107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1646459107',id=7,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPZCXzXUJ0htBJqMWP6P6MyY9g5dh/fzIuEqPI8plA6qru3b/nkjxS3WeOwFI+KnsXdNXkswJPHrFRld3VpQ/esCeSkMfxmCUU0WQL51iNxfK9OyyiDKuxURsclckqszw==',key_name='tempest-keypair-245191451',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:32:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='331f005ccb394d18a5ec723b1a94bf73',ramdisk_id='',reservation_id='r-tg61aa3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1341975594',owner_user_name='tempest-TestVolumeSwap-1341975594-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:32:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f76161fed446bf9ebf53beef8dc0d0',uuid=b1d5a938-3f1e-4e8c-bdda-0786d4e27d98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd4cdfd2-7917-4c56-b348-6856691dec61", "address": "fa:16:3e:19:09:43", "network": {"id": "af43fc40-99df-4eac-b5f1-c481b6de298a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378376468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331f005ccb394d18a5ec723b1a94bf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4cdfd2-79", "ovs_interfaceid": "cd4cdfd2-7917-4c56-b348-6856691dec61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b3c3872e-73f3-4805-95be-375003072828 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Converting VIF {"id": "cd4cdfd2-7917-4c56-b348-6856691dec61", "address": "fa:16:3e:19:09:43", "network": {"id": "af43fc40-99df-4eac-b5f1-c481b6de298a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378376468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331f005ccb394d18a5ec723b1a94bf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd4cdfd2-79", "ovs_interfaceid": "cd4cdfd2-7917-4c56-b348-6856691dec61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b3c3872e-73f3-4805-95be-375003072828 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:09:43,bridge_name='br-int',has_traffic_filtering=True,id=cd4cdfd2-7917-4c56-b348-6856691dec61,network=Network(af43fc40-99df-4eac-b5f1-c481b6de298a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd4cdfd2-79') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG os_vif [None req-b3c3872e-73f3-4805-95be-375003072828 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:09:43,bridge_name='br-int',has_traffic_filtering=True,id=cd4cdfd2-7917-4c56-b348-6856691dec61,network=Network(af43fc40-99df-4eac-b5f1-c481b6de298a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd4cdfd2-79') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd4cdfd2-79, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:36:09 user nova-compute[73010]:   <uuid>afcd0a05-e035-492e-9fbe-cd63f4c3ea42</uuid>
Aug 15 00:36:09 user nova-compute[73010]:   <name>instance-00000003</name>
Aug 15 00:36:09 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:36:09 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:36:09 user nova-compute[73010]:   <metadata>
Aug 15 00:36:09 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:36:09 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:36:09 user nova-compute[73010]:       <nova:name>tempest-AttachVolumeTestJSON-server-1899570606</nova:name>
Aug 15 00:36:09 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:36:08</nova:creationTime>
Aug 15 00:36:09 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:36:09 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:36:09 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:36:09 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:36:09 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:36:09 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:36:09 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:36:09 user nova-compute[73010]:       <nova:owner>
Aug 15 00:36:09 user nova-compute[73010]:         <nova:user uuid="53c8150819854d29b1d8c865da2642ca">tempest-AttachVolumeTestJSON-338922600-project-member</nova:user>
Aug 15 00:36:09 user nova-compute[73010]:         <nova:project uuid="e50aaf528c8c4d4ba8d39b3b203b5a52">tempest-AttachVolumeTestJSON-338922600</nova:project>
Aug 15 00:36:09 user nova-compute[73010]:       </nova:owner>
Aug 15 00:36:09 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:36:09 user nova-compute[73010]:       <nova:ports>
Aug 15 00:36:09 user nova-compute[73010]:         <nova:port uuid="2f2b345b-67b5-4d95-bbd3-3fe48aafaee5">
Aug 15 00:36:09 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 00:36:09 user nova-compute[73010]:         </nova:port>
Aug 15 00:36:09 user nova-compute[73010]:       </nova:ports>
Aug 15 00:36:09 user nova-compute[73010]:     </nova:instance>
Aug 15 00:36:09 user nova-compute[73010]:   </metadata>
Aug 15 00:36:09 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:36:09 user nova-compute[73010]:     <system>
Aug 15 00:36:09 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:36:09 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:36:09 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:36:09 user nova-compute[73010]:       <entry name="serial">afcd0a05-e035-492e-9fbe-cd63f4c3ea42</entry>
Aug 15 00:36:09 user nova-compute[73010]:       <entry name="uuid">afcd0a05-e035-492e-9fbe-cd63f4c3ea42</entry>
Aug 15 00:36:09 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:36:09 user nova-compute[73010]:     </system>
Aug 15 00:36:09 user nova-compute[73010]:   </sysinfo>
Aug 15 00:36:09 user nova-compute[73010]:   <os>
Aug 15 00:36:09 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:36:09 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:36:09 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:36:09 user nova-compute[73010]:   </os>
Aug 15 00:36:09 user nova-compute[73010]:   <features>
Aug 15 00:36:09 user nova-compute[73010]:     <acpi/>
Aug 15 00:36:09 user nova-compute[73010]:     <apic/>
Aug 15 00:36:09 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:36:09 user nova-compute[73010]:   </features>
Aug 15 00:36:09 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:36:09 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:36:09 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:36:09 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:36:09 user nova-compute[73010]:   </clock>
Aug 15 00:36:09 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:36:09 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:36:09 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:36:09 user nova-compute[73010]:   </cpu>
Aug 15 00:36:09 user nova-compute[73010]:   <devices>
Aug 15 00:36:09 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:36:09 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:36:09 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk"/>
Aug 15 00:36:09 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:36:09 user nova-compute[73010]:     </disk>
Aug 15 00:36:09 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 00:36:09 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:36:09 user nova-compute[73010]:       <source dev="/dev/sdc"/>
Aug 15 00:36:09 user nova-compute[73010]:       <target dev="vdb" bus="virtio"/>
Aug 15 00:36:09 user nova-compute[73010]:       <serial>4b15bb6b-3a19-4857-b779-8264e831296c</serial>
Aug 15 00:36:09 user nova-compute[73010]:     </disk>
Aug 15 00:36:09 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:36:09 user nova-compute[73010]:       <mac address="fa:16:3e:7b:68:0b"/>
Aug 15 00:36:09 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:36:09 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:36:09 user nova-compute[73010]:       <target dev="tap2f2b345b-67"/>
Aug 15 00:36:09 user nova-compute[73010]:     </interface>
Aug 15 00:36:09 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:36:09 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/console.log" append="off"/>
Aug 15 00:36:09 user nova-compute[73010]:     </serial>
Aug 15 00:36:09 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:36:09 user nova-compute[73010]:     <video>
Aug 15 00:36:09 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:36:09 user nova-compute[73010]:     </video>
Aug 15 00:36:09 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:36:09 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:36:09 user nova-compute[73010]:     </rng>
Aug 15 00:36:09 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:36:09 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:36:09 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:36:09 user nova-compute[73010]:     </memballoon>
Aug 15 00:36:09 user nova-compute[73010]:   </devices>
Aug 15 00:36:09 user nova-compute[73010]: </domain>
Aug 15 00:36:09 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:36:09 user nova-compute[73010]: INFO os_vif [None req-b3c3872e-73f3-4805-95be-375003072828 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:09:43,bridge_name='br-int',has_traffic_filtering=True,id=cd4cdfd2-7917-4c56-b348-6856691dec61,network=Network(af43fc40-99df-4eac-b5f1-c481b6de298a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd4cdfd2-79')
Aug 15 00:36:09 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-b3c3872e-73f3-4805-95be-375003072828 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Deleting instance files /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98_del
Aug 15 00:36:09 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-b3c3872e-73f3-4805-95be-375003072828 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Deletion of /opt/stack/data/nova/instances/b1d5a938-3f1e-4e8c-bdda-0786d4e27d98_del complete
Aug 15 00:36:10 user nova-compute[73010]: DEBUG nova.network.neutron [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Port ba4444c9-ca0d-4265-a567-f931f42b3115 binding to destination host user is already ACTIVE {{(pid=73010) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:10 user nova-compute[73010]: INFO nova.compute.manager [None req-b3c3872e-73f3-4805-95be-375003072828 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Took 1.42 seconds to destroy the instance on the hypervisor.
Aug 15 00:36:10 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-b3c3872e-73f3-4805-95be-375003072828 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG nova.objects.instance [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'trusted_certs' on Instance uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquired lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG nova.network.neutron [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.271s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Checking if we can resize image /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Cannot resize image /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG nova.objects.instance [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'migration_context' on Instance uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1899570606',display_name='tempest-AttachVolumeTestJSON-server-1899570606',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1899570606',id=3,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMV9Ia1g6S1Dqv5u52uv7YpM19NUmr26Hj+tCSO6tG0aZL4zk5VCqdKIe6IWKX3KiHIXyqR1c1NApawOfSvd8OOhU+aA7fYaPBkxC185NYPaDo0+I9Vsdwf99lfNe8lrhw==',key_name='tempest-keypair-1489578241',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:32:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='e50aaf528c8c4d4ba8d39b3b203b5a52',ramdisk_id='',reservation_id='r-abzuan7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-338922600',owner_user_name='tempest-AttachVolumeTestJSON-338922600-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:34:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53c8150819854d29b1d8c865da2642ca',uuid=afcd0a05-e035-492e-9fbe-cd63f4c3ea42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Converting VIF {"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:68:0b,bridge_name='br-int',has_traffic_filtering=True,id=2f2b345b-67b5-4d95-bbd3-3fe48aafaee5,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b345b-67') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG os_vif [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:68:0b,bridge_name='br-int',has_traffic_filtering=True,id=2f2b345b-67b5-4d95-bbd3-3fe48aafaee5,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b345b-67') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:36:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f2b345b-67, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2f2b345b-67, col_values=(('external_ids', {'iface-id': '2f2b345b-67b5-4d95-bbd3-3fe48aafaee5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:68:0b', 'vm-uuid': 'afcd0a05-e035-492e-9fbe-cd63f4c3ea42'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:11 user nova-compute[73010]: INFO os_vif [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:68:0b,bridge_name='br-int',has_traffic_filtering=True,id=2f2b345b-67b5-4d95-bbd3-3fe48aafaee5,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b345b-67')
Aug 15 00:36:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-f75d49b1-2319-42a8-8be6-ce4ba596a807 req-985349ae-ba11-4a5a-bed5-7e8d4af78f66 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Received event network-vif-plugged-cd4cdfd2-7917-4c56-b348-6856691dec61 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f75d49b1-2319-42a8-8be6-ce4ba596a807 req-985349ae-ba11-4a5a-bed5-7e8d4af78f66 service nova] Acquiring lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f75d49b1-2319-42a8-8be6-ce4ba596a807 req-985349ae-ba11-4a5a-bed5-7e8d4af78f66 service nova] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f75d49b1-2319-42a8-8be6-ce4ba596a807 req-985349ae-ba11-4a5a-bed5-7e8d4af78f66 service nova] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-f75d49b1-2319-42a8-8be6-ce4ba596a807 req-985349ae-ba11-4a5a-bed5-7e8d4af78f66 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] No waiting events found dispatching network-vif-plugged-cd4cdfd2-7917-4c56-b348-6856691dec61 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:36:11 user nova-compute[73010]: WARNING nova.compute.manager [req-f75d49b1-2319-42a8-8be6-ce4ba596a807 req-985349ae-ba11-4a5a-bed5-7e8d4af78f66 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Received unexpected event network-vif-plugged-cd4cdfd2-7917-4c56-b348-6856691dec61 for instance with vm_state active and task_state deleting.
Aug 15 00:36:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-f75d49b1-2319-42a8-8be6-ce4ba596a807 req-985349ae-ba11-4a5a-bed5-7e8d4af78f66 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Received event network-vif-plugged-cd4cdfd2-7917-4c56-b348-6856691dec61 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f75d49b1-2319-42a8-8be6-ce4ba596a807 req-985349ae-ba11-4a5a-bed5-7e8d4af78f66 service nova] Acquiring lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f75d49b1-2319-42a8-8be6-ce4ba596a807 req-985349ae-ba11-4a5a-bed5-7e8d4af78f66 service nova] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f75d49b1-2319-42a8-8be6-ce4ba596a807 req-985349ae-ba11-4a5a-bed5-7e8d4af78f66 service nova] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-f75d49b1-2319-42a8-8be6-ce4ba596a807 req-985349ae-ba11-4a5a-bed5-7e8d4af78f66 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] No waiting events found dispatching network-vif-plugged-cd4cdfd2-7917-4c56-b348-6856691dec61 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:36:11 user nova-compute[73010]: WARNING nova.compute.manager [req-f75d49b1-2319-42a8-8be6-ce4ba596a807 req-985349ae-ba11-4a5a-bed5-7e8d4af78f66 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Received unexpected event network-vif-plugged-cd4cdfd2-7917-4c56-b348-6856691dec61 for instance with vm_state active and task_state deleting.
Aug 15 00:36:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-f75d49b1-2319-42a8-8be6-ce4ba596a807 req-985349ae-ba11-4a5a-bed5-7e8d4af78f66 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Received event network-vif-plugged-cd4cdfd2-7917-4c56-b348-6856691dec61 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f75d49b1-2319-42a8-8be6-ce4ba596a807 req-985349ae-ba11-4a5a-bed5-7e8d4af78f66 service nova] Acquiring lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f75d49b1-2319-42a8-8be6-ce4ba596a807 req-985349ae-ba11-4a5a-bed5-7e8d4af78f66 service nova] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f75d49b1-2319-42a8-8be6-ce4ba596a807 req-985349ae-ba11-4a5a-bed5-7e8d4af78f66 service nova] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-f75d49b1-2319-42a8-8be6-ce4ba596a807 req-985349ae-ba11-4a5a-bed5-7e8d4af78f66 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] No waiting events found dispatching network-vif-plugged-cd4cdfd2-7917-4c56-b348-6856691dec61 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:36:11 user nova-compute[73010]: WARNING nova.compute.manager [req-f75d49b1-2319-42a8-8be6-ce4ba596a807 req-985349ae-ba11-4a5a-bed5-7e8d4af78f66 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Received unexpected event network-vif-plugged-cd4cdfd2-7917-4c56-b348-6856691dec61 for instance with vm_state active and task_state deleting.
Aug 15 00:36:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-f75d49b1-2319-42a8-8be6-ce4ba596a807 req-985349ae-ba11-4a5a-bed5-7e8d4af78f66 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Received event network-vif-unplugged-cd4cdfd2-7917-4c56-b348-6856691dec61 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f75d49b1-2319-42a8-8be6-ce4ba596a807 req-985349ae-ba11-4a5a-bed5-7e8d4af78f66 service nova] Acquiring lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f75d49b1-2319-42a8-8be6-ce4ba596a807 req-985349ae-ba11-4a5a-bed5-7e8d4af78f66 service nova] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f75d49b1-2319-42a8-8be6-ce4ba596a807 req-985349ae-ba11-4a5a-bed5-7e8d4af78f66 service nova] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-f75d49b1-2319-42a8-8be6-ce4ba596a807 req-985349ae-ba11-4a5a-bed5-7e8d4af78f66 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] No waiting events found dispatching network-vif-unplugged-cd4cdfd2-7917-4c56-b348-6856691dec61 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-f75d49b1-2319-42a8-8be6-ce4ba596a807 req-985349ae-ba11-4a5a-bed5-7e8d4af78f66 service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Received event network-vif-unplugged-cd4cdfd2-7917-4c56-b348-6856691dec61 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG nova.network.neutron [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Updating instance_info_cache with network_info: [{"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Releasing lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG os_brick.utils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[518c663a-f613-49ac-8f28-8f4dae079d29]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a177dfda-ce15-4fbb-a6b8-97cc9532596b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53c9606-3136-4f5b-afa9-a371b0542384]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d278af-ddda-49ca-87ce-56c708bd9886]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:36:11 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:36:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74ea158-fcfa-4a23-a854-148f2f2168ba]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:36:11 user nova-compute[73010]: DEBUG os_brick.utils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZOHEFScf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:36:12 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:36:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:36:12 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:36:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:36:12 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e77981-cb8a-4b33-8ec8-b0c27f05e3de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:36:12 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.046s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d80d82-eb97-4681-8798-6086e1e04398]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7] added
Aug 15 00:36:12 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-478c25bd-2bf8-4590-a5c7-dba65c649972 req-b0bfefe8-807d-4681-8c20-3448f1718e5f service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Received event network-vif-deleted-cd4cdfd2-7917-4c56-b348-6856691dec61 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:36:12 user nova-compute[73010]: INFO nova.compute.manager [req-478c25bd-2bf8-4590-a5c7-dba65c649972 req-b0bfefe8-807d-4681-8c20-3448f1718e5f service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Neutron deleted interface cd4cdfd2-7917-4c56-b348-6856691dec61; detaching it from the instance and deleting it from the info cache
Aug 15 00:36:12 user nova-compute[73010]: DEBUG nova.network.neutron [req-478c25bd-2bf8-4590-a5c7-dba65c649972 req-b0bfefe8-807d-4681-8c20-3448f1718e5f service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb112072-4919-454e-a5ea-47111785abfd]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:12 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Took 2.17 seconds to deallocate network for instance.
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa623c78-c6e0-49d1-8821-bc766daf9400]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZOHEFScf {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-478c25bd-2bf8-4590-a5c7-dba65c649972 req-b0bfefe8-807d-4681-8c20-3448f1718e5f service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Detach interface failed, port_id=cd4cdfd2-7917-4c56-b348-6856691dec61, reason: Instance b1d5a938-3f1e-4e8c-bdda-0786d4e27d98 could not be found. {{(pid=73010) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZOHEFScf" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[107403c6-ad0a-48a1-a9db-1959ef34f9c2]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZOHEFScf'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5f8a52-25bc-40ba-83ac-c00f8b8c5473]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b3c3872e-73f3-4805-95be-375003072828 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b3c3872e-73f3-4805-95be-375003072828 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cec035f-fd38-4ca5-a495-0c868cf8cec0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:36:12 user nova-compute[73010]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:36:12 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:36:12 user nova-compute[73010]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:36:12 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1290c94-6308-44ba-bfb9-40b02ca911e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7, portal: 172.16.0.220,3260]
Aug 15 00:36:12 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7, portal: 172.16.0.220,3260] successful.
Aug 15 00:36:12 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea63e4b2-6c9b-4823-8f34-fae0b6d442d3]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a5ba12-b6cb-408f-b30c-a37b9df0f8dd]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:36:12 user nova-compute[73010]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:36:12 user nova-compute[73010]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 (non-flash)
Aug 15 00:36:12 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:36:12 user nova-compute[73010]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:36:12 user nova-compute[73010]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 (non-flash)
Aug 15 00:36:12 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.469s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52eddef-059b-4fe7-a640-9a3c789c04b4]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZOHEFScf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-b3c3872e-73f3-4805-95be-375003072828 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:36:12 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-b3c3872e-73f3-4805-95be-375003072828 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:36:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b3c3872e-73f3-4805-95be-375003072828 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.556s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:13 user nova-compute[73010]: DEBUG nova.compute.manager [req-ce1667ed-f839-4804-81c4-5ac005e29b82 req-b4237f76-7252-4b3e-862a-2f7acea2c1b2 service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received event network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:36:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ce1667ed-f839-4804-81c4-5ac005e29b82 req-b4237f76-7252-4b3e-862a-2f7acea2c1b2 service nova] Acquiring lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ce1667ed-f839-4804-81c4-5ac005e29b82 req-b4237f76-7252-4b3e-862a-2f7acea2c1b2 service nova] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ce1667ed-f839-4804-81c4-5ac005e29b82 req-b4237f76-7252-4b3e-862a-2f7acea2c1b2 service nova] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:13 user nova-compute[73010]: DEBUG nova.compute.manager [req-ce1667ed-f839-4804-81c4-5ac005e29b82 req-b4237f76-7252-4b3e-862a-2f7acea2c1b2 service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] No waiting events found dispatching network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:36:13 user nova-compute[73010]: WARNING nova.compute.manager [req-ce1667ed-f839-4804-81c4-5ac005e29b82 req-b4237f76-7252-4b3e-862a-2f7acea2c1b2 service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received unexpected event network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 for instance with vm_state stopped and task_state powering-on.
Aug 15 00:36:13 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-b3c3872e-73f3-4805-95be-375003072828 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Deleted allocations for instance b1d5a938-3f1e-4e8c-bdda-0786d4e27d98
Aug 15 00:36:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b3c3872e-73f3-4805-95be-375003072828 tempest-TestVolumeSwap-1341975594 tempest-TestVolumeSwap-1341975594-project-member] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.494s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:13 user nova-compute[73010]: DEBUG nova.compute.manager [req-19eb1ccf-fbe9-469a-8242-8e23df62b757 req-ee71d861-7971-456d-aa81-37fcbd9d6d4b service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Received event network-vif-plugged-cd4cdfd2-7917-4c56-b348-6856691dec61 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:36:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-19eb1ccf-fbe9-469a-8242-8e23df62b757 req-ee71d861-7971-456d-aa81-37fcbd9d6d4b service nova] Acquiring lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-19eb1ccf-fbe9-469a-8242-8e23df62b757 req-ee71d861-7971-456d-aa81-37fcbd9d6d4b service nova] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-19eb1ccf-fbe9-469a-8242-8e23df62b757 req-ee71d861-7971-456d-aa81-37fcbd9d6d4b service nova] Lock "b1d5a938-3f1e-4e8c-bdda-0786d4e27d98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:13 user nova-compute[73010]: DEBUG nova.compute.manager [req-19eb1ccf-fbe9-469a-8242-8e23df62b757 req-ee71d861-7971-456d-aa81-37fcbd9d6d4b service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] No waiting events found dispatching network-vif-plugged-cd4cdfd2-7917-4c56-b348-6856691dec61 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:36:13 user nova-compute[73010]: WARNING nova.compute.manager [req-19eb1ccf-fbe9-469a-8242-8e23df62b757 req-ee71d861-7971-456d-aa81-37fcbd9d6d4b service nova] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Received unexpected event network-vif-plugged-cd4cdfd2-7917-4c56-b348-6856691dec61 for instance with vm_state deleted and task_state None.
Aug 15 00:36:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.526s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:36:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] <== connect_volume: return (1528ms) {'type': 'block', 'scsi_wwn': '23733366236373134', 'path': '/dev/sdd'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:36:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733366236373134', 'path': '/dev/sdd'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:36:13 user nova-compute[73010]: DEBUG nova.objects.instance [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lazy-loading 'flavor' on Instance uuid da32613e-b1a9-4733-831f-e4fb1f34995f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:36:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:36:13 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:36:13 user nova-compute[73010]:   <source dev="/dev/sdd"/>
Aug 15 00:36:13 user nova-compute[73010]:   <target dev="vdc" bus="virtio"/>
Aug 15 00:36:13 user nova-compute[73010]:   <serial>0fc0fb03-0fad-4198-8399-7a55d328b0d7</serial>
Aug 15 00:36:13 user nova-compute[73010]: </disk>
Aug 15 00:36:13 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:36:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:36:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:36:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:36:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] No VIF found with MAC fa:16:3e:5a:3b:0f, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:36:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1c6c7e5e-0387-498c-86d7-374add3400ed tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.398s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-4e100ef1-185c-4545-9473-6d82f42fc187 req-6246f92e-6aac-4583-a246-b3cdfc77d305 service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received event network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:36:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4e100ef1-185c-4545-9473-6d82f42fc187 req-6246f92e-6aac-4583-a246-b3cdfc77d305 service nova] Acquiring lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4e100ef1-185c-4545-9473-6d82f42fc187 req-6246f92e-6aac-4583-a246-b3cdfc77d305 service nova] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4e100ef1-185c-4545-9473-6d82f42fc187 req-6246f92e-6aac-4583-a246-b3cdfc77d305 service nova] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-4e100ef1-185c-4545-9473-6d82f42fc187 req-6246f92e-6aac-4583-a246-b3cdfc77d305 service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] No waiting events found dispatching network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:36:15 user nova-compute[73010]: WARNING nova.compute.manager [req-4e100ef1-185c-4545-9473-6d82f42fc187 req-6246f92e-6aac-4583-a246-b3cdfc77d305 service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received unexpected event network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 for instance with vm_state stopped and task_state powering-on.
Aug 15 00:36:15 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059775.2403963, afcd0a05-e035-492e-9fbe-cd63f4c3ea42 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:36:15 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] VM Resumed (Lifecycle Event)
Aug 15 00:36:15 user nova-compute[73010]: DEBUG nova.compute.manager [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:36:15 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Instance rebooted successfully.
Aug 15 00:36:15 user nova-compute[73010]: DEBUG nova.compute.manager [None req-596e6e4c-5f38-44b7-b3ac-c73902f62f29 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:36:15 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:36:15 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:36:15 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 00:36:15 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059775.2452743, afcd0a05-e035-492e-9fbe-cd63f4c3ea42 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:36:15 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] VM Started (Lifecycle Event)
Aug 15 00:36:15 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:36:15 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:36:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Acquiring lock "da32613e-b1a9-4733-831f-e4fb1f34995f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:15 user nova-compute[73010]: INFO nova.compute.manager [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Detaching volume 0fc0fb03-0fad-4198-8399-7a55d328b0d7
Aug 15 00:36:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:15 user nova-compute[73010]: INFO nova.virt.block_device [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Attempting to driver detach volume 0fc0fb03-0fad-4198-8399-7a55d328b0d7 from mountpoint /dev/vdc
Aug 15 00:36:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Attempting to detach device vdc from instance da32613e-b1a9-4733-831f-e4fb1f34995f from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:36:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:36:15 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:36:15 user nova-compute[73010]:   <source dev="/dev/sdd"/>
Aug 15 00:36:15 user nova-compute[73010]:   <target dev="vdc" bus="virtio"/>
Aug 15 00:36:15 user nova-compute[73010]:   <serial>0fc0fb03-0fad-4198-8399-7a55d328b0d7</serial>
Aug 15 00:36:15 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 00:36:15 user nova-compute[73010]: </disk>
Aug 15 00:36:15 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:36:15 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Successfully detached device vdc from instance da32613e-b1a9-4733-831f-e4fb1f34995f from the persistent domain config.
Aug 15 00:36:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance da32613e-b1a9-4733-831f-e4fb1f34995f from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:36:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:36:15 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:36:15 user nova-compute[73010]:   <source dev="/dev/sdd"/>
Aug 15 00:36:15 user nova-compute[73010]:   <target dev="vdc" bus="virtio"/>
Aug 15 00:36:15 user nova-compute[73010]:   <serial>0fc0fb03-0fad-4198-8399-7a55d328b0d7</serial>
Aug 15 00:36:15 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 00:36:15 user nova-compute[73010]: </disk>
Aug 15 00:36:15 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692059776.4331186, da32613e-b1a9-4733-831f-e4fb1f34995f => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance da32613e-b1a9-4733-831f-e4fb1f34995f {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:36:16 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Successfully detached device vdc from instance da32613e-b1a9-4733-831f-e4fb1f34995f from the live domain config.
Aug 15 00:36:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZOHEFScf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:36:16 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:36:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf32ceea-701e-4c6b-b4ee-9f24c3b07083]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a102141-431f-462f-aa8f-24e0139e3953]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:36:16 user nova-compute[73010]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:36:16 user nova-compute[73010]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 (non-flash)
Aug 15 00:36:16 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:36:16 user nova-compute[73010]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:36:16 user nova-compute[73010]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 (non-flash)
Aug 15 00:36:16 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec305e2b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7'): ({'sdd'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Removing single pathed devices sdd {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[77da73d0-89cc-4604-955b-a779bbddf113]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2849ae8a-3caa-421e-88ac-7ce5ddbd805b]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Flushing IO for device /dev/sdd {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9054a97-4541-47d8-ba9e-1dd8450200bf]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f646be8d-b189-44d2-9fc6-9becc969576a]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] SCSI volumes sdd have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c40cbdd-94f0-4af6-94dd-214e8f921d8d]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[97af2191-872a-411d-91e4-559415ccd34e]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7, portal: 172.16.0.220,3260]
Aug 15 00:36:16 user nova-compute[73010]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7, portal: 172.16.0.220,3260] successful.
Aug 15 00:36:16 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc0fb03-0fad-4198-8399-7a55d328b0d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba828af-6cae-420d-90a7-e3ce4d2b1a59]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] <== disconnect_volume: return (315ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:36:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:36:17 user nova-compute[73010]: DEBUG nova.objects.instance [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lazy-loading 'flavor' on Instance uuid da32613e-b1a9-4733-831f-e4fb1f34995f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:36:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d86313e2-874d-4667-9f99-58f5cc1d9a10 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.808s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:21 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692059766.9391768, 983577b5-4abb-4280-b8e8-a63f42d8f796 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:36:21 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] VM Stopped (Lifecycle Event)
Aug 15 00:36:22 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f05fb1b8-a7be-4fb6-a816-c247da6d1dbd None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:36:22 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f05fb1b8-a7be-4fb6-a816-c247da6d1dbd None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:36:22 user nova-compute[73010]: INFO nova.compute.manager [None req-f05fb1b8-a7be-4fb6-a816-c247da6d1dbd None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 00:36:22 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Starting finish_migration {{(pid=73010) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 15 00:36:22 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Instance directory exists: not creating {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 00:36:22 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Creating image(s)
Aug 15 00:36:22 user nova-compute[73010]: DEBUG nova.objects.instance [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lazy-loading 'trusted_certs' on Instance uuid 983577b5-4abb-4280-b8e8-a63f42d8f796 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:36:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.196s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Checking if we can resize image /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk. size=21474836480 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk 21474836480 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk 21474836480" returned: 0 in 0.053s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Did not create local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Ensure instance console log exists: /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Start _get_guest_xml network_info=[{"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-176102819-network", "vif_mac": "fa:16:3e:b9:64:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AZTKRHrL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '983577b5-4abb-4280-b8e8-a63f42d8f796', 'attached_at': '2023-08-15T00:36:23.000000', 'detached_at': '', 'volume_id': 'e4ddadda-c939-425a-bcb3-4e454e0db7f4', 'serial': 'e4ddadda-c939-425a-bcb3-4e454e0db7f4'}, 'disk_bus': 'virtio', 'attachment_id': 'fad7c981-0f73-4243-8ecb-f4b697f77532', 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:23 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:36:23 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:36:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:28:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG nova.objects.instance [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lazy-loading 'vcpu_model' on Instance uuid 983577b5-4abb-4280-b8e8-a63f42d8f796 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AZTKRHrL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:36:23 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:36:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:36:23 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:36:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:36:23 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b7f91e-c9d0-40e0-9073-a8285c064a14]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:36:23 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba4a749-4c7c-4472-bde8-9f3d6f22d9be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4] added
Aug 15 00:36:23 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d8422b-2611-4288-8cca-a568b0f50a50]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd7f241-d600-41a2-99b5-4ea7bc25d85c]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AZTKRHrL {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AZTKRHrL" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e44317-faeb-47a1-abf1-b6f94aade09a]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AZTKRHrL'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a04fd62-643a-4cb6-ade5-856281eaf1a1]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1eb679a-6794-4e66-9696-8a18f2a6bd63]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:36:23 user nova-compute[73010]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:36:23 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:36:23 user nova-compute[73010]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:36:23 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb46c68-385e-4b13-b742-6c952bc44a2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4, portal: 172.16.0.220,3260]
Aug 15 00:36:23 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4, portal: 172.16.0.220,3260] successful.
Aug 15 00:36:23 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d2ec17-7a37-4605-a4cf-c5df7555d242]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31fecae-e2c5-4c52-ae5e-677ceac5da95]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:36:23 user nova-compute[73010]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:36:23 user nova-compute[73010]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:36:23 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:36:23 user nova-compute[73010]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:36:23 user nova-compute[73010]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:36:23 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:36:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.035s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:24 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e98b37-02a6-41f4-9004-31b022d51c2d]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:36:24 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:36:24 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AZTKRHrL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:36:24 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692059769.8223257, b1d5a938-3f1e-4e8c-bdda-0786d4e27d98 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:36:24 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] VM Stopped (Lifecycle Event)
Aug 15 00:36:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-a8e099c0-54e8-46f5-b48e-6dcccd01d510 None None] [instance: b1d5a938-3f1e-4e8c-bdda-0786d4e27d98] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:36:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:36:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '26466376665656565', 'path': '/dev/sdd'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:36:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466376665656565', 'path': '/dev/sdd'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:36:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1216295700',display_name='tempest-ServerActionsTestOtherB-server-1216295700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1216295700',id=2,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVoikkIiX9fqlWUgAuNi/64W1pPax2fim7TT4ZilB7kZJFBTddrjL8mZ+9EedRXSwMMm3xZIb3UP53hHNu173Z0/TxgKI44bIEdZkISEoJSalzaVJQjVXA5W+j4ISJAVA==',key_name='tempest-keypair-1664333158',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:32:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1588cfc0b04643a881de076bea2e23b5',ramdisk_id='',reservation_id='r-t3ok78f7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-594907864',owner_user_name='tempest-ServerActionsTestOtherB-594907864-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5e4be2f71154849a225adb0628fa70e',uuid=983577b5-4abb-4280-b8e8-a63f42d8f796,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-176102819-network", "vif_mac": "fa:16:3e:b9:64:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:36:25 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Converting VIF {"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-176102819-network", "vif_mac": "fa:16:3e:b9:64:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:36:25 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:64:22,bridge_name='br-int',has_traffic_filtering=True,id=ba4444c9-ca0d-4265-a567-f931f42b3115,network=Network(25ddd6d0-e3f6-4a35-b15f-a41da18091ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4444c9-ca') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:36:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:36:25 user nova-compute[73010]:   <uuid>983577b5-4abb-4280-b8e8-a63f42d8f796</uuid>
Aug 15 00:36:25 user nova-compute[73010]:   <name>instance-00000002</name>
Aug 15 00:36:25 user nova-compute[73010]:   <memory>2097152</memory>
Aug 15 00:36:25 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:36:25 user nova-compute[73010]:   <metadata>
Aug 15 00:36:25 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:36:25 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:36:25 user nova-compute[73010]:       <nova:name>tempest-ServerActionsTestOtherB-server-1216295700</nova:name>
Aug 15 00:36:25 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:36:23</nova:creationTime>
Aug 15 00:36:25 user nova-compute[73010]:       <nova:flavor name="m1.small">
Aug 15 00:36:25 user nova-compute[73010]:         <nova:memory>2048</nova:memory>
Aug 15 00:36:25 user nova-compute[73010]:         <nova:disk>20</nova:disk>
Aug 15 00:36:25 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:36:25 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:36:25 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:36:25 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:36:25 user nova-compute[73010]:       <nova:owner>
Aug 15 00:36:25 user nova-compute[73010]:         <nova:user uuid="a5e4be2f71154849a225adb0628fa70e">tempest-ServerActionsTestOtherB-594907864-project-member</nova:user>
Aug 15 00:36:25 user nova-compute[73010]:         <nova:project uuid="1588cfc0b04643a881de076bea2e23b5">tempest-ServerActionsTestOtherB-594907864</nova:project>
Aug 15 00:36:25 user nova-compute[73010]:       </nova:owner>
Aug 15 00:36:25 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:36:25 user nova-compute[73010]:       <nova:ports>
Aug 15 00:36:25 user nova-compute[73010]:         <nova:port uuid="ba4444c9-ca0d-4265-a567-f931f42b3115">
Aug 15 00:36:25 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 00:36:25 user nova-compute[73010]:         </nova:port>
Aug 15 00:36:25 user nova-compute[73010]:       </nova:ports>
Aug 15 00:36:25 user nova-compute[73010]:     </nova:instance>
Aug 15 00:36:25 user nova-compute[73010]:   </metadata>
Aug 15 00:36:25 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:36:25 user nova-compute[73010]:     <system>
Aug 15 00:36:25 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:36:25 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:36:25 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:36:25 user nova-compute[73010]:       <entry name="serial">983577b5-4abb-4280-b8e8-a63f42d8f796</entry>
Aug 15 00:36:25 user nova-compute[73010]:       <entry name="uuid">983577b5-4abb-4280-b8e8-a63f42d8f796</entry>
Aug 15 00:36:25 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:36:25 user nova-compute[73010]:     </system>
Aug 15 00:36:25 user nova-compute[73010]:   </sysinfo>
Aug 15 00:36:25 user nova-compute[73010]:   <os>
Aug 15 00:36:25 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:36:25 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:36:25 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:36:25 user nova-compute[73010]:   </os>
Aug 15 00:36:25 user nova-compute[73010]:   <features>
Aug 15 00:36:25 user nova-compute[73010]:     <acpi/>
Aug 15 00:36:25 user nova-compute[73010]:     <apic/>
Aug 15 00:36:25 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:36:25 user nova-compute[73010]:   </features>
Aug 15 00:36:25 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:36:25 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:36:25 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:36:25 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:36:25 user nova-compute[73010]:   </clock>
Aug 15 00:36:25 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:36:25 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:36:25 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:36:25 user nova-compute[73010]:   </cpu>
Aug 15 00:36:25 user nova-compute[73010]:   <devices>
Aug 15 00:36:25 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:36:25 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:36:25 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk"/>
Aug 15 00:36:25 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:36:25 user nova-compute[73010]:     </disk>
Aug 15 00:36:25 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 00:36:25 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:36:25 user nova-compute[73010]:       <source dev="/dev/sdd"/>
Aug 15 00:36:25 user nova-compute[73010]:       <target dev="vdb" bus="virtio"/>
Aug 15 00:36:25 user nova-compute[73010]:       <serial>e4ddadda-c939-425a-bcb3-4e454e0db7f4</serial>
Aug 15 00:36:25 user nova-compute[73010]:     </disk>
Aug 15 00:36:25 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:36:25 user nova-compute[73010]:       <mac address="fa:16:3e:b9:64:22"/>
Aug 15 00:36:25 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:36:25 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:36:25 user nova-compute[73010]:       <target dev="tapba4444c9-ca"/>
Aug 15 00:36:25 user nova-compute[73010]:     </interface>
Aug 15 00:36:25 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:36:25 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/console.log" append="off"/>
Aug 15 00:36:25 user nova-compute[73010]:     </serial>
Aug 15 00:36:25 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:36:25 user nova-compute[73010]:     <video>
Aug 15 00:36:25 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:36:25 user nova-compute[73010]:     </video>
Aug 15 00:36:25 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:36:25 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:36:25 user nova-compute[73010]:     </rng>
Aug 15 00:36:25 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:36:25 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:36:25 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:36:25 user nova-compute[73010]:     </memballoon>
Aug 15 00:36:25 user nova-compute[73010]:   </devices>
Aug 15 00:36:25 user nova-compute[73010]: </domain>
Aug 15 00:36:25 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:36:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1216295700',display_name='tempest-ServerActionsTestOtherB-server-1216295700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1216295700',id=2,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVoikkIiX9fqlWUgAuNi/64W1pPax2fim7TT4ZilB7kZJFBTddrjL8mZ+9EedRXSwMMm3xZIb3UP53hHNu173Z0/TxgKI44bIEdZkISEoJSalzaVJQjVXA5W+j4ISJAVA==',key_name='tempest-keypair-1664333158',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:32:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1588cfc0b04643a881de076bea2e23b5',ramdisk_id='',reservation_id='r-t3ok78f7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-594907864',owner_user_name='tempest-ServerActionsTestOtherB-594907864-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5e4be2f71154849a225adb0628fa70e',uuid=983577b5-4abb-4280-b8e8-a63f42d8f796,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-176102819-network", "vif_mac": "fa:16:3e:b9:64:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:36:25 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Converting VIF {"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-176102819-network", "vif_mac": "fa:16:3e:b9:64:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:36:25 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:64:22,bridge_name='br-int',has_traffic_filtering=True,id=ba4444c9-ca0d-4265-a567-f931f42b3115,network=Network(25ddd6d0-e3f6-4a35-b15f-a41da18091ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4444c9-ca') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:36:25 user nova-compute[73010]: DEBUG os_vif [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:64:22,bridge_name='br-int',has_traffic_filtering=True,id=ba4444c9-ca0d-4265-a567-f931f42b3115,network=Network(25ddd6d0-e3f6-4a35-b15f-a41da18091ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4444c9-ca') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:36:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:36:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:36:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba4444c9-ca, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:36:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba4444c9-ca, col_values=(('external_ids', {'iface-id': 'ba4444c9-ca0d-4265-a567-f931f42b3115', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:64:22', 'vm-uuid': '983577b5-4abb-4280-b8e8-a63f42d8f796'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:36:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:36:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:25 user nova-compute[73010]: INFO os_vif [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:64:22,bridge_name='br-int',has_traffic_filtering=True,id=ba4444c9-ca0d-4265-a567-f931f42b3115,network=Network(25ddd6d0-e3f6-4a35-b15f-a41da18091ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4444c9-ca')
Aug 15 00:36:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:36:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:36:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] No VIF found with MAC fa:16:3e:b9:64:22, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:36:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:27 user nova-compute[73010]: DEBUG nova.compute.manager [req-c1fe132d-1695-4d62-b5fb-17abc922e961 req-5334f70b-4e2f-4140-94cb-c8dfca09e49b service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received event network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:36:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c1fe132d-1695-4d62-b5fb-17abc922e961 req-5334f70b-4e2f-4140-94cb-c8dfca09e49b service nova] Acquiring lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c1fe132d-1695-4d62-b5fb-17abc922e961 req-5334f70b-4e2f-4140-94cb-c8dfca09e49b service nova] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c1fe132d-1695-4d62-b5fb-17abc922e961 req-5334f70b-4e2f-4140-94cb-c8dfca09e49b service nova] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:27 user nova-compute[73010]: DEBUG nova.compute.manager [req-c1fe132d-1695-4d62-b5fb-17abc922e961 req-5334f70b-4e2f-4140-94cb-c8dfca09e49b service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] No waiting events found dispatching network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:36:27 user nova-compute[73010]: WARNING nova.compute.manager [req-c1fe132d-1695-4d62-b5fb-17abc922e961 req-5334f70b-4e2f-4140-94cb-c8dfca09e49b service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received unexpected event network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 for instance with vm_state active and task_state resize_finish.
Aug 15 00:36:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:29 user nova-compute[73010]: DEBUG nova.compute.manager [req-317ebb98-d710-4e24-85e3-d7e2df86ec24 req-8551d85d-8272-4dfd-bec9-bbdf94ae09ef service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received event network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:36:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-317ebb98-d710-4e24-85e3-d7e2df86ec24 req-8551d85d-8272-4dfd-bec9-bbdf94ae09ef service nova] Acquiring lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-317ebb98-d710-4e24-85e3-d7e2df86ec24 req-8551d85d-8272-4dfd-bec9-bbdf94ae09ef service nova] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-317ebb98-d710-4e24-85e3-d7e2df86ec24 req-8551d85d-8272-4dfd-bec9-bbdf94ae09ef service nova] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:29 user nova-compute[73010]: DEBUG nova.compute.manager [req-317ebb98-d710-4e24-85e3-d7e2df86ec24 req-8551d85d-8272-4dfd-bec9-bbdf94ae09ef service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] No waiting events found dispatching network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:36:29 user nova-compute[73010]: WARNING nova.compute.manager [req-317ebb98-d710-4e24-85e3-d7e2df86ec24 req-8551d85d-8272-4dfd-bec9-bbdf94ae09ef service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received unexpected event network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 for instance with vm_state active and task_state resize_finish.
Aug 15 00:36:29 user nova-compute[73010]: DEBUG nova.compute.manager [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:36:29 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059789.1956372, 983577b5-4abb-4280-b8e8-a63f42d8f796 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:36:29 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] VM Resumed (Lifecycle Event)
Aug 15 00:36:29 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Instance running successfully.
Aug 15 00:36:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Failed to set time: agent not configured {{(pid=73010) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 15 00:36:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6d5b57b9-85bc-4ec8-a67c-8f6e1b6e9a95 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] finish_migration finished successfully. {{(pid=73010) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 15 00:36:29 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:36:29 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:36:29 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 00:36:29 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059789.1958342, 983577b5-4abb-4280-b8e8-a63f42d8f796 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:36:29 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] VM Started (Lifecycle Event)
Aug 15 00:36:29 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:36:29 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:36:29 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 00:36:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:46 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:36:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:46 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:36:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:36:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-aeec93ef-10ae-4de4-b19e-e14b1e25f065 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:36:47 user nova-compute[73010]: INFO nova.compute.manager [None req-aeec93ef-10ae-4de4-b19e-e14b1e25f065 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] instance snapshotting
Aug 15 00:36:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:47 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-aeec93ef-10ae-4de4-b19e-e14b1e25f065 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Beginning live snapshot process
Aug 15 00:36:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-aeec93ef-10ae-4de4-b19e-e14b1e25f065 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json -f qcow2 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-aeec93ef-10ae-4de4-b19e-e14b1e25f065 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-aeec93ef-10ae-4de4-b19e-e14b1e25f065 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json -f qcow2 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-aeec93ef-10ae-4de4-b19e-e14b1e25f065 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json -f qcow2" returned: 0 in 0.203s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-aeec93ef-10ae-4de4-b19e-e14b1e25f065 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:36:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-aeec93ef-10ae-4de4-b19e-e14b1e25f065 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.193s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-aeec93ef-10ae-4de4-b19e-e14b1e25f065 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpagfxa0c6/564c9a2c75e84cb4a49912799945e974.delta 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-aeec93ef-10ae-4de4-b19e-e14b1e25f065 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpagfxa0c6/564c9a2c75e84cb4a49912799945e974.delta 1073741824" returned: 0 in 0.067s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:48 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-aeec93ef-10ae-4de4-b19e-e14b1e25f065 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 00:36:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ba39c23-9f14-4eda-94f7-a07e82c92ec0/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ba39c23-9f14-4eda-94f7-a07e82c92ec0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ba39c23-9f14-4eda-94f7-a07e82c92ec0/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ba39c23-9f14-4eda-94f7-a07e82c92ec0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-aeec93ef-10ae-4de4-b19e-e14b1e25f065 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] COPY block job progress, current cursor: 589824 final cursor: 75563008 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 00:36:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-aeec93ef-10ae-4de4-b19e-e14b1e25f065 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] COPY block job progress, current cursor: 47513600 final cursor: 75563008 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 00:36:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:36:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:50 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:36:50 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:36:50 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=7374MB free_disk=25.797992706298828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:36:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-aeec93ef-10ae-4de4-b19e-e14b1e25f065 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 00:36:50 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-aeec93ef-10ae-4de4-b19e-e14b1e25f065 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 00:36:50 user nova-compute[73010]: DEBUG nova.privsep.utils [None req-aeec93ef-10ae-4de4-b19e-e14b1e25f065 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73010) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 00:36:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-aeec93ef-10ae-4de4-b19e-e14b1e25f065 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpagfxa0c6/564c9a2c75e84cb4a49912799945e974.delta /opt/stack/data/nova/instances/snapshots/tmpagfxa0c6/564c9a2c75e84cb4a49912799945e974 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:50 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Applying migration context for instance 983577b5-4abb-4280-b8e8-a63f42d8f796 as it has an incoming, in-progress migration 29f41887-4ebb-4d2f-a4e9-270027a77f26. Migration status is finished {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 00:36:50 user nova-compute[73010]: INFO nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Updating resource usage from migration 29f41887-4ebb-4d2f-a4e9-270027a77f26
Aug 15 00:36:50 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance afcd0a05-e035-492e-9fbe-cd63f4c3ea42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:36:50 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 0588a46c-2314-47e3-b984-1e04518e8a63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:36:50 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance e2410ee7-7351-460a-8d9c-47fe54e08c8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:36:50 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance da32613e-b1a9-4733-831f-e4fb1f34995f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:36:50 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4ba39c23-9f14-4eda-94f7-a07e82c92ec0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:36:50 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 52878f3e-3ffa-4b1b-b842-ca2215454a3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:36:50 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance dde74512-c8c3-436c-a6dc-a9327340229e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:36:50 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Migration 29f41887-4ebb-4d2f-a4e9-270027a77f26 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 00:36:50 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 983577b5-4abb-4280-b8e8-a63f42d8f796 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:36:50 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:36:50 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:36:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:51 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:36:51 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:36:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-aeec93ef-10ae-4de4-b19e-e14b1e25f065 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpagfxa0c6/564c9a2c75e84cb4a49912799945e974.delta /opt/stack/data/nova/instances/snapshots/tmpagfxa0c6/564c9a2c75e84cb4a49912799945e974" returned: 0 in 0.625s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:51 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-aeec93ef-10ae-4de4-b19e-e14b1e25f065 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Snapshot extracted, beginning image upload
Aug 15 00:36:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:36:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.789s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:53 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:36:53 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:36:53 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:36:53 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Didn't find any instances for network info cache update. {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 00:36:53 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:36:53 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:36:53 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:36:53 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:36:53 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:36:53 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:36:53 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-aeec93ef-10ae-4de4-b19e-e14b1e25f065 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Snapshot image upload complete
Aug 15 00:36:53 user nova-compute[73010]: INFO nova.compute.manager [None req-aeec93ef-10ae-4de4-b19e-e14b1e25f065 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Took 6.56 seconds to snapshot the instance on the hypervisor.
Aug 15 00:36:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:55 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:36:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:36:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:57 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:36:57 user nova-compute[73010]: INFO nova.compute.claims [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Claim successful on node user
Aug 15 00:36:57 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:36:57 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:36:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.574s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:36:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:36:57 user nova-compute[73010]: DEBUG nova.network.neutron [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:36:57 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:36:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:36:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "6dfc356b-953a-47b0-9da7-70cc59a80853" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "6dfc356b-953a-47b0-9da7-70cc59a80853" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:36:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:36:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:36:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Creating image(s)
Aug 15 00:36:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c4015b5-3ae9-4486-878c-e7a2b01ff5c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "/opt/stack/data/nova/instances/3c4015b5-3ae9-4486-878c-e7a2b01ff5c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "/opt/stack/data/nova/instances/3c4015b5-3ae9-4486-878c-e7a2b01ff5c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "335e81ba9199bf0fda5bd9f800f921ed31f9b6fe" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "335e81ba9199bf0fda5bd9f800f921ed31f9b6fe" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:58 user nova-compute[73010]: DEBUG nova.policy [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '456d295a0dfd4e96848eb4e0ce9e5604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f162c9493416db7cfab122c4050af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:36:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:36:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:36:58 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:36:58 user nova-compute[73010]: INFO nova.compute.claims [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Claim successful on node user
Aug 15 00:36:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/335e81ba9199bf0fda5bd9f800f921ed31f9b6fe.part --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:36:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/335e81ba9199bf0fda5bd9f800f921ed31f9b6fe.part --force-share --output=json" returned: 0 in 0.232s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:59 user nova-compute[73010]: DEBUG nova.virt.images [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] c872a2f0-e6f5-40a6-a946-7f455d3155b0 was qcow2, converting to raw {{(pid=73010) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 00:36:59 user nova-compute[73010]: DEBUG nova.privsep.utils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73010) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 00:36:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/335e81ba9199bf0fda5bd9f800f921ed31f9b6fe.part /opt/stack/data/nova/instances/_base/335e81ba9199bf0fda5bd9f800f921ed31f9b6fe.converted {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/335e81ba9199bf0fda5bd9f800f921ed31f9b6fe.part /opt/stack/data/nova/instances/_base/335e81ba9199bf0fda5bd9f800f921ed31f9b6fe.converted" returned: 0 in 0.431s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/335e81ba9199bf0fda5bd9f800f921ed31f9b6fe.converted --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:36:59 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:36:59 user nova-compute[73010]: DEBUG nova.network.neutron [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Successfully created port: eac88317-fb48-4ff8-b519-8695d8b3ac57 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:36:59 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:36:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.758s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:59 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:36:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/335e81ba9199bf0fda5bd9f800f921ed31f9b6fe.converted --force-share --output=json" returned: 0 in 0.254s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:36:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "335e81ba9199bf0fda5bd9f800f921ed31f9b6fe" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.833s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:36:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/335e81ba9199bf0fda5bd9f800f921ed31f9b6fe --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:37:00 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:37:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/335e81ba9199bf0fda5bd9f800f921ed31f9b6fe --force-share --output=json" returned: 0 in 0.226s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "335e81ba9199bf0fda5bd9f800f921ed31f9b6fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "335e81ba9199bf0fda5bd9f800f921ed31f9b6fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/335e81ba9199bf0fda5bd9f800f921ed31f9b6fe --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG nova.policy [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0e48e71bb404f26926ac7a8176e04bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13115a64ccc24df68bdfda1fc72399c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:37:00 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Creating image(s)
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "/opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "/opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "/opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/335e81ba9199bf0fda5bd9f800f921ed31f9b6fe --force-share --output=json" returned: 0 in 0.224s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/335e81ba9199bf0fda5bd9f800f921ed31f9b6fe,backing_fmt=raw /opt/stack/data/nova/instances/3c4015b5-3ae9-4486-878c-e7a2b01ff5c9/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/335e81ba9199bf0fda5bd9f800f921ed31f9b6fe,backing_fmt=raw /opt/stack/data/nova/instances/3c4015b5-3ae9-4486-878c-e7a2b01ff5c9/disk 1073741824" returned: 0 in 0.060s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "335e81ba9199bf0fda5bd9f800f921ed31f9b6fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/335e81ba9199bf0fda5bd9f800f921ed31f9b6fe --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.240s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/335e81ba9199bf0fda5bd9f800f921ed31f9b6fe --force-share --output=json" returned: 0 in 0.215s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG nova.objects.instance [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lazy-loading 'migration_context' on Instance uuid 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Ensure instance console log exists: /opt/stack/data/nova/instances/3c4015b5-3ae9-4486-878c-e7a2b01ff5c9/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.199s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk 1073741824" returned: 0 in 0.069s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.230s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Successfully created port: 4ff59e78-ba56-4896-8f62-3cd1cc2465b4 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.network.neutron [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Successfully updated port: eac88317-fb48-4ff8-b519-8695d8b3ac57 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "refresh_cache-3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquired lock "refresh_cache-3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.network.neutron [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.compute.manager [req-f6304a79-f126-4f1b-8728-ca1fc80d14d0 req-5efede52-cfff-4718-8edf-88ea0ba108eb service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Received event network-changed-eac88317-fb48-4ff8-b519-8695d8b3ac57 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.compute.manager [req-f6304a79-f126-4f1b-8728-ca1fc80d14d0 req-5efede52-cfff-4718-8edf-88ea0ba108eb service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Refreshing instance network info cache due to event network-changed-eac88317-fb48-4ff8-b519-8695d8b3ac57. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f6304a79-f126-4f1b-8728-ca1fc80d14d0 req-5efede52-cfff-4718-8edf-88ea0ba108eb service nova] Acquiring lock "refresh_cache-3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.network.neutron [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Cannot resize image /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lazy-loading 'migration_context' on Instance uuid 6dfc356b-953a-47b0-9da7-70cc59a80853 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Ensure instance console log exists: /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.network.neutron [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Updating instance_info_cache with network_info: [{"id": "eac88317-fb48-4ff8-b519-8695d8b3ac57", "address": "fa:16:3e:59:f7:fc", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac88317-fb", "ovs_interfaceid": "eac88317-fb48-4ff8-b519-8695d8b3ac57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Releasing lock "refresh_cache-3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Instance network_info: |[{"id": "eac88317-fb48-4ff8-b519-8695d8b3ac57", "address": "fa:16:3e:59:f7:fc", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac88317-fb", "ovs_interfaceid": "eac88317-fb48-4ff8-b519-8695d8b3ac57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f6304a79-f126-4f1b-8728-ca1fc80d14d0 req-5efede52-cfff-4718-8edf-88ea0ba108eb service nova] Acquired lock "refresh_cache-3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.network.neutron [req-f6304a79-f126-4f1b-8728-ca1fc80d14d0 req-5efede52-cfff-4718-8edf-88ea0ba108eb service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Refreshing network info cache for port eac88317-fb48-4ff8-b519-8695d8b3ac57 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Start _get_guest_xml network_info=[{"id": "eac88317-fb48-4ff8-b519-8695d8b3ac57", "address": "fa:16:3e:59:f7:fc", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac88317-fb", "ovs_interfaceid": "eac88317-fb48-4ff8-b519-8695d8b3ac57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='f7a5c9e33157302e85d8e9a2f283f9f0',container_format='bare',created_at=2023-08-15T00:36:47Z,direct_url=<?>,disk_format='qcow2',id=c872a2f0-e6f5-40a6-a946-7f455d3155b0,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1992644529',owner='9d0f162c9493416db7cfab122c4050af',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T00:36:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': 'c872a2f0-e6f5-40a6-a946-7f455d3155b0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:37:01 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:37:01 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f7a5c9e33157302e85d8e9a2f283f9f0',container_format='bare',created_at=2023-08-15T00:36:47Z,direct_url=<?>,disk_format='qcow2',id=c872a2f0-e6f5-40a6-a946-7f455d3155b0,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1992644529',owner='9d0f162c9493416db7cfab122c4050af',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T00:36:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1526302439',display_name='tempest-TestStampPattern-server-1526302439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1526302439',id=16,image_ref='c872a2f0-e6f5-40a6-a946-7f455d3155b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrgFYRcqv6WgRdkBOunRQ1m/LgpwWxam7rDA0+KqfC3W5QB65YWRrvkhgBL/Sf+IJhFzjvTZJIwpzP4EtbE6dhqqF6WJsQneEfsmdXlIDI2l5CiQq/L0gFEvj2zfmLvMA==',key_name='tempest-TestStampPattern-362830252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d0f162c9493416db7cfab122c4050af',ramdisk_id='',reservation_id='r-kdbmqx0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e2410ee7-7351-460a-8d9c-47fe54e08c8b',image_min_disk='1',image_min_ram='0',image_owner_id='9d0f162c9493416db7cfab122c4050af',image_owner_project_name='tempest-TestStampPattern-1617621274',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1617621274-project-member',image_user_id='456d295a0dfd4e96848eb4e0ce9e5604',network_allocated='True',owner_project_name='tempest-TestStampPattern-1617621274',owner_user_name='tempest-TestStampPattern-1617621274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:36:58Z,user_data=None,user_id='456d295a0dfd4e96848eb4e0ce9e5604',uuid=3c4015b5-3ae9-4486-878c-e7a2b01ff5c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eac88317-fb48-4ff8-b519-8695d8b3ac57", "address": "fa:16:3e:59:f7:fc", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac88317-fb", "ovs_interfaceid": "eac88317-fb48-4ff8-b519-8695d8b3ac57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Converting VIF {"id": "eac88317-fb48-4ff8-b519-8695d8b3ac57", "address": "fa:16:3e:59:f7:fc", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac88317-fb", "ovs_interfaceid": "eac88317-fb48-4ff8-b519-8695d8b3ac57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:f7:fc,bridge_name='br-int',has_traffic_filtering=True,id=eac88317-fb48-4ff8-b519-8695d8b3ac57,network=Network(a0e0995e-1753-4a7a-825f-76c1938b2d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac88317-fb') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.objects.instance [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:37:01 user nova-compute[73010]:   <uuid>3c4015b5-3ae9-4486-878c-e7a2b01ff5c9</uuid>
Aug 15 00:37:01 user nova-compute[73010]:   <name>instance-00000010</name>
Aug 15 00:37:01 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:37:01 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:37:01 user nova-compute[73010]:   <metadata>
Aug 15 00:37:01 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:37:01 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:37:01 user nova-compute[73010]:       <nova:name>tempest-TestStampPattern-server-1526302439</nova:name>
Aug 15 00:37:01 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:37:01</nova:creationTime>
Aug 15 00:37:01 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:37:01 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:37:01 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:37:01 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:37:01 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:37:01 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:37:01 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:37:01 user nova-compute[73010]:       <nova:owner>
Aug 15 00:37:01 user nova-compute[73010]:         <nova:user uuid="456d295a0dfd4e96848eb4e0ce9e5604">tempest-TestStampPattern-1617621274-project-member</nova:user>
Aug 15 00:37:01 user nova-compute[73010]:         <nova:project uuid="9d0f162c9493416db7cfab122c4050af">tempest-TestStampPattern-1617621274</nova:project>
Aug 15 00:37:01 user nova-compute[73010]:       </nova:owner>
Aug 15 00:37:01 user nova-compute[73010]:       <nova:root type="image" uuid="c872a2f0-e6f5-40a6-a946-7f455d3155b0"/>
Aug 15 00:37:01 user nova-compute[73010]:       <nova:ports>
Aug 15 00:37:01 user nova-compute[73010]:         <nova:port uuid="eac88317-fb48-4ff8-b519-8695d8b3ac57">
Aug 15 00:37:01 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 00:37:01 user nova-compute[73010]:         </nova:port>
Aug 15 00:37:01 user nova-compute[73010]:       </nova:ports>
Aug 15 00:37:01 user nova-compute[73010]:     </nova:instance>
Aug 15 00:37:01 user nova-compute[73010]:   </metadata>
Aug 15 00:37:01 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:37:01 user nova-compute[73010]:     <system>
Aug 15 00:37:01 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:37:01 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:37:01 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:37:01 user nova-compute[73010]:       <entry name="serial">3c4015b5-3ae9-4486-878c-e7a2b01ff5c9</entry>
Aug 15 00:37:01 user nova-compute[73010]:       <entry name="uuid">3c4015b5-3ae9-4486-878c-e7a2b01ff5c9</entry>
Aug 15 00:37:01 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:37:01 user nova-compute[73010]:     </system>
Aug 15 00:37:01 user nova-compute[73010]:   </sysinfo>
Aug 15 00:37:01 user nova-compute[73010]:   <os>
Aug 15 00:37:01 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:37:01 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:37:01 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:37:01 user nova-compute[73010]:   </os>
Aug 15 00:37:01 user nova-compute[73010]:   <features>
Aug 15 00:37:01 user nova-compute[73010]:     <acpi/>
Aug 15 00:37:01 user nova-compute[73010]:     <apic/>
Aug 15 00:37:01 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:37:01 user nova-compute[73010]:   </features>
Aug 15 00:37:01 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:37:01 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:37:01 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:37:01 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:37:01 user nova-compute[73010]:   </clock>
Aug 15 00:37:01 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:37:01 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:37:01 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:37:01 user nova-compute[73010]:   </cpu>
Aug 15 00:37:01 user nova-compute[73010]:   <devices>
Aug 15 00:37:01 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:37:01 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:37:01 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/3c4015b5-3ae9-4486-878c-e7a2b01ff5c9/disk"/>
Aug 15 00:37:01 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:37:01 user nova-compute[73010]:     </disk>
Aug 15 00:37:01 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:37:01 user nova-compute[73010]:       <mac address="fa:16:3e:59:f7:fc"/>
Aug 15 00:37:01 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:37:01 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:37:01 user nova-compute[73010]:       <target dev="tapeac88317-fb"/>
Aug 15 00:37:01 user nova-compute[73010]:     </interface>
Aug 15 00:37:01 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:37:01 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/3c4015b5-3ae9-4486-878c-e7a2b01ff5c9/console.log" append="off"/>
Aug 15 00:37:01 user nova-compute[73010]:     </serial>
Aug 15 00:37:01 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:37:01 user nova-compute[73010]:     <video>
Aug 15 00:37:01 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:37:01 user nova-compute[73010]:     </video>
Aug 15 00:37:01 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:37:01 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:37:01 user nova-compute[73010]:     </rng>
Aug 15 00:37:01 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:37:01 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:37:01 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:37:01 user nova-compute[73010]:     </memballoon>
Aug 15 00:37:01 user nova-compute[73010]:   </devices>
Aug 15 00:37:01 user nova-compute[73010]: </domain>
Aug 15 00:37:01 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1526302439',display_name='tempest-TestStampPattern-server-1526302439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1526302439',id=16,image_ref='c872a2f0-e6f5-40a6-a946-7f455d3155b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrgFYRcqv6WgRdkBOunRQ1m/LgpwWxam7rDA0+KqfC3W5QB65YWRrvkhgBL/Sf+IJhFzjvTZJIwpzP4EtbE6dhqqF6WJsQneEfsmdXlIDI2l5CiQq/L0gFEvj2zfmLvMA==',key_name='tempest-TestStampPattern-362830252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d0f162c9493416db7cfab122c4050af',ramdisk_id='',reservation_id='r-kdbmqx0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e2410ee7-7351-460a-8d9c-47fe54e08c8b',image_min_disk='1',image_min_ram='0',image_owner_id='9d0f162c9493416db7cfab122c4050af',image_owner_project_name='tempest-TestStampPattern-1617621274',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1617621274-project-member',image_user_id='456d295a0dfd4e96848eb4e0ce9e5604',network_allocated='True',owner_project_name='tempest-TestStampPattern-1617621274',owner_user_name='tempest-TestStampPattern-1617621274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:36:58Z,user_data=None,user_id='456d295a0dfd4e96848eb4e0ce9e5604',uuid=3c4015b5-3ae9-4486-878c-e7a2b01ff5c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eac88317-fb48-4ff8-b519-8695d8b3ac57", "address": "fa:16:3e:59:f7:fc", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac88317-fb", "ovs_interfaceid": "eac88317-fb48-4ff8-b519-8695d8b3ac57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Converting VIF {"id": "eac88317-fb48-4ff8-b519-8695d8b3ac57", "address": "fa:16:3e:59:f7:fc", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac88317-fb", "ovs_interfaceid": "eac88317-fb48-4ff8-b519-8695d8b3ac57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:f7:fc,bridge_name='br-int',has_traffic_filtering=True,id=eac88317-fb48-4ff8-b519-8695d8b3ac57,network=Network(a0e0995e-1753-4a7a-825f-76c1938b2d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac88317-fb') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG os_vif [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:f7:fc,bridge_name='br-int',has_traffic_filtering=True,id=eac88317-fb48-4ff8-b519-8695d8b3ac57,network=Network(a0e0995e-1753-4a7a-825f-76c1938b2d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac88317-fb') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeac88317-fb, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeac88317-fb, col_values=(('external_ids', {'iface-id': 'eac88317-fb48-4ff8-b519-8695d8b3ac57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:f7:fc', 'vm-uuid': '3c4015b5-3ae9-4486-878c-e7a2b01ff5c9'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:01 user nova-compute[73010]: INFO os_vif [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:f7:fc,bridge_name='br-int',has_traffic_filtering=True,id=eac88317-fb48-4ff8-b519-8695d8b3ac57,network=Network(a0e0995e-1753-4a7a-825f-76c1938b2d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac88317-fb')
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] No VIF found with MAC fa:16:3e:59:f7:fc, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:01 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Successfully updated port: 4ff59e78-ba56-4896-8f62-3cd1cc2465b4 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "refresh_cache-6dfc356b-953a-47b0-9da7-70cc59a80853" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquired lock "refresh_cache-6dfc356b-953a-47b0-9da7-70cc59a80853" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-48593b06-a251-43cb-a96d-540a6ef3ac09 req-c1f085d2-3653-47be-8ce8-a45d6971d3b0 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Received event network-changed-4ff59e78-ba56-4896-8f62-3cd1cc2465b4 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-48593b06-a251-43cb-a96d-540a6ef3ac09 req-c1f085d2-3653-47be-8ce8-a45d6971d3b0 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Refreshing instance network info cache due to event network-changed-4ff59e78-ba56-4896-8f62-3cd1cc2465b4. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-48593b06-a251-43cb-a96d-540a6ef3ac09 req-c1f085d2-3653-47be-8ce8-a45d6971d3b0 service nova] Acquiring lock "refresh_cache-6dfc356b-953a-47b0-9da7-70cc59a80853" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Updating instance_info_cache with network_info: [{"id": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "address": "fa:16:3e:63:99:69", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff59e78-ba", "ovs_interfaceid": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Releasing lock "refresh_cache-6dfc356b-953a-47b0-9da7-70cc59a80853" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Instance network_info: |[{"id": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "address": "fa:16:3e:63:99:69", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff59e78-ba", "ovs_interfaceid": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-48593b06-a251-43cb-a96d-540a6ef3ac09 req-c1f085d2-3653-47be-8ce8-a45d6971d3b0 service nova] Acquired lock "refresh_cache-6dfc356b-953a-47b0-9da7-70cc59a80853" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.network.neutron [req-48593b06-a251-43cb-a96d-540a6ef3ac09 req-c1f085d2-3653-47be-8ce8-a45d6971d3b0 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Refreshing network info cache for port 4ff59e78-ba56-4896-8f62-3cd1cc2465b4 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Start _get_guest_xml network_info=[{"id": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "address": "fa:16:3e:63:99:69", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff59e78-ba", "ovs_interfaceid": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:37:02 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:37:02 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-560646446',display_name='tempest-ServerActionsTestOtherA-server-560646446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-560646446',id=17,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqunjyZFkLpiNk80zhHJBMmI4Jlrza8ZHLYSe5RBsKwkkEoHKGeBKUwg/vA7wlV9hl0L81vzjguxDm4dKyFGA6ikNNXxOaicSODgz47pq/ht3X4FxrymmL8vELLfuQCog==',key_name='tempest-keypair-786587935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13115a64ccc24df68bdfda1fc72399c4',ramdisk_id='',reservation_id='r-cep35jzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-671712537',owner_user_name='tempest-ServerActionsTestOtherA-671712537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:37:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0e48e71bb404f26926ac7a8176e04bb',uuid=6dfc356b-953a-47b0-9da7-70cc59a80853,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "address": "fa:16:3e:63:99:69", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff59e78-ba", "ovs_interfaceid": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converting VIF {"id": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "address": "fa:16:3e:63:99:69", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff59e78-ba", "ovs_interfaceid": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:99:69,bridge_name='br-int',has_traffic_filtering=True,id=4ff59e78-ba56-4896-8f62-3cd1cc2465b4,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff59e78-ba') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lazy-loading 'pci_devices' on Instance uuid 6dfc356b-953a-47b0-9da7-70cc59a80853 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:37:02 user nova-compute[73010]:   <uuid>6dfc356b-953a-47b0-9da7-70cc59a80853</uuid>
Aug 15 00:37:02 user nova-compute[73010]:   <name>instance-00000011</name>
Aug 15 00:37:02 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:37:02 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:37:02 user nova-compute[73010]:   <metadata>
Aug 15 00:37:02 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:37:02 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:37:02 user nova-compute[73010]:       <nova:name>tempest-ServerActionsTestOtherA-server-560646446</nova:name>
Aug 15 00:37:02 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:37:02</nova:creationTime>
Aug 15 00:37:02 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:37:02 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:37:02 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:37:02 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:37:02 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:37:02 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:37:02 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:37:02 user nova-compute[73010]:       <nova:owner>
Aug 15 00:37:02 user nova-compute[73010]:         <nova:user uuid="b0e48e71bb404f26926ac7a8176e04bb">tempest-ServerActionsTestOtherA-671712537-project-member</nova:user>
Aug 15 00:37:02 user nova-compute[73010]:         <nova:project uuid="13115a64ccc24df68bdfda1fc72399c4">tempest-ServerActionsTestOtherA-671712537</nova:project>
Aug 15 00:37:02 user nova-compute[73010]:       </nova:owner>
Aug 15 00:37:02 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:37:02 user nova-compute[73010]:       <nova:ports>
Aug 15 00:37:02 user nova-compute[73010]:         <nova:port uuid="4ff59e78-ba56-4896-8f62-3cd1cc2465b4">
Aug 15 00:37:02 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 00:37:02 user nova-compute[73010]:         </nova:port>
Aug 15 00:37:02 user nova-compute[73010]:       </nova:ports>
Aug 15 00:37:02 user nova-compute[73010]:     </nova:instance>
Aug 15 00:37:02 user nova-compute[73010]:   </metadata>
Aug 15 00:37:02 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:37:02 user nova-compute[73010]:     <system>
Aug 15 00:37:02 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:37:02 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:37:02 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:37:02 user nova-compute[73010]:       <entry name="serial">6dfc356b-953a-47b0-9da7-70cc59a80853</entry>
Aug 15 00:37:02 user nova-compute[73010]:       <entry name="uuid">6dfc356b-953a-47b0-9da7-70cc59a80853</entry>
Aug 15 00:37:02 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:37:02 user nova-compute[73010]:     </system>
Aug 15 00:37:02 user nova-compute[73010]:   </sysinfo>
Aug 15 00:37:02 user nova-compute[73010]:   <os>
Aug 15 00:37:02 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:37:02 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:37:02 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:37:02 user nova-compute[73010]:   </os>
Aug 15 00:37:02 user nova-compute[73010]:   <features>
Aug 15 00:37:02 user nova-compute[73010]:     <acpi/>
Aug 15 00:37:02 user nova-compute[73010]:     <apic/>
Aug 15 00:37:02 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:37:02 user nova-compute[73010]:   </features>
Aug 15 00:37:02 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:37:02 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:37:02 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:37:02 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:37:02 user nova-compute[73010]:   </clock>
Aug 15 00:37:02 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:37:02 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:37:02 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:37:02 user nova-compute[73010]:   </cpu>
Aug 15 00:37:02 user nova-compute[73010]:   <devices>
Aug 15 00:37:02 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:37:02 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:37:02 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk"/>
Aug 15 00:37:02 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:37:02 user nova-compute[73010]:     </disk>
Aug 15 00:37:02 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:37:02 user nova-compute[73010]:       <mac address="fa:16:3e:63:99:69"/>
Aug 15 00:37:02 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:37:02 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:37:02 user nova-compute[73010]:       <target dev="tap4ff59e78-ba"/>
Aug 15 00:37:02 user nova-compute[73010]:     </interface>
Aug 15 00:37:02 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:37:02 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/console.log" append="off"/>
Aug 15 00:37:02 user nova-compute[73010]:     </serial>
Aug 15 00:37:02 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:37:02 user nova-compute[73010]:     <video>
Aug 15 00:37:02 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:37:02 user nova-compute[73010]:     </video>
Aug 15 00:37:02 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:37:02 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:37:02 user nova-compute[73010]:     </rng>
Aug 15 00:37:02 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:37:02 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:37:02 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:37:02 user nova-compute[73010]:     </memballoon>
Aug 15 00:37:02 user nova-compute[73010]:   </devices>
Aug 15 00:37:02 user nova-compute[73010]: </domain>
Aug 15 00:37:02 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-560646446',display_name='tempest-ServerActionsTestOtherA-server-560646446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-560646446',id=17,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqunjyZFkLpiNk80zhHJBMmI4Jlrza8ZHLYSe5RBsKwkkEoHKGeBKUwg/vA7wlV9hl0L81vzjguxDm4dKyFGA6ikNNXxOaicSODgz47pq/ht3X4FxrymmL8vELLfuQCog==',key_name='tempest-keypair-786587935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13115a64ccc24df68bdfda1fc72399c4',ramdisk_id='',reservation_id='r-cep35jzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-671712537',owner_user_name='tempest-ServerActionsTestOtherA-671712537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:37:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0e48e71bb404f26926ac7a8176e04bb',uuid=6dfc356b-953a-47b0-9da7-70cc59a80853,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "address": "fa:16:3e:63:99:69", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff59e78-ba", "ovs_interfaceid": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converting VIF {"id": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "address": "fa:16:3e:63:99:69", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff59e78-ba", "ovs_interfaceid": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:99:69,bridge_name='br-int',has_traffic_filtering=True,id=4ff59e78-ba56-4896-8f62-3cd1cc2465b4,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff59e78-ba') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG os_vif [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:99:69,bridge_name='br-int',has_traffic_filtering=True,id=4ff59e78-ba56-4896-8f62-3cd1cc2465b4,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff59e78-ba') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ff59e78-ba, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ff59e78-ba, col_values=(('external_ids', {'iface-id': '4ff59e78-ba56-4896-8f62-3cd1cc2465b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:99:69', 'vm-uuid': '6dfc356b-953a-47b0-9da7-70cc59a80853'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:02 user nova-compute[73010]: INFO os_vif [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:99:69,bridge_name='br-int',has_traffic_filtering=True,id=4ff59e78-ba56-4896-8f62-3cd1cc2465b4,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff59e78-ba')
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] No VIF found with MAC fa:16:3e:63:99:69, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.network.neutron [req-f6304a79-f126-4f1b-8728-ca1fc80d14d0 req-5efede52-cfff-4718-8edf-88ea0ba108eb service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Updated VIF entry in instance network info cache for port eac88317-fb48-4ff8-b519-8695d8b3ac57. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG nova.network.neutron [req-f6304a79-f126-4f1b-8728-ca1fc80d14d0 req-5efede52-cfff-4718-8edf-88ea0ba108eb service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Updating instance_info_cache with network_info: [{"id": "eac88317-fb48-4ff8-b519-8695d8b3ac57", "address": "fa:16:3e:59:f7:fc", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac88317-fb", "ovs_interfaceid": "eac88317-fb48-4ff8-b519-8695d8b3ac57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:37:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f6304a79-f126-4f1b-8728-ca1fc80d14d0 req-5efede52-cfff-4718-8edf-88ea0ba108eb service nova] Releasing lock "refresh_cache-3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:37:03 user nova-compute[73010]: DEBUG nova.network.neutron [req-48593b06-a251-43cb-a96d-540a6ef3ac09 req-c1f085d2-3653-47be-8ce8-a45d6971d3b0 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Updated VIF entry in instance network info cache for port 4ff59e78-ba56-4896-8f62-3cd1cc2465b4. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:37:03 user nova-compute[73010]: DEBUG nova.network.neutron [req-48593b06-a251-43cb-a96d-540a6ef3ac09 req-c1f085d2-3653-47be-8ce8-a45d6971d3b0 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Updating instance_info_cache with network_info: [{"id": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "address": "fa:16:3e:63:99:69", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff59e78-ba", "ovs_interfaceid": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:37:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-48593b06-a251-43cb-a96d-540a6ef3ac09 req-c1f085d2-3653-47be-8ce8-a45d6971d3b0 service nova] Releasing lock "refresh_cache-6dfc356b-953a-47b0-9da7-70cc59a80853" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:37:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:04 user nova-compute[73010]: DEBUG nova.compute.manager [req-1ceacf5e-e5b6-4cfa-bebf-ef6251eb711b req-ad37acba-dda1-4c7b-a3f9-48c5c08da968 service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Received event network-vif-plugged-eac88317-fb48-4ff8-b519-8695d8b3ac57 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1ceacf5e-e5b6-4cfa-bebf-ef6251eb711b req-ad37acba-dda1-4c7b-a3f9-48c5c08da968 service nova] Acquiring lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1ceacf5e-e5b6-4cfa-bebf-ef6251eb711b req-ad37acba-dda1-4c7b-a3f9-48c5c08da968 service nova] Lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1ceacf5e-e5b6-4cfa-bebf-ef6251eb711b req-ad37acba-dda1-4c7b-a3f9-48c5c08da968 service nova] Lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:04 user nova-compute[73010]: DEBUG nova.compute.manager [req-1ceacf5e-e5b6-4cfa-bebf-ef6251eb711b req-ad37acba-dda1-4c7b-a3f9-48c5c08da968 service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] No waiting events found dispatching network-vif-plugged-eac88317-fb48-4ff8-b519-8695d8b3ac57 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:37:04 user nova-compute[73010]: WARNING nova.compute.manager [req-1ceacf5e-e5b6-4cfa-bebf-ef6251eb711b req-ad37acba-dda1-4c7b-a3f9-48c5c08da968 service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Received unexpected event network-vif-plugged-eac88317-fb48-4ff8-b519-8695d8b3ac57 for instance with vm_state building and task_state spawning.
Aug 15 00:37:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-4d286cfc-3611-41c7-a497-4573918e7c65 req-bda07b5c-13a4-4289-b422-54fba58607f4 service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Received event network-vif-plugged-eac88317-fb48-4ff8-b519-8695d8b3ac57 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4d286cfc-3611-41c7-a497-4573918e7c65 req-bda07b5c-13a4-4289-b422-54fba58607f4 service nova] Acquiring lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4d286cfc-3611-41c7-a497-4573918e7c65 req-bda07b5c-13a4-4289-b422-54fba58607f4 service nova] Lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4d286cfc-3611-41c7-a497-4573918e7c65 req-bda07b5c-13a4-4289-b422-54fba58607f4 service nova] Lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-4d286cfc-3611-41c7-a497-4573918e7c65 req-bda07b5c-13a4-4289-b422-54fba58607f4 service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] No waiting events found dispatching network-vif-plugged-eac88317-fb48-4ff8-b519-8695d8b3ac57 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:37:06 user nova-compute[73010]: WARNING nova.compute.manager [req-4d286cfc-3611-41c7-a497-4573918e7c65 req-bda07b5c-13a4-4289-b422-54fba58607f4 service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Received unexpected event network-vif-plugged-eac88317-fb48-4ff8-b519-8695d8b3ac57 for instance with vm_state building and task_state spawning.
Aug 15 00:37:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-4d286cfc-3611-41c7-a497-4573918e7c65 req-bda07b5c-13a4-4289-b422-54fba58607f4 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Received event network-vif-plugged-4ff59e78-ba56-4896-8f62-3cd1cc2465b4 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4d286cfc-3611-41c7-a497-4573918e7c65 req-bda07b5c-13a4-4289-b422-54fba58607f4 service nova] Acquiring lock "6dfc356b-953a-47b0-9da7-70cc59a80853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4d286cfc-3611-41c7-a497-4573918e7c65 req-bda07b5c-13a4-4289-b422-54fba58607f4 service nova] Lock "6dfc356b-953a-47b0-9da7-70cc59a80853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4d286cfc-3611-41c7-a497-4573918e7c65 req-bda07b5c-13a4-4289-b422-54fba58607f4 service nova] Lock "6dfc356b-953a-47b0-9da7-70cc59a80853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-4d286cfc-3611-41c7-a497-4573918e7c65 req-bda07b5c-13a4-4289-b422-54fba58607f4 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] No waiting events found dispatching network-vif-plugged-4ff59e78-ba56-4896-8f62-3cd1cc2465b4 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:37:06 user nova-compute[73010]: WARNING nova.compute.manager [req-4d286cfc-3611-41c7-a497-4573918e7c65 req-bda07b5c-13a4-4289-b422-54fba58607f4 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Received unexpected event network-vif-plugged-4ff59e78-ba56-4896-8f62-3cd1cc2465b4 for instance with vm_state building and task_state spawning.
Aug 15 00:37:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-4d286cfc-3611-41c7-a497-4573918e7c65 req-bda07b5c-13a4-4289-b422-54fba58607f4 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Received event network-vif-plugged-4ff59e78-ba56-4896-8f62-3cd1cc2465b4 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4d286cfc-3611-41c7-a497-4573918e7c65 req-bda07b5c-13a4-4289-b422-54fba58607f4 service nova] Acquiring lock "6dfc356b-953a-47b0-9da7-70cc59a80853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4d286cfc-3611-41c7-a497-4573918e7c65 req-bda07b5c-13a4-4289-b422-54fba58607f4 service nova] Lock "6dfc356b-953a-47b0-9da7-70cc59a80853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4d286cfc-3611-41c7-a497-4573918e7c65 req-bda07b5c-13a4-4289-b422-54fba58607f4 service nova] Lock "6dfc356b-953a-47b0-9da7-70cc59a80853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-4d286cfc-3611-41c7-a497-4573918e7c65 req-bda07b5c-13a4-4289-b422-54fba58607f4 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] No waiting events found dispatching network-vif-plugged-4ff59e78-ba56-4896-8f62-3cd1cc2465b4 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:37:06 user nova-compute[73010]: WARNING nova.compute.manager [req-4d286cfc-3611-41c7-a497-4573918e7c65 req-bda07b5c-13a4-4289-b422-54fba58607f4 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Received unexpected event network-vif-plugged-4ff59e78-ba56-4896-8f62-3cd1cc2465b4 for instance with vm_state building and task_state spawning.
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Acquiring lock "da32613e-b1a9-4733-831f-e4fb1f34995f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:07 user nova-compute[73010]: INFO nova.compute.manager [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Detaching volume 133a19e3-93e2-430c-8ae3-d3942f749ee7
Aug 15 00:37:07 user nova-compute[73010]: INFO nova.virt.block_device [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Attempting to driver detach volume 133a19e3-93e2-430c-8ae3-d3942f749ee7 from mountpoint /dev/vdb
Aug 15 00:37:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Attempting to detach device vdb from instance da32613e-b1a9-4733-831f-e4fb1f34995f from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:37:07 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:37:07 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:37:07 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:37:07 user nova-compute[73010]:   <serial>133a19e3-93e2-430c-8ae3-d3942f749ee7</serial>
Aug 15 00:37:07 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:37:07 user nova-compute[73010]: </disk>
Aug 15 00:37:07 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:37:07 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Successfully detached device vdb from instance da32613e-b1a9-4733-831f-e4fb1f34995f from the persistent domain config.
Aug 15 00:37:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance da32613e-b1a9-4733-831f-e4fb1f34995f from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:37:07 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:37:07 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:37:07 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:37:07 user nova-compute[73010]:   <serial>133a19e3-93e2-430c-8ae3-d3942f749ee7</serial>
Aug 15 00:37:07 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:37:07 user nova-compute[73010]: </disk>
Aug 15 00:37:07 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692059827.5830545, da32613e-b1a9-4733-831f-e4fb1f34995f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance da32613e-b1a9-4733-831f-e4fb1f34995f {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:37:07 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Successfully detached device vdb from instance da32613e-b1a9-4733-831f-e4fb1f34995f from the live domain config.
Aug 15 00:37:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LicNyxGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:37:07 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:37:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9d6d00-1fd0-4933-b872-2c73b90958b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[debdd4af-bd3b-470c-b3b8-50f3ab5ff31a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:37:07 user nova-compute[73010]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:37:07 user nova-compute[73010]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:37:07 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 (non-flash)
Aug 15 00:37:07 user nova-compute[73010]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:37:07 user nova-compute[73010]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:37:07 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec305ab9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7'): ({'sdb'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Removing single pathed devices sdb {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4b7001-fd5c-47a6-8d91-54dabb39804d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2f35a8-394c-4b15-b20d-74e1914ca161]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Flushing IO for device /dev/sdb {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bc7574-478d-43f9-b786-189c1567010f]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[39324cae-26ed-4f48-982b-9e742c76ee5a]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0350a681-6d33-449c-bdaf-444f64f5f28a]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[818fcf68-23c3-4f15-8826-d4226ad16c97]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7, portal: 172.16.0.220,3260]
Aug 15 00:37:07 user nova-compute[73010]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7, portal: 172.16.0.220,3260] successful.
Aug 15 00:37:07 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133a19e3-93e2-430c-8ae3-d3942f749ee7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae98157-14f3-4aae-a830-93445443bc30]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] <== disconnect_volume: return (319ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:37:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059828.0485997, 6dfc356b-953a-47b0-9da7-70cc59a80853 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:37:08 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] VM Resumed (Lifecycle Event)
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:37:08 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Instance spawned successfully.
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:37:08 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059828.0563192, 6dfc356b-953a-47b0-9da7-70cc59a80853 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:37:08 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] VM Started (Lifecycle Event)
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:37:08 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Instance spawned successfully.
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:37:08 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059828.1433313, 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:37:08 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] VM Resumed (Lifecycle Event)
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:37:08 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059828.1458566, 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:37:08 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] VM Started (Lifecycle Event)
Aug 15 00:37:08 user nova-compute[73010]: INFO nova.compute.manager [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Took 7.87 seconds to spawn the instance on the hypervisor.
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:37:08 user nova-compute[73010]: INFO nova.compute.manager [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Took 10.15 seconds to spawn the instance on the hypervisor.
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:37:08 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:37:08 user nova-compute[73010]: INFO nova.compute.manager [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Took 10.18 seconds to build instance.
Aug 15 00:37:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f673da65-defb-4a94-ae4e-add2112c648b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "6dfc356b-953a-47b0-9da7-70cc59a80853" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.352s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:08 user nova-compute[73010]: INFO nova.compute.manager [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Took 11.14 seconds to build instance.
Aug 15 00:37:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cf16d4ec-b2a9-4764-b4e0-82e74817d500 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.371s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:08 user nova-compute[73010]: DEBUG nova.objects.instance [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lazy-loading 'flavor' on Instance uuid da32613e-b1a9-4733-831f-e4fb1f34995f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:37:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-db072b8f-7ca2-4553-8c8c-e795dbf57cf0 tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.960s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:37:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 00:37:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:37:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:37:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3379f317-3461-4e86-8bdb-beb1ca3cd753 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquiring lock "4ba39c23-9f14-4eda-94f7-a07e82c92ec0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3379f317-3461-4e86-8bdb-beb1ca3cd753 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "4ba39c23-9f14-4eda-94f7-a07e82c92ec0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3379f317-3461-4e86-8bdb-beb1ca3cd753 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquiring lock "4ba39c23-9f14-4eda-94f7-a07e82c92ec0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3379f317-3461-4e86-8bdb-beb1ca3cd753 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "4ba39c23-9f14-4eda-94f7-a07e82c92ec0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3379f317-3461-4e86-8bdb-beb1ca3cd753 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "4ba39c23-9f14-4eda-94f7-a07e82c92ec0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:24 user nova-compute[73010]: INFO nova.compute.manager [None req-3379f317-3461-4e86-8bdb-beb1ca3cd753 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Terminating instance
Aug 15 00:37:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-3379f317-3461-4e86-8bdb-beb1ca3cd753 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:37:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-6e22af21-a1c5-43b4-ade7-90926cd5bf67 req-600991e6-bcc6-4b67-9cf8-bdacdfb95710 service nova] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Received event network-vif-unplugged-f683f262-ea3e-4086-9f68-27f9528a6f77 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6e22af21-a1c5-43b4-ade7-90926cd5bf67 req-600991e6-bcc6-4b67-9cf8-bdacdfb95710 service nova] Acquiring lock "4ba39c23-9f14-4eda-94f7-a07e82c92ec0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6e22af21-a1c5-43b4-ade7-90926cd5bf67 req-600991e6-bcc6-4b67-9cf8-bdacdfb95710 service nova] Lock "4ba39c23-9f14-4eda-94f7-a07e82c92ec0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6e22af21-a1c5-43b4-ade7-90926cd5bf67 req-600991e6-bcc6-4b67-9cf8-bdacdfb95710 service nova] Lock "4ba39c23-9f14-4eda-94f7-a07e82c92ec0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-6e22af21-a1c5-43b4-ade7-90926cd5bf67 req-600991e6-bcc6-4b67-9cf8-bdacdfb95710 service nova] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] No waiting events found dispatching network-vif-unplugged-f683f262-ea3e-4086-9f68-27f9528a6f77 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:37:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-6e22af21-a1c5-43b4-ade7-90926cd5bf67 req-600991e6-bcc6-4b67-9cf8-bdacdfb95710 service nova] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Received event network-vif-unplugged-f683f262-ea3e-4086-9f68-27f9528a6f77 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:37:25 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Instance destroyed successfully.
Aug 15 00:37:25 user nova-compute[73010]: DEBUG nova.objects.instance [None req-3379f317-3461-4e86-8bdb-beb1ca3cd753 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lazy-loading 'resources' on Instance uuid 4ba39c23-9f14-4eda-94f7-a07e82c92ec0 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:37:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-3379f317-3461-4e86-8bdb-beb1ca3cd753 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:35:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-298787467',display_name='tempest-VolumesAdminNegativeTest-server-298787467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-298787467',id=13,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:35:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a620c803f76045d6a5b5b78ec1894c5f',ramdisk_id='',reservation_id='r-520bnh7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-507850758',owner_user_name='tempest-VolumesAdminNegativeTest-507850758-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:35:32Z,user_data=None,user_id='f8948cbf02ab4061a56a10037186f60e',uuid=4ba39c23-9f14-4eda-94f7-a07e82c92ec0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f683f262-ea3e-4086-9f68-27f9528a6f77", "address": "fa:16:3e:68:85:e1", "network": {"id": "9aa91991-9d4c-4b0d-a955-652df703cde1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-393715584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a620c803f76045d6a5b5b78ec1894c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf683f262-ea", "ovs_interfaceid": "f683f262-ea3e-4086-9f68-27f9528a6f77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:37:25 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-3379f317-3461-4e86-8bdb-beb1ca3cd753 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Converting VIF {"id": "f683f262-ea3e-4086-9f68-27f9528a6f77", "address": "fa:16:3e:68:85:e1", "network": {"id": "9aa91991-9d4c-4b0d-a955-652df703cde1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-393715584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a620c803f76045d6a5b5b78ec1894c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf683f262-ea", "ovs_interfaceid": "f683f262-ea3e-4086-9f68-27f9528a6f77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:37:25 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-3379f317-3461-4e86-8bdb-beb1ca3cd753 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:85:e1,bridge_name='br-int',has_traffic_filtering=True,id=f683f262-ea3e-4086-9f68-27f9528a6f77,network=Network(9aa91991-9d4c-4b0d-a955-652df703cde1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf683f262-ea') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:37:25 user nova-compute[73010]: DEBUG os_vif [None req-3379f317-3461-4e86-8bdb-beb1ca3cd753 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:85:e1,bridge_name='br-int',has_traffic_filtering=True,id=f683f262-ea3e-4086-9f68-27f9528a6f77,network=Network(9aa91991-9d4c-4b0d-a955-652df703cde1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf683f262-ea') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:37:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf683f262-ea, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:37:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:37:25 user nova-compute[73010]: INFO os_vif [None req-3379f317-3461-4e86-8bdb-beb1ca3cd753 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:85:e1,bridge_name='br-int',has_traffic_filtering=True,id=f683f262-ea3e-4086-9f68-27f9528a6f77,network=Network(9aa91991-9d4c-4b0d-a955-652df703cde1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf683f262-ea')
Aug 15 00:37:25 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-3379f317-3461-4e86-8bdb-beb1ca3cd753 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Deleting instance files /opt/stack/data/nova/instances/4ba39c23-9f14-4eda-94f7-a07e82c92ec0_del
Aug 15 00:37:25 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-3379f317-3461-4e86-8bdb-beb1ca3cd753 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Deletion of /opt/stack/data/nova/instances/4ba39c23-9f14-4eda-94f7-a07e82c92ec0_del complete
Aug 15 00:37:25 user nova-compute[73010]: INFO nova.compute.manager [None req-3379f317-3461-4e86-8bdb-beb1ca3cd753 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Took 0.77 seconds to destroy the instance on the hypervisor.
Aug 15 00:37:25 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-3379f317-3461-4e86-8bdb-beb1ca3cd753 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:37:25 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:37:25 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:37:25 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:37:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:26 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Took 0.63 seconds to deallocate network for instance.
Aug 15 00:37:26 user nova-compute[73010]: DEBUG nova.compute.manager [req-5a7ae5b0-6110-45e5-ab03-797f37528b96 req-a04b6978-d656-47f0-89f6-c81a29cd2978 service nova] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Received event network-vif-deleted-f683f262-ea3e-4086-9f68-27f9528a6f77 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3379f317-3461-4e86-8bdb-beb1ca3cd753 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3379f317-3461-4e86-8bdb-beb1ca3cd753 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:26 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-3379f317-3461-4e86-8bdb-beb1ca3cd753 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:37:26 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-3379f317-3461-4e86-8bdb-beb1ca3cd753 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:37:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3379f317-3461-4e86-8bdb-beb1ca3cd753 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:26 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-3379f317-3461-4e86-8bdb-beb1ca3cd753 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Deleted allocations for instance 4ba39c23-9f14-4eda-94f7-a07e82c92ec0
Aug 15 00:37:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3379f317-3461-4e86-8bdb-beb1ca3cd753 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "4ba39c23-9f14-4eda-94f7-a07e82c92ec0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.146s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:27 user nova-compute[73010]: DEBUG nova.compute.manager [req-90bdd323-8e39-4fc1-a70b-abb92abaec53 req-5b77eedf-a795-43e7-9291-d9f28fe99ea9 service nova] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Received event network-vif-plugged-f683f262-ea3e-4086-9f68-27f9528a6f77 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-90bdd323-8e39-4fc1-a70b-abb92abaec53 req-5b77eedf-a795-43e7-9291-d9f28fe99ea9 service nova] Acquiring lock "4ba39c23-9f14-4eda-94f7-a07e82c92ec0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-90bdd323-8e39-4fc1-a70b-abb92abaec53 req-5b77eedf-a795-43e7-9291-d9f28fe99ea9 service nova] Lock "4ba39c23-9f14-4eda-94f7-a07e82c92ec0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-90bdd323-8e39-4fc1-a70b-abb92abaec53 req-5b77eedf-a795-43e7-9291-d9f28fe99ea9 service nova] Lock "4ba39c23-9f14-4eda-94f7-a07e82c92ec0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:27 user nova-compute[73010]: DEBUG nova.compute.manager [req-90bdd323-8e39-4fc1-a70b-abb92abaec53 req-5b77eedf-a795-43e7-9291-d9f28fe99ea9 service nova] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] No waiting events found dispatching network-vif-plugged-f683f262-ea3e-4086-9f68-27f9528a6f77 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:37:27 user nova-compute[73010]: WARNING nova.compute.manager [req-90bdd323-8e39-4fc1-a70b-abb92abaec53 req-5b77eedf-a795-43e7-9291-d9f28fe99ea9 service nova] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Received unexpected event network-vif-plugged-f683f262-ea3e-4086-9f68-27f9528a6f77 for instance with vm_state deleted and task_state None.
Aug 15 00:37:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:34 user nova-compute[73010]: DEBUG nova.compute.manager [req-31ea40fb-4066-4dfd-be42-2b0cbf1e37c6 req-2c19baee-9426-49d5-ab9f-8928c6ab4770 service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Received event network-changed-30aa2ade-cfae-4c5a-aecc-3ddfadea1000 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:34 user nova-compute[73010]: DEBUG nova.compute.manager [req-31ea40fb-4066-4dfd-be42-2b0cbf1e37c6 req-2c19baee-9426-49d5-ab9f-8928c6ab4770 service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Refreshing instance network info cache due to event network-changed-30aa2ade-cfae-4c5a-aecc-3ddfadea1000. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:37:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-31ea40fb-4066-4dfd-be42-2b0cbf1e37c6 req-2c19baee-9426-49d5-ab9f-8928c6ab4770 service nova] Acquiring lock "refresh_cache-52878f3e-3ffa-4b1b-b842-ca2215454a3e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:37:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-31ea40fb-4066-4dfd-be42-2b0cbf1e37c6 req-2c19baee-9426-49d5-ab9f-8928c6ab4770 service nova] Acquired lock "refresh_cache-52878f3e-3ffa-4b1b-b842-ca2215454a3e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:37:34 user nova-compute[73010]: DEBUG nova.network.neutron [req-31ea40fb-4066-4dfd-be42-2b0cbf1e37c6 req-2c19baee-9426-49d5-ab9f-8928c6ab4770 service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Refreshing network info cache for port 30aa2ade-cfae-4c5a-aecc-3ddfadea1000 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:37:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Acquiring lock "interface-52878f3e-3ffa-4b1b-b842-ca2215454a3e-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "interface-52878f3e-3ffa-4b1b-b842-ca2215454a3e-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:35 user nova-compute[73010]: DEBUG nova.objects.instance [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lazy-loading 'flavor' on Instance uuid 52878f3e-3ffa-4b1b-b842-ca2215454a3e {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:37:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:35 user nova-compute[73010]: DEBUG nova.objects.instance [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lazy-loading 'pci_requests' on Instance uuid 52878f3e-3ffa-4b1b-b842-ca2215454a3e {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:37:35 user nova-compute[73010]: DEBUG nova.network.neutron [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:37:35 user nova-compute[73010]: DEBUG nova.policy [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca2df8041ee64a82a97814ab342008b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05feaf1f5e24465d9e3560741bb5f595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:37:35 user nova-compute[73010]: DEBUG nova.network.neutron [req-31ea40fb-4066-4dfd-be42-2b0cbf1e37c6 req-2c19baee-9426-49d5-ab9f-8928c6ab4770 service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Updated VIF entry in instance network info cache for port 30aa2ade-cfae-4c5a-aecc-3ddfadea1000. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:37:35 user nova-compute[73010]: DEBUG nova.network.neutron [req-31ea40fb-4066-4dfd-be42-2b0cbf1e37c6 req-2c19baee-9426-49d5-ab9f-8928c6ab4770 service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Updating instance_info_cache with network_info: [{"id": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "address": "fa:16:3e:4d:03:9e", "network": {"id": "35a82886-0b11-43bd-adcf-7d64cd9afdc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719337962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05feaf1f5e24465d9e3560741bb5f595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30aa2ade-cf", "ovs_interfaceid": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:37:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-31ea40fb-4066-4dfd-be42-2b0cbf1e37c6 req-2c19baee-9426-49d5-ab9f-8928c6ab4770 service nova] Releasing lock "refresh_cache-52878f3e-3ffa-4b1b-b842-ca2215454a3e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:37:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:36 user nova-compute[73010]: DEBUG nova.network.neutron [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Successfully created port: abc9fcfb-9358-4a10-8c8b-edcf21901762 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:37:37 user nova-compute[73010]: DEBUG nova.network.neutron [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Successfully updated port: abc9fcfb-9358-4a10-8c8b-edcf21901762 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:37:37 user nova-compute[73010]: DEBUG nova.compute.manager [req-db8e210d-e083-4baa-b590-86b259456055 req-e6243246-affc-46b0-9d09-d7d9528de054 service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Received event network-changed-abc9fcfb-9358-4a10-8c8b-edcf21901762 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:37 user nova-compute[73010]: DEBUG nova.compute.manager [req-db8e210d-e083-4baa-b590-86b259456055 req-e6243246-affc-46b0-9d09-d7d9528de054 service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Refreshing instance network info cache due to event network-changed-abc9fcfb-9358-4a10-8c8b-edcf21901762. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:37:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-db8e210d-e083-4baa-b590-86b259456055 req-e6243246-affc-46b0-9d09-d7d9528de054 service nova] Acquiring lock "refresh_cache-52878f3e-3ffa-4b1b-b842-ca2215454a3e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:37:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-db8e210d-e083-4baa-b590-86b259456055 req-e6243246-affc-46b0-9d09-d7d9528de054 service nova] Acquired lock "refresh_cache-52878f3e-3ffa-4b1b-b842-ca2215454a3e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:37:37 user nova-compute[73010]: DEBUG nova.network.neutron [req-db8e210d-e083-4baa-b590-86b259456055 req-e6243246-affc-46b0-9d09-d7d9528de054 service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Refreshing network info cache for port abc9fcfb-9358-4a10-8c8b-edcf21901762 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:37:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Acquiring lock "refresh_cache-52878f3e-3ffa-4b1b-b842-ca2215454a3e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG nova.network.neutron [req-db8e210d-e083-4baa-b590-86b259456055 req-e6243246-affc-46b0-9d09-d7d9528de054 service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Added VIF to instance network info cache for port abc9fcfb-9358-4a10-8c8b-edcf21901762. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG nova.network.neutron [req-db8e210d-e083-4baa-b590-86b259456055 req-e6243246-affc-46b0-9d09-d7d9528de054 service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Updating instance_info_cache with network_info: [{"id": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "address": "fa:16:3e:4d:03:9e", "network": {"id": "35a82886-0b11-43bd-adcf-7d64cd9afdc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719337962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05feaf1f5e24465d9e3560741bb5f595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30aa2ade-cf", "ovs_interfaceid": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abc9fcfb-9358-4a10-8c8b-edcf21901762", "address": "fa:16:3e:37:8d:8d", "network": {"id": "89f6414b-a104-4e54-ac37-a4b659a3c132", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1528839876", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "05feaf1f5e24465d9e3560741bb5f595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9fcfb-93", "ovs_interfaceid": "abc9fcfb-9358-4a10-8c8b-edcf21901762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-db8e210d-e083-4baa-b590-86b259456055 req-e6243246-affc-46b0-9d09-d7d9528de054 service nova] Releasing lock "refresh_cache-52878f3e-3ffa-4b1b-b842-ca2215454a3e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Acquired lock "refresh_cache-52878f3e-3ffa-4b1b-b842-ca2215454a3e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG nova.network.neutron [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:37:38 user nova-compute[73010]: WARNING nova.network.neutron [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] 89f6414b-a104-4e54-ac37-a4b659a3c132 already exists in list: networks containing: ['89f6414b-a104-4e54-ac37-a4b659a3c132']. ignoring it
Aug 15 00:37:38 user nova-compute[73010]: WARNING nova.network.neutron [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] abc9fcfb-9358-4a10-8c8b-edcf21901762 already exists in list: port_ids containing: ['abc9fcfb-9358-4a10-8c8b-edcf21901762']. ignoring it
Aug 15 00:37:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquiring lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG nova.compute.manager [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:37:38 user nova-compute[73010]: INFO nova.compute.claims [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Claim successful on node user
Aug 15 00:37:38 user nova-compute[73010]: DEBUG nova.network.neutron [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Updating instance_info_cache with network_info: [{"id": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "address": "fa:16:3e:4d:03:9e", "network": {"id": "35a82886-0b11-43bd-adcf-7d64cd9afdc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719337962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05feaf1f5e24465d9e3560741bb5f595", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30aa2ade-cf", "ovs_interfaceid": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abc9fcfb-9358-4a10-8c8b-edcf21901762", "address": "fa:16:3e:37:8d:8d", "network": {"id": "89f6414b-a104-4e54-ac37-a4b659a3c132", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1528839876", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "05feaf1f5e24465d9e3560741bb5f595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9fcfb-93", "ovs_interfaceid": "abc9fcfb-9358-4a10-8c8b-edcf21901762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Releasing lock "refresh_cache-52878f3e-3ffa-4b1b-b842-ca2215454a3e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1403916647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1403916647',id=14,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTpqd0AO5cR/8y8DOTel0pu1KfJ9BbuQ2tYkoDS5WHMZgu+jFCinV11caUfGX5tzP78Z/KTQ4jpvDxB89/wwhV2id1x6y1BOAyCNEVTVJLgpj3ceNjhqPbgEXUOXteS+w==',key_name='tempest-keypair-434770644',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:35:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='05feaf1f5e24465d9e3560741bb5f595',ramdisk_id='',reservation_id='r-wnii2rsz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1572033819',owner_user_name='tempest-TaggedAttachmentsTest-1572033819-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:35:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca2df8041ee64a82a97814ab342008b4',uuid=52878f3e-3ffa-4b1b-b842-ca2215454a3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abc9fcfb-9358-4a10-8c8b-edcf21901762", "address": "fa:16:3e:37:8d:8d", "network": {"id": "89f6414b-a104-4e54-ac37-a4b659a3c132", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1528839876", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "05feaf1f5e24465d9e3560741bb5f595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9fcfb-93", "ovs_interfaceid": "abc9fcfb-9358-4a10-8c8b-edcf21901762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Converting VIF {"id": "abc9fcfb-9358-4a10-8c8b-edcf21901762", "address": "fa:16:3e:37:8d:8d", "network": {"id": "89f6414b-a104-4e54-ac37-a4b659a3c132", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1528839876", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "05feaf1f5e24465d9e3560741bb5f595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9fcfb-93", "ovs_interfaceid": "abc9fcfb-9358-4a10-8c8b-edcf21901762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:8d:8d,bridge_name='br-int',has_traffic_filtering=True,id=abc9fcfb-9358-4a10-8c8b-edcf21901762,network=Network(89f6414b-a104-4e54-ac37-a4b659a3c132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc9fcfb-93') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG os_vif [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:8d:8d,bridge_name='br-int',has_traffic_filtering=True,id=abc9fcfb-9358-4a10-8c8b-edcf21901762,network=Network(89f6414b-a104-4e54-ac37-a4b659a3c132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc9fcfb-93') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabc9fcfb-93, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapabc9fcfb-93, col_values=(('external_ids', {'iface-id': 'abc9fcfb-9358-4a10-8c8b-edcf21901762', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:8d:8d', 'vm-uuid': '52878f3e-3ffa-4b1b-b842-ca2215454a3e'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:38 user nova-compute[73010]: INFO os_vif [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:8d:8d,bridge_name='br-int',has_traffic_filtering=True,id=abc9fcfb-9358-4a10-8c8b-edcf21901762,network=Network(89f6414b-a104-4e54-ac37-a4b659a3c132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc9fcfb-93')
Aug 15 00:37:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1403916647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1403916647',id=14,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTpqd0AO5cR/8y8DOTel0pu1KfJ9BbuQ2tYkoDS5WHMZgu+jFCinV11caUfGX5tzP78Z/KTQ4jpvDxB89/wwhV2id1x6y1BOAyCNEVTVJLgpj3ceNjhqPbgEXUOXteS+w==',key_name='tempest-keypair-434770644',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:35:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='05feaf1f5e24465d9e3560741bb5f595',ramdisk_id='',reservation_id='r-wnii2rsz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1572033819',owner_user_name='tempest-TaggedAttachmentsTest-1572033819-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:35:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca2df8041ee64a82a97814ab342008b4',uuid=52878f3e-3ffa-4b1b-b842-ca2215454a3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abc9fcfb-9358-4a10-8c8b-edcf21901762", "address": "fa:16:3e:37:8d:8d", "network": {"id": "89f6414b-a104-4e54-ac37-a4b659a3c132", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1528839876", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "05feaf1f5e24465d9e3560741bb5f595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9fcfb-93", "ovs_interfaceid": "abc9fcfb-9358-4a10-8c8b-edcf21901762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Converting VIF {"id": "abc9fcfb-9358-4a10-8c8b-edcf21901762", "address": "fa:16:3e:37:8d:8d", "network": {"id": "89f6414b-a104-4e54-ac37-a4b659a3c132", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1528839876", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "05feaf1f5e24465d9e3560741bb5f595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9fcfb-93", "ovs_interfaceid": "abc9fcfb-9358-4a10-8c8b-edcf21901762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:8d:8d,bridge_name='br-int',has_traffic_filtering=True,id=abc9fcfb-9358-4a10-8c8b-edcf21901762,network=Network(89f6414b-a104-4e54-ac37-a4b659a3c132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc9fcfb-93') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] attach device xml: <interface type="ethernet">
Aug 15 00:37:38 user nova-compute[73010]:   <mac address="fa:16:3e:37:8d:8d"/>
Aug 15 00:37:38 user nova-compute[73010]:   <model type="virtio"/>
Aug 15 00:37:38 user nova-compute[73010]:   <mtu size="1442"/>
Aug 15 00:37:38 user nova-compute[73010]:   <target dev="tapabc9fcfb-93"/>
Aug 15 00:37:38 user nova-compute[73010]: </interface>
Aug 15 00:37:38 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:37:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG nova.compute.manager [req-265c2f31-76aa-408c-a1ae-7db6512766e9 req-1885c3a3-9422-4f6a-9450-a7bca81f7e0a service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Received event network-vif-plugged-abc9fcfb-9358-4a10-8c8b-edcf21901762 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-265c2f31-76aa-408c-a1ae-7db6512766e9 req-1885c3a3-9422-4f6a-9450-a7bca81f7e0a service nova] Acquiring lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-265c2f31-76aa-408c-a1ae-7db6512766e9 req-1885c3a3-9422-4f6a-9450-a7bca81f7e0a service nova] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-265c2f31-76aa-408c-a1ae-7db6512766e9 req-1885c3a3-9422-4f6a-9450-a7bca81f7e0a service nova] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG nova.compute.manager [req-265c2f31-76aa-408c-a1ae-7db6512766e9 req-1885c3a3-9422-4f6a-9450-a7bca81f7e0a service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] No waiting events found dispatching network-vif-plugged-abc9fcfb-9358-4a10-8c8b-edcf21901762 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:37:39 user nova-compute[73010]: WARNING nova.compute.manager [req-265c2f31-76aa-408c-a1ae-7db6512766e9 req-1885c3a3-9422-4f6a-9450-a7bca81f7e0a service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Received unexpected event network-vif-plugged-abc9fcfb-9358-4a10-8c8b-edcf21901762 for instance with vm_state active and task_state None.
Aug 15 00:37:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.624s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG nova.network.neutron [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:37:39 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:37:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] No BDM found with device name hda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] No VIF found with MAC fa:16:3e:4d:03:9e, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:37:39 user nova-compute[73010]:   <nova:package version="0.0.0"/>
Aug 15 00:37:39 user nova-compute[73010]:   <nova:name>tempest-device-tagging-server-1403916647</nova:name>
Aug 15 00:37:39 user nova-compute[73010]:   <nova:creationTime>2023-08-15 00:37:39</nova:creationTime>
Aug 15 00:37:39 user nova-compute[73010]:   <nova:flavor name="m1.tiny">
Aug 15 00:37:39 user nova-compute[73010]:     <nova:memory>512</nova:memory>
Aug 15 00:37:39 user nova-compute[73010]:     <nova:disk>1</nova:disk>
Aug 15 00:37:39 user nova-compute[73010]:     <nova:swap>0</nova:swap>
Aug 15 00:37:39 user nova-compute[73010]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:37:39 user nova-compute[73010]:     <nova:vcpus>1</nova:vcpus>
Aug 15 00:37:39 user nova-compute[73010]:   </nova:flavor>
Aug 15 00:37:39 user nova-compute[73010]:   <nova:owner>
Aug 15 00:37:39 user nova-compute[73010]:     <nova:user uuid="ca2df8041ee64a82a97814ab342008b4">tempest-TaggedAttachmentsTest-1572033819-project-member</nova:user>
Aug 15 00:37:39 user nova-compute[73010]:     <nova:project uuid="05feaf1f5e24465d9e3560741bb5f595">tempest-TaggedAttachmentsTest-1572033819</nova:project>
Aug 15 00:37:39 user nova-compute[73010]:   </nova:owner>
Aug 15 00:37:39 user nova-compute[73010]:   <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:37:39 user nova-compute[73010]:   <nova:ports>
Aug 15 00:37:39 user nova-compute[73010]:     <nova:port uuid="30aa2ade-cfae-4c5a-aecc-3ddfadea1000">
Aug 15 00:37:39 user nova-compute[73010]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 00:37:39 user nova-compute[73010]:     </nova:port>
Aug 15 00:37:39 user nova-compute[73010]:     <nova:port uuid="abc9fcfb-9358-4a10-8c8b-edcf21901762">
Aug 15 00:37:39 user nova-compute[73010]:       <nova:ip type="fixed" address="10.10.10.44" ipVersion="4"/>
Aug 15 00:37:39 user nova-compute[73010]:     </nova:port>
Aug 15 00:37:39 user nova-compute[73010]:   </nova:ports>
Aug 15 00:37:39 user nova-compute[73010]: </nova:instance>
Aug 15 00:37:39 user nova-compute[73010]:  {{(pid=73010) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-15d5e290-46db-424c-aea0-c96ee168cb3b tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "interface-52878f3e-3ffa-4b1b-b842-ca2215454a3e-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.413s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:37:39 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Creating image(s)
Aug 15 00:37:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquiring lock "/opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "/opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "/opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG nova.policy [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0256395ac9eb4654932c0fe37dea75c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadfec8dd5ed4c8b8c8730c98b2711ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.205s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Acquiring lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG nova.objects.instance [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lazy-loading 'flavor' on Instance uuid 52878f3e-3ffa-4b1b-b842-ca2215454a3e {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.185s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk 1073741824" returned: 0 in 0.225s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.415s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692059845.2389135, 4ba39c23-9f14-4eda-94f7-a07e82c92ec0 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:37:40 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] VM Stopped (Lifecycle Event)
Aug 15 00:37:40 user nova-compute[73010]: DEBUG nova.compute.manager [None req-0260a011-b929-489b-9851-a6cbc1b70b78 None None] [instance: 4ba39c23-9f14-4eda-94f7-a07e82c92ec0] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Acquiring lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:40 user nova-compute[73010]: INFO nova.compute.manager [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Attaching volume a34fb63c-348a-4316-9dc7-c69eb4b60cd9 to /dev/vdb
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.204s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG nova.network.neutron [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Successfully created port: 5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG os_brick.utils [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da78186-7faa-4d9d-bdb6-71de91e6a1c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[626b6cf8-fbfd-4cc6-a610-6a7a5151dbb8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e17e88-5943-466d-8b37-2e3903d0d140]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6235c484-a31e-4bad-868c-27aef555a062]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:37:40 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[880533d9-7b25-48ea-a58e-066bf7adeb24]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG os_brick.utils [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Updating existing volume attachment record: f37a6301-1383-47eb-9464-47895e9fcd1b {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Cannot resize image /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG nova.objects.instance [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lazy-loading 'migration_context' on Instance uuid f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Ensure instance console log exists: /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-1deaaf9a-2d45-4940-bc05-4b62b9db086b req-4c2df079-d542-457f-a935-69e0062c0c25 service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Received event network-vif-plugged-abc9fcfb-9358-4a10-8c8b-edcf21901762 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1deaaf9a-2d45-4940-bc05-4b62b9db086b req-4c2df079-d542-457f-a935-69e0062c0c25 service nova] Acquiring lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1deaaf9a-2d45-4940-bc05-4b62b9db086b req-4c2df079-d542-457f-a935-69e0062c0c25 service nova] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1deaaf9a-2d45-4940-bc05-4b62b9db086b req-4c2df079-d542-457f-a935-69e0062c0c25 service nova] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-1deaaf9a-2d45-4940-bc05-4b62b9db086b req-4c2df079-d542-457f-a935-69e0062c0c25 service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] No waiting events found dispatching network-vif-plugged-abc9fcfb-9358-4a10-8c8b-edcf21901762 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:37:41 user nova-compute[73010]: WARNING nova.compute.manager [req-1deaaf9a-2d45-4940-bc05-4b62b9db086b req-4c2df079-d542-457f-a935-69e0062c0c25 service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Received unexpected event network-vif-plugged-abc9fcfb-9358-4a10-8c8b-edcf21901762 for instance with vm_state active and task_state None.
Aug 15 00:37:41 user nova-compute[73010]: DEBUG nova.network.neutron [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Successfully updated port: 5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:37:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquiring lock "refresh_cache-f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:37:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquired lock "refresh_cache-f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:37:41 user nova-compute[73010]: DEBUG nova.network.neutron [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:37:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-2314e84d-3e79-45e5-9cdb-a52d1fdaa326 req-70da2d54-55cd-4d73-a352-15023fa77183 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received event network-changed-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-2314e84d-3e79-45e5-9cdb-a52d1fdaa326 req-70da2d54-55cd-4d73-a352-15023fa77183 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Refreshing instance network info cache due to event network-changed-5db62e1b-e013-4958-8470-da256258503d. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:37:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2314e84d-3e79-45e5-9cdb-a52d1fdaa326 req-70da2d54-55cd-4d73-a352-15023fa77183 service nova] Acquiring lock "refresh_cache-f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:37:41 user nova-compute[73010]: DEBUG nova.network.neutron [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.network.neutron [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Updating instance_info_cache with network_info: [{"id": "5db62e1b-e013-4958-8470-da256258503d", "address": "fa:16:3e:71:55:dd", "network": {"id": "22954f6c-78d2-40d7-91fc-1e8eb0881e40", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1057005040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadfec8dd5ed4c8b8c8730c98b2711ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db62e1b-e0", "ovs_interfaceid": "5db62e1b-e013-4958-8470-da256258503d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Releasing lock "refresh_cache-f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Instance network_info: |[{"id": "5db62e1b-e013-4958-8470-da256258503d", "address": "fa:16:3e:71:55:dd", "network": {"id": "22954f6c-78d2-40d7-91fc-1e8eb0881e40", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1057005040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadfec8dd5ed4c8b8c8730c98b2711ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db62e1b-e0", "ovs_interfaceid": "5db62e1b-e013-4958-8470-da256258503d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2314e84d-3e79-45e5-9cdb-a52d1fdaa326 req-70da2d54-55cd-4d73-a352-15023fa77183 service nova] Acquired lock "refresh_cache-f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.network.neutron [req-2314e84d-3e79-45e5-9cdb-a52d1fdaa326 req-70da2d54-55cd-4d73-a352-15023fa77183 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Refreshing network info cache for port 5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Start _get_guest_xml network_info=[{"id": "5db62e1b-e013-4958-8470-da256258503d", "address": "fa:16:3e:71:55:dd", "network": {"id": "22954f6c-78d2-40d7-91fc-1e8eb0881e40", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1057005040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadfec8dd5ed4c8b8c8730c98b2711ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db62e1b-e0", "ovs_interfaceid": "5db62e1b-e013-4958-8470-da256258503d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:37:42 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:37:42 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:37:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-187035777',display_name='tempest-ServerStableDeviceRescueTest-server-187035777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-187035777',id=18,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl48HAmcfFRrH0rUkUHs/8dSGQIF1uCxQEyzMtTaxr3R25Tjk85cbgCHshsmycnRK+vD67hffvzQCcRdwaXrKsXIdJGDiJmiNMcQzgqMkHe9ej/2bb6LdarHKVQSu8gAg==',key_name='tempest-keypair-1148060121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aadfec8dd5ed4c8b8c8730c98b2711ff',ramdisk_id='',reservation_id='r-rd3n8zy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1325761686',owner_user_name='tempest-ServerStableDeviceRescueTest-1325761686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:37:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0256395ac9eb4654932c0fe37dea75c1',uuid=f22d29a4-26d1-4bfd-acf7-80dcdbc4d889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5db62e1b-e013-4958-8470-da256258503d", "address": "fa:16:3e:71:55:dd", "network": {"id": "22954f6c-78d2-40d7-91fc-1e8eb0881e40", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1057005040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadfec8dd5ed4c8b8c8730c98b2711ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db62e1b-e0", "ovs_interfaceid": "5db62e1b-e013-4958-8470-da256258503d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Converting VIF {"id": "5db62e1b-e013-4958-8470-da256258503d", "address": "fa:16:3e:71:55:dd", "network": {"id": "22954f6c-78d2-40d7-91fc-1e8eb0881e40", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1057005040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadfec8dd5ed4c8b8c8730c98b2711ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db62e1b-e0", "ovs_interfaceid": "5db62e1b-e013-4958-8470-da256258503d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:55:dd,bridge_name='br-int',has_traffic_filtering=True,id=5db62e1b-e013-4958-8470-da256258503d,network=Network(22954f6c-78d2-40d7-91fc-1e8eb0881e40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db62e1b-e0') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.objects.instance [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lazy-loading 'pci_devices' on Instance uuid f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:37:42 user nova-compute[73010]:   <uuid>f22d29a4-26d1-4bfd-acf7-80dcdbc4d889</uuid>
Aug 15 00:37:42 user nova-compute[73010]:   <name>instance-00000012</name>
Aug 15 00:37:42 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:37:42 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:37:42 user nova-compute[73010]:   <metadata>
Aug 15 00:37:42 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:37:42 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:37:42 user nova-compute[73010]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-187035777</nova:name>
Aug 15 00:37:42 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:37:42</nova:creationTime>
Aug 15 00:37:42 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:37:42 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:37:42 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:37:42 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:37:42 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:37:42 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:37:42 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:37:42 user nova-compute[73010]:       <nova:owner>
Aug 15 00:37:42 user nova-compute[73010]:         <nova:user uuid="0256395ac9eb4654932c0fe37dea75c1">tempest-ServerStableDeviceRescueTest-1325761686-project-member</nova:user>
Aug 15 00:37:42 user nova-compute[73010]:         <nova:project uuid="aadfec8dd5ed4c8b8c8730c98b2711ff">tempest-ServerStableDeviceRescueTest-1325761686</nova:project>
Aug 15 00:37:42 user nova-compute[73010]:       </nova:owner>
Aug 15 00:37:42 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:37:42 user nova-compute[73010]:       <nova:ports>
Aug 15 00:37:42 user nova-compute[73010]:         <nova:port uuid="5db62e1b-e013-4958-8470-da256258503d">
Aug 15 00:37:42 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 00:37:42 user nova-compute[73010]:         </nova:port>
Aug 15 00:37:42 user nova-compute[73010]:       </nova:ports>
Aug 15 00:37:42 user nova-compute[73010]:     </nova:instance>
Aug 15 00:37:42 user nova-compute[73010]:   </metadata>
Aug 15 00:37:42 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:37:42 user nova-compute[73010]:     <system>
Aug 15 00:37:42 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:37:42 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:37:42 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:37:42 user nova-compute[73010]:       <entry name="serial">f22d29a4-26d1-4bfd-acf7-80dcdbc4d889</entry>
Aug 15 00:37:42 user nova-compute[73010]:       <entry name="uuid">f22d29a4-26d1-4bfd-acf7-80dcdbc4d889</entry>
Aug 15 00:37:42 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:37:42 user nova-compute[73010]:     </system>
Aug 15 00:37:42 user nova-compute[73010]:   </sysinfo>
Aug 15 00:37:42 user nova-compute[73010]:   <os>
Aug 15 00:37:42 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:37:42 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:37:42 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:37:42 user nova-compute[73010]:   </os>
Aug 15 00:37:42 user nova-compute[73010]:   <features>
Aug 15 00:37:42 user nova-compute[73010]:     <acpi/>
Aug 15 00:37:42 user nova-compute[73010]:     <apic/>
Aug 15 00:37:42 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:37:42 user nova-compute[73010]:   </features>
Aug 15 00:37:42 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:37:42 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:37:42 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:37:42 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:37:42 user nova-compute[73010]:   </clock>
Aug 15 00:37:42 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:37:42 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:37:42 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:37:42 user nova-compute[73010]:   </cpu>
Aug 15 00:37:42 user nova-compute[73010]:   <devices>
Aug 15 00:37:42 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:37:42 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:37:42 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk"/>
Aug 15 00:37:42 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:37:42 user nova-compute[73010]:     </disk>
Aug 15 00:37:42 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:37:42 user nova-compute[73010]:       <mac address="fa:16:3e:71:55:dd"/>
Aug 15 00:37:42 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:37:42 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:37:42 user nova-compute[73010]:       <target dev="tap5db62e1b-e0"/>
Aug 15 00:37:42 user nova-compute[73010]:     </interface>
Aug 15 00:37:42 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:37:42 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/console.log" append="off"/>
Aug 15 00:37:42 user nova-compute[73010]:     </serial>
Aug 15 00:37:42 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:37:42 user nova-compute[73010]:     <video>
Aug 15 00:37:42 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:37:42 user nova-compute[73010]:     </video>
Aug 15 00:37:42 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:37:42 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:37:42 user nova-compute[73010]:     </rng>
Aug 15 00:37:42 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:37:42 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:37:42 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:37:42 user nova-compute[73010]:     </memballoon>
Aug 15 00:37:42 user nova-compute[73010]:   </devices>
Aug 15 00:37:42 user nova-compute[73010]: </domain>
Aug 15 00:37:42 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:37:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-187035777',display_name='tempest-ServerStableDeviceRescueTest-server-187035777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-187035777',id=18,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl48HAmcfFRrH0rUkUHs/8dSGQIF1uCxQEyzMtTaxr3R25Tjk85cbgCHshsmycnRK+vD67hffvzQCcRdwaXrKsXIdJGDiJmiNMcQzgqMkHe9ej/2bb6LdarHKVQSu8gAg==',key_name='tempest-keypair-1148060121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aadfec8dd5ed4c8b8c8730c98b2711ff',ramdisk_id='',reservation_id='r-rd3n8zy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1325761686',owner_user_name='tempest-ServerStableDeviceRescueTest-1325761686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:37:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0256395ac9eb4654932c0fe37dea75c1',uuid=f22d29a4-26d1-4bfd-acf7-80dcdbc4d889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5db62e1b-e013-4958-8470-da256258503d", "address": "fa:16:3e:71:55:dd", "network": {"id": "22954f6c-78d2-40d7-91fc-1e8eb0881e40", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1057005040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadfec8dd5ed4c8b8c8730c98b2711ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db62e1b-e0", "ovs_interfaceid": "5db62e1b-e013-4958-8470-da256258503d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Converting VIF {"id": "5db62e1b-e013-4958-8470-da256258503d", "address": "fa:16:3e:71:55:dd", "network": {"id": "22954f6c-78d2-40d7-91fc-1e8eb0881e40", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1057005040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadfec8dd5ed4c8b8c8730c98b2711ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db62e1b-e0", "ovs_interfaceid": "5db62e1b-e013-4958-8470-da256258503d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:55:dd,bridge_name='br-int',has_traffic_filtering=True,id=5db62e1b-e013-4958-8470-da256258503d,network=Network(22954f6c-78d2-40d7-91fc-1e8eb0881e40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db62e1b-e0') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG os_vif [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:55:dd,bridge_name='br-int',has_traffic_filtering=True,id=5db62e1b-e013-4958-8470-da256258503d,network=Network(22954f6c-78d2-40d7-91fc-1e8eb0881e40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db62e1b-e0') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5db62e1b-e0, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5db62e1b-e0, col_values=(('external_ids', {'iface-id': '5db62e1b-e013-4958-8470-da256258503d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:55:dd', 'vm-uuid': 'f22d29a4-26d1-4bfd-acf7-80dcdbc4d889'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:42 user nova-compute[73010]: INFO os_vif [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:55:dd,bridge_name='br-int',has_traffic_filtering=True,id=5db62e1b-e013-4958-8470-da256258503d,network=Network(22954f6c-78d2-40d7-91fc-1e8eb0881e40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db62e1b-e0')
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] No VIF found with MAC fa:16:3e:71:55:dd, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.network.neutron [req-2314e84d-3e79-45e5-9cdb-a52d1fdaa326 req-70da2d54-55cd-4d73-a352-15023fa77183 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Updated VIF entry in instance network info cache for port 5db62e1b-e013-4958-8470-da256258503d. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG nova.network.neutron [req-2314e84d-3e79-45e5-9cdb-a52d1fdaa326 req-70da2d54-55cd-4d73-a352-15023fa77183 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Updating instance_info_cache with network_info: [{"id": "5db62e1b-e013-4958-8470-da256258503d", "address": "fa:16:3e:71:55:dd", "network": {"id": "22954f6c-78d2-40d7-91fc-1e8eb0881e40", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1057005040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadfec8dd5ed4c8b8c8730c98b2711ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db62e1b-e0", "ovs_interfaceid": "5db62e1b-e013-4958-8470-da256258503d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:37:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2314e84d-3e79-45e5-9cdb-a52d1fdaa326 req-70da2d54-55cd-4d73-a352-15023fa77183 service nova] Releasing lock "refresh_cache-f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:37:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:46 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059866.04051, f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:37:46 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] VM Resumed (Lifecycle Event)
Aug 15 00:37:46 user nova-compute[73010]: DEBUG nova.compute.manager [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:37:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:37:46 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Instance spawned successfully.
Aug 15 00:37:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:37:46 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:37:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:46 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:37:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:37:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:37:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:37:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:37:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:37:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:37:46 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:37:46 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059866.0449932, f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:37:46 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] VM Started (Lifecycle Event)
Aug 15 00:37:46 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:37:46 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:37:46 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:37:46 user nova-compute[73010]: INFO nova.compute.manager [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Took 6.60 seconds to spawn the instance on the hypervisor.
Aug 15 00:37:46 user nova-compute[73010]: DEBUG nova.compute.manager [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:37:46 user nova-compute[73010]: INFO nova.compute.manager [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Took 7.63 seconds to build instance.
Aug 15 00:37:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-75c6c714-3aba-400f-ad4d-a137be7d10ef tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.720s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:46 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:37:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:46 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:37:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c4015b5-3ae9-4486-878c-e7a2b01ff5c9/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c4015b5-3ae9-4486-878c-e7a2b01ff5c9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c4015b5-3ae9-4486-878c-e7a2b01ff5c9/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c4015b5-3ae9-4486-878c-e7a2b01ff5c9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:47 user nova-compute[73010]: DEBUG nova.compute.manager [req-a97a17d7-c1b7-4dbd-b793-9aee74144fb3 req-c6e658ec-cd40-4e11-9280-530b29a99b28 service nova] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Received event network-changed-68f235d2-055a-40e8-a4ab-09e33974f4ac {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:47 user nova-compute[73010]: DEBUG nova.compute.manager [req-a97a17d7-c1b7-4dbd-b793-9aee74144fb3 req-c6e658ec-cd40-4e11-9280-530b29a99b28 service nova] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Refreshing instance network info cache due to event network-changed-68f235d2-055a-40e8-a4ab-09e33974f4ac. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:37:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a97a17d7-c1b7-4dbd-b793-9aee74144fb3 req-c6e658ec-cd40-4e11-9280-530b29a99b28 service nova] Acquiring lock "refresh_cache-dde74512-c8c3-436c-a6dc-a9327340229e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:37:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a97a17d7-c1b7-4dbd-b793-9aee74144fb3 req-c6e658ec-cd40-4e11-9280-530b29a99b28 service nova] Acquired lock "refresh_cache-dde74512-c8c3-436c-a6dc-a9327340229e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:37:47 user nova-compute[73010]: DEBUG nova.network.neutron [req-a97a17d7-c1b7-4dbd-b793-9aee74144fb3 req-c6e658ec-cd40-4e11-9280-530b29a99b28 service nova] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Refreshing network info cache for port 68f235d2-055a-40e8-a4ab-09e33974f4ac {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:37:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:48 user nova-compute[73010]: DEBUG nova.network.neutron [req-a97a17d7-c1b7-4dbd-b793-9aee74144fb3 req-c6e658ec-cd40-4e11-9280-530b29a99b28 service nova] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Updated VIF entry in instance network info cache for port 68f235d2-055a-40e8-a4ab-09e33974f4ac. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:37:48 user nova-compute[73010]: DEBUG nova.network.neutron [req-a97a17d7-c1b7-4dbd-b793-9aee74144fb3 req-c6e658ec-cd40-4e11-9280-530b29a99b28 service nova] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Updating instance_info_cache with network_info: [{"id": "68f235d2-055a-40e8-a4ab-09e33974f4ac", "address": "fa:16:3e:8b:20:c2", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f235d2-05", "ovs_interfaceid": "68f235d2-055a-40e8-a4ab-09e33974f4ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:37:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a97a17d7-c1b7-4dbd-b793-9aee74144fb3 req-c6e658ec-cd40-4e11-9280-530b29a99b28 service nova] Releasing lock "refresh_cache-dde74512-c8c3-436c-a6dc-a9327340229e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:37:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:37:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:49 user nova-compute[73010]: DEBUG nova.compute.manager [req-d7f24316-d37f-475b-91ab-38a473e5943f req-0411ef0e-e34e-43ca-b222-13f0ac9f7c7a service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received event network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d7f24316-d37f-475b-91ab-38a473e5943f req-0411ef0e-e34e-43ca-b222-13f0ac9f7c7a service nova] Acquiring lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d7f24316-d37f-475b-91ab-38a473e5943f req-0411ef0e-e34e-43ca-b222-13f0ac9f7c7a service nova] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d7f24316-d37f-475b-91ab-38a473e5943f req-0411ef0e-e34e-43ca-b222-13f0ac9f7c7a service nova] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:49 user nova-compute[73010]: DEBUG nova.compute.manager [req-d7f24316-d37f-475b-91ab-38a473e5943f req-0411ef0e-e34e-43ca-b222-13f0ac9f7c7a service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] No waiting events found dispatching network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:37:49 user nova-compute[73010]: WARNING nova.compute.manager [req-d7f24316-d37f-475b-91ab-38a473e5943f req-0411ef0e-e34e-43ca-b222-13f0ac9f7c7a service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received unexpected event network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d for instance with vm_state active and task_state None.
Aug 15 00:37:49 user nova-compute[73010]: DEBUG nova.compute.manager [req-d7f24316-d37f-475b-91ab-38a473e5943f req-0411ef0e-e34e-43ca-b222-13f0ac9f7c7a service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received event network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d7f24316-d37f-475b-91ab-38a473e5943f req-0411ef0e-e34e-43ca-b222-13f0ac9f7c7a service nova] Acquiring lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d7f24316-d37f-475b-91ab-38a473e5943f req-0411ef0e-e34e-43ca-b222-13f0ac9f7c7a service nova] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d7f24316-d37f-475b-91ab-38a473e5943f req-0411ef0e-e34e-43ca-b222-13f0ac9f7c7a service nova] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:49 user nova-compute[73010]: DEBUG nova.compute.manager [req-d7f24316-d37f-475b-91ab-38a473e5943f req-0411ef0e-e34e-43ca-b222-13f0ac9f7c7a service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] No waiting events found dispatching network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:37:49 user nova-compute[73010]: WARNING nova.compute.manager [req-d7f24316-d37f-475b-91ab-38a473e5943f req-0411ef0e-e34e-43ca-b222-13f0ac9f7c7a service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received unexpected event network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d for instance with vm_state active and task_state None.
Aug 15 00:37:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Acquiring lock "9058e3fc-9958-4143-9bd7-507396fa619b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "9058e3fc-9958-4143-9bd7-507396fa619b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:50 user nova-compute[73010]: DEBUG nova.compute.manager [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:37:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:50 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:37:50 user nova-compute[73010]: INFO nova.compute.claims [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Claim successful on node user
Aug 15 00:37:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:37:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:50 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:37:50 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:37:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.684s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:50 user nova-compute[73010]: DEBUG nova.compute.manager [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:37:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG nova.compute.manager [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG nova.network.neutron [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:51 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:37:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vpFEyMKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:37:51 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:37:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:37:51 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:37:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:37:51 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:37:51 user nova-compute[73010]: DEBUG nova.compute.manager [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd678996-5853-45c9-9712-097f8bb7780a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:37:51 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[992a1715-ce91-4941-9541-ee461b7aed5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9] added
Aug 15 00:37:51 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[392fec99-b7c7-4bff-b1a4-a5976f1d76b1]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e47f4d-e901-4f7c-8434-22d9d15e4fd4]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vpFEyMKu {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG nova.policy [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '40b76f3f670f4808817395410be6d6bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3735c817d3d2455ca95902bd1eaea878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG nova.compute.manager [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:37:51 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Creating image(s)
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Acquiring lock "/opt/stack/data/nova/instances/9058e3fc-9958-4143-9bd7-507396fa619b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "/opt/stack/data/nova/instances/9058e3fc-9958-4143-9bd7-507396fa619b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "/opt/stack/data/nova/instances/9058e3fc-9958-4143-9bd7-507396fa619b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vpFEyMKu" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6852addc-c3bd-493b-8ce9-f07254bf252e]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vpFEyMKu'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3b22dd-7e42-4b0b-9d01-bb25b4c32f33]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e29acb-3d4c-4ce2-9518-df7c191c937a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:37:51 user nova-compute[73010]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:37:51 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:37:51 user nova-compute[73010]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:37:51 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[56177a91-2f95-4fd9-9485-1c73cd1d114a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9, portal: 172.16.0.220,3260]
Aug 15 00:37:51 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9, portal: 172.16.0.220,3260] successful.
Aug 15 00:37:51 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.585s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf78c06a-c866-4eb6-aa0d-02f635b1f088]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:51 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:37:51 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:37:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=7266MB free_disk=25.618900299072266GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.007s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5489a6-eeed-4095-a6eb-e40f542c2be7]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:37:51 user nova-compute[73010]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:37:51 user nova-compute[73010]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 (non-flash)
Aug 15 00:37:51 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:37:51 user nova-compute[73010]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:37:51 user nova-compute[73010]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 (non-flash)
Aug 15 00:37:51 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.804s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e723317-cf4e-4c20-ae5e-efa8202b443e]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vpFEyMKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:37:51 user nova-compute[73010]: DEBUG nova.network.neutron [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Successfully created port: 5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.510s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/9058e3fc-9958-4143-9bd7-507396fa619b/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Applying migration context for instance 983577b5-4abb-4280-b8e8-a63f42d8f796 as it has an incoming, in-progress migration 29f41887-4ebb-4d2f-a4e9-270027a77f26. Migration status is finished {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 00:37:52 user nova-compute[73010]: INFO nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Updating resource usage from migration 29f41887-4ebb-4d2f-a4e9-270027a77f26
Aug 15 00:37:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/9058e3fc-9958-4143-9bd7-507396fa619b/disk 1073741824" returned: 0 in 0.056s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.568s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance afcd0a05-e035-492e-9fbe-cd63f4c3ea42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 0588a46c-2314-47e3-b984-1e04518e8a63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance e2410ee7-7351-460a-8d9c-47fe54e08c8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance da32613e-b1a9-4733-831f-e4fb1f34995f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 52878f3e-3ffa-4b1b-b842-ca2215454a3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance dde74512-c8c3-436c-a6dc-a9327340229e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Migration 29f41887-4ebb-4d2f-a4e9-270027a77f26 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 983577b5-4abb-4280-b8e8-a63f42d8f796 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6dfc356b-953a-47b0-9da7-70cc59a80853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 9058e3fc-9958-4143-9bd7-507396fa619b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.190s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9058e3fc-9958-4143-9bd7-507396fa619b/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9058e3fc-9958-4143-9bd7-507396fa619b/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "dde74512-c8c3-436c-a6dc-a9327340229e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "dde74512-c8c3-436c-a6dc-a9327340229e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lazy-loading 'flavor' on Instance uuid dde74512-c8c3-436c-a6dc-a9327340229e {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "dde74512-c8c3-436c-a6dc-a9327340229e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9058e3fc-9958-4143-9bd7-507396fa619b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Cannot resize image /opt/stack/data/nova/instances/9058e3fc-9958-4143-9bd7-507396fa619b/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.objects.instance [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lazy-loading 'migration_context' on Instance uuid 9058e3fc-9958-4143-9bd7-507396fa619b {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Ensure instance console log exists: /opt/stack/data/nova/instances/9058e3fc-9958-4143-9bd7-507396fa619b/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.network.neutron [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Successfully updated port: 5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Acquiring lock "refresh_cache-9058e3fc-9958-4143-9bd7-507396fa619b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Acquired lock "refresh_cache-9058e3fc-9958-4143-9bd7-507396fa619b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.network.neutron [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.compute.manager [req-6e825dc7-5b31-4324-9639-b190805b5558 req-7b1a4d70-4329-4215-9f3e-ad26837f49d0 service nova] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Received event network-changed-5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.compute.manager [req-6e825dc7-5b31-4324-9639-b190805b5558 req-7b1a4d70-4329-4215-9f3e-ad26837f49d0 service nova] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Refreshing instance network info cache due to event network-changed-5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6e825dc7-5b31-4324-9639-b190805b5558 req-7b1a4d70-4329-4215-9f3e-ad26837f49d0 service nova] Acquiring lock "refresh_cache-9058e3fc-9958-4143-9bd7-507396fa619b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.031s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Cleaning up deleted instances {{(pid=73010) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "dde74512-c8c3-436c-a6dc-a9327340229e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "dde74512-c8c3-436c-a6dc-a9327340229e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:52 user nova-compute[73010]: INFO nova.compute.manager [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Attaching volume 37f5c72a-3808-437e-93b5-428de784e195 to /dev/vdb
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] There are 0 instances to clean {{(pid=73010) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.845s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] <== connect_volume: return (1846ms) {'type': 'block', 'scsi_wwn': '26263356330653331', 'path': '/dev/sdb'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263356330653331', 'path': '/dev/sdb'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:37:52 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73010) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.objects.instance [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lazy-loading 'flavor' on Instance uuid 52878f3e-3ffa-4b1b-b842-ca2215454a3e {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.network.neutron [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:37:53 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:37:53 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:37:53 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:37:53 user nova-compute[73010]:   <serial>a34fb63c-348a-4316-9dc7-c69eb4b60cd9</serial>
Aug 15 00:37:53 user nova-compute[73010]: </disk>
Aug 15 00:37:53 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG os_brick.utils [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[65654d24-3cf9-4b45-a822-8ee9ff084d83]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfb3dde-2af6-435a-81f8-9bacddd1cd7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[189a7d3c-fb2c-4257-b41a-de37e02ea3cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9141dea9-7500-4720-b4e0-7852cdbb5337]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:37:53 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:37:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a093c5f-1fd2-4f5e-844b-a33fdc842759]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG os_brick.utils [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Updating existing volume attachment record: 1b185623-784e-4b1c-825f-fb96c5b96860 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.network.neutron [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Updating instance_info_cache with network_info: [{"id": "5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4", "address": "fa:16:3e:51:cb:59", "network": {"id": "258ca453-3ceb-467a-8fc8-f5d5041c510c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1411807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c817d3d2455ca95902bd1eaea878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba905d3-9e", "ovs_interfaceid": "5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Releasing lock "refresh_cache-9058e3fc-9958-4143-9bd7-507396fa619b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.compute.manager [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Instance network_info: |[{"id": "5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4", "address": "fa:16:3e:51:cb:59", "network": {"id": "258ca453-3ceb-467a-8fc8-f5d5041c510c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1411807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c817d3d2455ca95902bd1eaea878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba905d3-9e", "ovs_interfaceid": "5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6e825dc7-5b31-4324-9639-b190805b5558 req-7b1a4d70-4329-4215-9f3e-ad26837f49d0 service nova] Acquired lock "refresh_cache-9058e3fc-9958-4143-9bd7-507396fa619b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.network.neutron [req-6e825dc7-5b31-4324-9639-b190805b5558 req-7b1a4d70-4329-4215-9f3e-ad26837f49d0 service nova] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Refreshing network info cache for port 5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Start _get_guest_xml network_info=[{"id": "5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4", "address": "fa:16:3e:51:cb:59", "network": {"id": "258ca453-3ceb-467a-8fc8-f5d5041c510c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1411807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c817d3d2455ca95902bd1eaea878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba905d3-9e", "ovs_interfaceid": "5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:37:53 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:37:53 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1749373973',display_name='tempest-VolumesActionsTest-instance-1749373973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1749373973',id=19,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3735c817d3d2455ca95902bd1eaea878',ramdisk_id='',reservation_id='r-l74de20z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1275308888',owner_user_name='tempest-VolumesActionsTest-1275308888-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:37:51Z,user_data=None,user_id='40b76f3f670f4808817395410be6d6bf',uuid=9058e3fc-9958-4143-9bd7-507396fa619b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4", "address": "fa:16:3e:51:cb:59", "network": {"id": "258ca453-3ceb-467a-8fc8-f5d5041c510c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1411807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c817d3d2455ca95902bd1eaea878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba905d3-9e", "ovs_interfaceid": "5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Converting VIF {"id": "5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4", "address": "fa:16:3e:51:cb:59", "network": {"id": "258ca453-3ceb-467a-8fc8-f5d5041c510c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1411807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c817d3d2455ca95902bd1eaea878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba905d3-9e", "ovs_interfaceid": "5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:cb:59,bridge_name='br-int',has_traffic_filtering=True,id=5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4,network=Network(258ca453-3ceb-467a-8fc8-f5d5041c510c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba905d3-9e') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.objects.instance [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lazy-loading 'pci_devices' on Instance uuid 9058e3fc-9958-4143-9bd7-507396fa619b {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:37:53 user nova-compute[73010]:   <uuid>9058e3fc-9958-4143-9bd7-507396fa619b</uuid>
Aug 15 00:37:53 user nova-compute[73010]:   <name>instance-00000013</name>
Aug 15 00:37:53 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:37:53 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:37:53 user nova-compute[73010]:   <metadata>
Aug 15 00:37:53 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:37:53 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:37:53 user nova-compute[73010]:       <nova:name>tempest-VolumesActionsTest-instance-1749373973</nova:name>
Aug 15 00:37:53 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:37:53</nova:creationTime>
Aug 15 00:37:53 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:37:53 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:37:53 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:37:53 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:37:53 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:37:53 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:37:53 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:37:53 user nova-compute[73010]:       <nova:owner>
Aug 15 00:37:53 user nova-compute[73010]:         <nova:user uuid="40b76f3f670f4808817395410be6d6bf">tempest-VolumesActionsTest-1275308888-project-member</nova:user>
Aug 15 00:37:53 user nova-compute[73010]:         <nova:project uuid="3735c817d3d2455ca95902bd1eaea878">tempest-VolumesActionsTest-1275308888</nova:project>
Aug 15 00:37:53 user nova-compute[73010]:       </nova:owner>
Aug 15 00:37:53 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:37:53 user nova-compute[73010]:       <nova:ports>
Aug 15 00:37:53 user nova-compute[73010]:         <nova:port uuid="5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4">
Aug 15 00:37:53 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 00:37:53 user nova-compute[73010]:         </nova:port>
Aug 15 00:37:53 user nova-compute[73010]:       </nova:ports>
Aug 15 00:37:53 user nova-compute[73010]:     </nova:instance>
Aug 15 00:37:53 user nova-compute[73010]:   </metadata>
Aug 15 00:37:53 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:37:53 user nova-compute[73010]:     <system>
Aug 15 00:37:53 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:37:53 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:37:53 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:37:53 user nova-compute[73010]:       <entry name="serial">9058e3fc-9958-4143-9bd7-507396fa619b</entry>
Aug 15 00:37:53 user nova-compute[73010]:       <entry name="uuid">9058e3fc-9958-4143-9bd7-507396fa619b</entry>
Aug 15 00:37:53 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:37:53 user nova-compute[73010]:     </system>
Aug 15 00:37:53 user nova-compute[73010]:   </sysinfo>
Aug 15 00:37:53 user nova-compute[73010]:   <os>
Aug 15 00:37:53 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:37:53 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:37:53 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:37:53 user nova-compute[73010]:   </os>
Aug 15 00:37:53 user nova-compute[73010]:   <features>
Aug 15 00:37:53 user nova-compute[73010]:     <acpi/>
Aug 15 00:37:53 user nova-compute[73010]:     <apic/>
Aug 15 00:37:53 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:37:53 user nova-compute[73010]:   </features>
Aug 15 00:37:53 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:37:53 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:37:53 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:37:53 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:37:53 user nova-compute[73010]:   </clock>
Aug 15 00:37:53 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:37:53 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:37:53 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:37:53 user nova-compute[73010]:   </cpu>
Aug 15 00:37:53 user nova-compute[73010]:   <devices>
Aug 15 00:37:53 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:37:53 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:37:53 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/9058e3fc-9958-4143-9bd7-507396fa619b/disk"/>
Aug 15 00:37:53 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:37:53 user nova-compute[73010]:     </disk>
Aug 15 00:37:53 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:37:53 user nova-compute[73010]:       <mac address="fa:16:3e:51:cb:59"/>
Aug 15 00:37:53 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:37:53 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:37:53 user nova-compute[73010]:       <target dev="tap5ba905d3-9e"/>
Aug 15 00:37:53 user nova-compute[73010]:     </interface>
Aug 15 00:37:53 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:37:53 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/9058e3fc-9958-4143-9bd7-507396fa619b/console.log" append="off"/>
Aug 15 00:37:53 user nova-compute[73010]:     </serial>
Aug 15 00:37:53 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:37:53 user nova-compute[73010]:     <video>
Aug 15 00:37:53 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:37:53 user nova-compute[73010]:     </video>
Aug 15 00:37:53 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:37:53 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:37:53 user nova-compute[73010]:     </rng>
Aug 15 00:37:53 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:37:53 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:37:53 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:37:53 user nova-compute[73010]:     </memballoon>
Aug 15 00:37:53 user nova-compute[73010]:   </devices>
Aug 15 00:37:53 user nova-compute[73010]: </domain>
Aug 15 00:37:53 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1749373973',display_name='tempest-VolumesActionsTest-instance-1749373973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1749373973',id=19,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3735c817d3d2455ca95902bd1eaea878',ramdisk_id='',reservation_id='r-l74de20z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1275308888',owner_user_name='tempest-VolumesActionsTest-1275308888-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:37:51Z,user_data=None,user_id='40b76f3f670f4808817395410be6d6bf',uuid=9058e3fc-9958-4143-9bd7-507396fa619b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4", "address": "fa:16:3e:51:cb:59", "network": {"id": "258ca453-3ceb-467a-8fc8-f5d5041c510c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1411807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c817d3d2455ca95902bd1eaea878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba905d3-9e", "ovs_interfaceid": "5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Converting VIF {"id": "5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4", "address": "fa:16:3e:51:cb:59", "network": {"id": "258ca453-3ceb-467a-8fc8-f5d5041c510c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1411807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c817d3d2455ca95902bd1eaea878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba905d3-9e", "ovs_interfaceid": "5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:cb:59,bridge_name='br-int',has_traffic_filtering=True,id=5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4,network=Network(258ca453-3ceb-467a-8fc8-f5d5041c510c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba905d3-9e') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG os_vif [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:cb:59,bridge_name='br-int',has_traffic_filtering=True,id=5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4,network=Network(258ca453-3ceb-467a-8fc8-f5d5041c510c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba905d3-9e') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ba905d3-9e, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ba905d3-9e, col_values=(('external_ids', {'iface-id': '5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:cb:59', 'vm-uuid': '9058e3fc-9958-4143-9bd7-507396fa619b'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:53 user nova-compute[73010]: INFO os_vif [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:cb:59,bridge_name='br-int',has_traffic_filtering=True,id=5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4,network=Network(258ca453-3ceb-467a-8fc8-f5d5041c510c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba905d3-9e')
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] No BDM found with device name hda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] No VIF found with MAC fa:16:3e:4d:03:9e, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] No VIF found with MAC fa:16:3e:51:cb:59, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0c3a9dde-d34f-49a7-9d45-f890973d06cc tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.358s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.network.neutron [req-6e825dc7-5b31-4324-9639-b190805b5558 req-7b1a4d70-4329-4215-9f3e-ad26837f49d0 service nova] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Updated VIF entry in instance network info cache for port 5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG nova.network.neutron [req-6e825dc7-5b31-4324-9639-b190805b5558 req-7b1a4d70-4329-4215-9f3e-ad26837f49d0 service nova] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Updating instance_info_cache with network_info: [{"id": "5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4", "address": "fa:16:3e:51:cb:59", "network": {"id": "258ca453-3ceb-467a-8fc8-f5d5041c510c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1411807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c817d3d2455ca95902bd1eaea878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba905d3-9e", "ovs_interfaceid": "5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:37:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6e825dc7-5b31-4324-9639-b190805b5558 req-7b1a4d70-4329-4215-9f3e-ad26837f49d0 service nova] Releasing lock "refresh_cache-9058e3fc-9958-4143-9bd7-507396fa619b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:37:54 user nova-compute[73010]: DEBUG nova.network.neutron [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Port ba4444c9-ca0d-4265-a567-f931f42b3115 binding to destination host user is already ACTIVE {{(pid=73010) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 00:37:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:37:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquired lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:37:54 user nova-compute[73010]: DEBUG nova.network.neutron [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:37:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Acquiring lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:55 user nova-compute[73010]: INFO nova.compute.manager [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Detaching volume a34fb63c-348a-4316-9dc7-c69eb4b60cd9
Aug 15 00:37:55 user nova-compute[73010]: DEBUG nova.compute.manager [req-3d5dfb5f-cc5a-4a19-b7ae-817ec64d926a req-4677772d-33aa-4d21-8462-d834d302e8c0 service nova] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Received event network-vif-plugged-5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3d5dfb5f-cc5a-4a19-b7ae-817ec64d926a req-4677772d-33aa-4d21-8462-d834d302e8c0 service nova] Acquiring lock "9058e3fc-9958-4143-9bd7-507396fa619b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3d5dfb5f-cc5a-4a19-b7ae-817ec64d926a req-4677772d-33aa-4d21-8462-d834d302e8c0 service nova] Lock "9058e3fc-9958-4143-9bd7-507396fa619b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3d5dfb5f-cc5a-4a19-b7ae-817ec64d926a req-4677772d-33aa-4d21-8462-d834d302e8c0 service nova] Lock "9058e3fc-9958-4143-9bd7-507396fa619b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG nova.compute.manager [req-3d5dfb5f-cc5a-4a19-b7ae-817ec64d926a req-4677772d-33aa-4d21-8462-d834d302e8c0 service nova] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] No waiting events found dispatching network-vif-plugged-5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:37:55 user nova-compute[73010]: WARNING nova.compute.manager [req-3d5dfb5f-cc5a-4a19-b7ae-817ec64d926a req-4677772d-33aa-4d21-8462-d834d302e8c0 service nova] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Received unexpected event network-vif-plugged-5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4 for instance with vm_state building and task_state spawning.
Aug 15 00:37:55 user nova-compute[73010]: INFO nova.virt.block_device [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Attempting to driver detach volume a34fb63c-348a-4316-9dc7-c69eb4b60cd9 from mountpoint /dev/vdb
Aug 15 00:37:55 user nova-compute[73010]: DEBUG nova.network.neutron [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Updating instance_info_cache with network_info: [{"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Attempting to detach device vdb from instance 52878f3e-3ffa-4b1b-b842-ca2215454a3e from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:37:55 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:37:55 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:37:55 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:37:55 user nova-compute[73010]:   <serial>a34fb63c-348a-4316-9dc7-c69eb4b60cd9</serial>
Aug 15 00:37:55 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 00:37:55 user nova-compute[73010]: </disk>
Aug 15 00:37:55 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Releasing lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:37:55 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Successfully detached device vdb from instance 52878f3e-3ffa-4b1b-b842-ca2215454a3e from the persistent domain config.
Aug 15 00:37:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 52878f3e-3ffa-4b1b-b842-ca2215454a3e from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:37:55 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:37:55 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:37:55 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:37:55 user nova-compute[73010]:   <serial>a34fb63c-348a-4316-9dc7-c69eb4b60cd9</serial>
Aug 15 00:37:55 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 00:37:55 user nova-compute[73010]: </disk>
Aug 15 00:37:55 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Creating tmpfile /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/tmp5aq5_3nr to verify with other compute node that the instance is on the same shared storage. {{(pid=73010) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG nova.compute.manager [req-78ca8369-ecee-4dfd-a13c-da48d9040ef7 req-38ef6efc-4c2d-442c-bbf6-0fd1acbabd2f service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received event network-vif-unplugged-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-78ca8369-ecee-4dfd-a13c-da48d9040ef7 req-38ef6efc-4c2d-442c-bbf6-0fd1acbabd2f service nova] Acquiring lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-78ca8369-ecee-4dfd-a13c-da48d9040ef7 req-38ef6efc-4c2d-442c-bbf6-0fd1acbabd2f service nova] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-78ca8369-ecee-4dfd-a13c-da48d9040ef7 req-38ef6efc-4c2d-442c-bbf6-0fd1acbabd2f service nova] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG nova.compute.manager [req-78ca8369-ecee-4dfd-a13c-da48d9040ef7 req-38ef6efc-4c2d-442c-bbf6-0fd1acbabd2f service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] No waiting events found dispatching network-vif-unplugged-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:37:55 user nova-compute[73010]: WARNING nova.compute.manager [req-78ca8369-ecee-4dfd-a13c-da48d9040ef7 req-38ef6efc-4c2d-442c-bbf6-0fd1acbabd2f service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received unexpected event network-vif-unplugged-ba4444c9-ca0d-4265-a567-f931f42b3115 for instance with vm_state resized and task_state resize_reverting.
Aug 15 00:37:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692059875.9999757, 52878f3e-3ffa-4b1b-b842-ca2215454a3e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 52878f3e-3ffa-4b1b-b842-ca2215454a3e {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 00:37:56 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Successfully detached device vdb from instance 52878f3e-3ffa-4b1b-b842-ca2215454a3e from the live domain config.
Aug 15 00:37:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vpFEyMKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:37:56 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Skipping network cache update for instance because it is Building. {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lazy-loading 'info_cache' on Instance uuid 983577b5-4abb-4280-b8e8-a63f42d8f796 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9aafe75-a0f1-4c59-ae1c-6215d03ee99a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d78b6be-6867-49ef-8e5c-9d593062c1bd]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:37:56 user nova-compute[73010]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:37:56 user nova-compute[73010]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 (non-flash)
Aug 15 00:37:56 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:37:56 user nova-compute[73010]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:37:56 user nova-compute[73010]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 (non-flash)
Aug 15 00:37:56 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec505e27a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9'): ({'sdb'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Removing single pathed devices sdb {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[41067ebb-6b56-415e-b6e4-a2adcfabbb97]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c39e10-2fa2-4275-ab21-5f30e259c5af]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Flushing IO for device /dev/sdb {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b69a838-9ee3-4cae-b239-e73fd4ffab18]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f29135-bc3b-47f3-ad8d-2080449ecfa2]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9accd3-a7dc-49ee-86a4-955b88933bca]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3b48e7-2c8e-41d9-b05d-0c480354d3d9]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9, portal: 172.16.0.220,3260]
Aug 15 00:37:56 user nova-compute[73010]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9, portal: 172.16.0.220,3260] successful.
Aug 15 00:37:56 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a34fb63c-348a-4316-9dc7-c69eb4b60cd9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[32478fc9-e633-4bc6-b9cc-a637168ca33f]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] <== disconnect_volume: return (368ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:37:56 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Instance destroyed successfully.
Aug 15 00:37:56 user nova-compute[73010]: DEBUG nova.objects.instance [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lazy-loading 'resources' on Instance uuid 983577b5-4abb-4280-b8e8-a63f42d8f796 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1216295700',display_name='tempest-ServerActionsTestOtherB-server-1216295700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1216295700',id=2,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVoikkIiX9fqlWUgAuNi/64W1pPax2fim7TT4ZilB7kZJFBTddrjL8mZ+9EedRXSwMMm3xZIb3UP53hHNu173Z0/TxgKI44bIEdZkISEoJSalzaVJQjVXA5W+j4ISJAVA==',key_name='tempest-keypair-1664333158',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:36:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1588cfc0b04643a881de076bea2e23b5',ramdisk_id='',reservation_id='r-t3ok78f7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-594907864',owner_user_name='tempest-ServerActionsTestOtherB-594907864-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:36:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5e4be2f71154849a225adb0628fa70e',uuid=983577b5-4abb-4280-b8e8-a63f42d8f796,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Converting VIF {"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:64:22,bridge_name='br-int',has_traffic_filtering=True,id=ba4444c9-ca0d-4265-a567-f931f42b3115,network=Network(25ddd6d0-e3f6-4a35-b15f-a41da18091ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4444c9-ca') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_vif [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:64:22,bridge_name='br-int',has_traffic_filtering=True,id=ba4444c9-ca0d-4265-a567-f931f42b3115,network=Network(25ddd6d0-e3f6-4a35-b15f-a41da18091ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4444c9-ca') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba4444c9-ca, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:56 user nova-compute[73010]: INFO os_vif [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:64:22,bridge_name='br-int',has_traffic_filtering=True,id=ba4444c9-ca0d-4265-a567-f931f42b3115,network=Network(25ddd6d0-e3f6-4a35-b15f-a41da18091ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4444c9-ca')
Aug 15 00:37:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AZTKRHrL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:37:56 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9626915a-b4f2-4211-beaa-7d7813f9012d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e566a9dd-94b7-4076-bf88-bc542b51536a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:37:56 user nova-compute[73010]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:37:56 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:37:56 user nova-compute[73010]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:37:56 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec30327250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4'): ({'sdd'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Removing single pathed devices sdd {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ab435c-f7da-4e8b-b9d2-6ec9bb3e4812]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffafb429-9ccd-4619-9cd6-0ebaefda1d97]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Flushing IO for device /dev/sdd {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c49161-2f72-412e-8855-b7ec530069ed]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6133c6e-796c-4be7-a555-3c58a22d9c54]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] SCSI volumes sdd have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b771a5-68c9-497e-8f5a-e31bca54e523]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d667b3-d8b6-4423-b812-07a227e3a255]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4, portal: 172.16.0.220,3260]
Aug 15 00:37:56 user nova-compute[73010]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4, portal: 172.16.0.220,3260] successful.
Aug 15 00:37:56 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad04af1-9e25-406a-8050-654681b230de]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] <== disconnect_volume: return (325ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:37:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.compute.manager [req-a855fd00-5b35-448a-be96-2f24da931b56 req-be44d76b-d431-4220-ba42-048e201fe017 service nova] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Received event network-vif-plugged-5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a855fd00-5b35-448a-be96-2f24da931b56 req-be44d76b-d431-4220-ba42-048e201fe017 service nova] Acquiring lock "9058e3fc-9958-4143-9bd7-507396fa619b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a855fd00-5b35-448a-be96-2f24da931b56 req-be44d76b-d431-4220-ba42-048e201fe017 service nova] Lock "9058e3fc-9958-4143-9bd7-507396fa619b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a855fd00-5b35-448a-be96-2f24da931b56 req-be44d76b-d431-4220-ba42-048e201fe017 service nova] Lock "9058e3fc-9958-4143-9bd7-507396fa619b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.compute.manager [req-a855fd00-5b35-448a-be96-2f24da931b56 req-be44d76b-d431-4220-ba42-048e201fe017 service nova] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] No waiting events found dispatching network-vif-plugged-5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:37:57 user nova-compute[73010]: WARNING nova.compute.manager [req-a855fd00-5b35-448a-be96-2f24da931b56 req-be44d76b-d431-4220-ba42-048e201fe017 service nova] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Received unexpected event network-vif-plugged-5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4 for instance with vm_state building and task_state spawning.
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Updating instance_info_cache with network_info: [{"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.objects.instance [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lazy-loading 'flavor' on Instance uuid 52878f3e-3ffa-4b1b-b842-ca2215454a3e {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e23b9b4b-5618-4405-850a-5a1cd5b31c61 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.299s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Acquiring lock "interface-52878f3e-3ffa-4b1b-b842-ca2215454a3e-abc9fcfb-9358-4a10-8c8b-edcf21901762" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "interface-52878f3e-3ffa-4b1b-b842-ca2215454a3e-abc9fcfb-9358-4a10-8c8b-edcf21901762" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.objects.instance [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lazy-loading 'flavor' on Instance uuid 52878f3e-3ffa-4b1b-b842-ca2215454a3e {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a9a65e8e-4fc2-4558-b170-70f2606b6f2f tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Acquiring lock "da32613e-b1a9-4733-831f-e4fb1f34995f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a9a65e8e-4fc2-4558-b170-70f2606b6f2f tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a9a65e8e-4fc2-4558-b170-70f2606b6f2f tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Acquiring lock "da32613e-b1a9-4733-831f-e4fb1f34995f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a9a65e8e-4fc2-4558-b170-70f2606b6f2f tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a9a65e8e-4fc2-4558-b170-70f2606b6f2f tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:57 user nova-compute[73010]: INFO nova.compute.manager [None req-a9a65e8e-4fc2-4558-b170-70f2606b6f2f tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Terminating instance
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-a9a65e8e-4fc2-4558-b170-70f2606b6f2f tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1403916647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1403916647',id=14,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTpqd0AO5cR/8y8DOTel0pu1KfJ9BbuQ2tYkoDS5WHMZgu+jFCinV11caUfGX5tzP78Z/KTQ4jpvDxB89/wwhV2id1x6y1BOAyCNEVTVJLgpj3ceNjhqPbgEXUOXteS+w==',key_name='tempest-keypair-434770644',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:35:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05feaf1f5e24465d9e3560741bb5f595',ramdisk_id='',reservation_id='r-wnii2rsz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1572033819',owner_user_name='tempest-TaggedAttachmentsTest-1572033819-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:35:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca2df8041ee64a82a97814ab342008b4',uuid=52878f3e-3ffa-4b1b-b842-ca2215454a3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abc9fcfb-9358-4a10-8c8b-edcf21901762", "address": "fa:16:3e:37:8d:8d", "network": {"id": "89f6414b-a104-4e54-ac37-a4b659a3c132", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1528839876", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "05feaf1f5e24465d9e3560741bb5f595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9fcfb-93", "ovs_interfaceid": "abc9fcfb-9358-4a10-8c8b-edcf21901762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Converting VIF {"id": "abc9fcfb-9358-4a10-8c8b-edcf21901762", "address": "fa:16:3e:37:8d:8d", "network": {"id": "89f6414b-a104-4e54-ac37-a4b659a3c132", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1528839876", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "05feaf1f5e24465d9e3560741bb5f595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9fcfb-93", "ovs_interfaceid": "abc9fcfb-9358-4a10-8c8b-edcf21901762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:8d:8d,bridge_name='br-int',has_traffic_filtering=True,id=abc9fcfb-9358-4a10-8c8b-edcf21901762,network=Network(89f6414b-a104-4e54-ac37-a4b659a3c132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc9fcfb-93') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:37:8d:8d"/><model type="virtio"/><mtu size="1442"/><target dev="tapabc9fcfb-93"/></interface> {{(pid=73010) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:37:8d:8d"/><model type="virtio"/><mtu size="1442"/><target dev="tapabc9fcfb-93"/></interface> {{(pid=73010) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Attempting to detach device tapabc9fcfb-93 from instance 52878f3e-3ffa-4b1b-b842-ca2215454a3e from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] detach device xml: <interface type="ethernet">
Aug 15 00:37:57 user nova-compute[73010]:   <mac address="fa:16:3e:37:8d:8d"/>
Aug 15 00:37:57 user nova-compute[73010]:   <model type="virtio"/>
Aug 15 00:37:57 user nova-compute[73010]:   <mtu size="1442"/>
Aug 15 00:37:57 user nova-compute[73010]:   <target dev="tapabc9fcfb-93"/>
Aug 15 00:37:57 user nova-compute[73010]: </interface>
Aug 15 00:37:57 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:37:8d:8d"/><model type="virtio"/><mtu size="1442"/><target dev="tapabc9fcfb-93"/></interface> {{(pid=73010) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059877.6241438, 9058e3fc-9958-4143-9bd7-507396fa619b => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:37:57 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] VM Resumed (Lifecycle Event)
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:37:8d:8d"/><model type="virtio"/><mtu size="1442"/><target dev="tapabc9fcfb-93"/></interface>not found in domain: <domain type='kvm' id='14'>
Aug 15 00:37:57 user nova-compute[73010]:   <name>instance-0000000e</name>
Aug 15 00:37:57 user nova-compute[73010]:   <uuid>52878f3e-3ffa-4b1b-b842-ca2215454a3e</uuid>
Aug 15 00:37:57 user nova-compute[73010]:   <metadata>
Aug 15 00:37:57 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:37:57 user nova-compute[73010]:   <nova:package version="0.0.0"/>
Aug 15 00:37:57 user nova-compute[73010]:   <nova:name>tempest-device-tagging-server-1403916647</nova:name>
Aug 15 00:37:57 user nova-compute[73010]:   <nova:creationTime>2023-08-15 00:37:39</nova:creationTime>
Aug 15 00:37:57 user nova-compute[73010]:   <nova:flavor name="m1.tiny">
Aug 15 00:37:57 user nova-compute[73010]:     <nova:memory>512</nova:memory>
Aug 15 00:37:57 user nova-compute[73010]:     <nova:disk>1</nova:disk>
Aug 15 00:37:57 user nova-compute[73010]:     <nova:swap>0</nova:swap>
Aug 15 00:37:57 user nova-compute[73010]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:37:57 user nova-compute[73010]:     <nova:vcpus>1</nova:vcpus>
Aug 15 00:37:57 user nova-compute[73010]:   </nova:flavor>
Aug 15 00:37:57 user nova-compute[73010]:   <nova:owner>
Aug 15 00:37:57 user nova-compute[73010]:     <nova:user uuid="ca2df8041ee64a82a97814ab342008b4">tempest-TaggedAttachmentsTest-1572033819-project-member</nova:user>
Aug 15 00:37:57 user nova-compute[73010]:     <nova:project uuid="05feaf1f5e24465d9e3560741bb5f595">tempest-TaggedAttachmentsTest-1572033819</nova:project>
Aug 15 00:37:57 user nova-compute[73010]:   </nova:owner>
Aug 15 00:37:57 user nova-compute[73010]:   <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:37:57 user nova-compute[73010]:   <nova:ports>
Aug 15 00:37:57 user nova-compute[73010]:     <nova:port uuid="30aa2ade-cfae-4c5a-aecc-3ddfadea1000">
Aug 15 00:37:57 user nova-compute[73010]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 00:37:57 user nova-compute[73010]:     </nova:port>
Aug 15 00:37:57 user nova-compute[73010]:     <nova:port uuid="abc9fcfb-9358-4a10-8c8b-edcf21901762">
Aug 15 00:37:57 user nova-compute[73010]:       <nova:ip type="fixed" address="10.10.10.44" ipVersion="4"/>
Aug 15 00:37:57 user nova-compute[73010]:     </nova:port>
Aug 15 00:37:57 user nova-compute[73010]:   </nova:ports>
Aug 15 00:37:57 user nova-compute[73010]: </nova:instance>
Aug 15 00:37:57 user nova-compute[73010]:   </metadata>
Aug 15 00:37:57 user nova-compute[73010]:   <memory unit='KiB'>524288</memory>
Aug 15 00:37:57 user nova-compute[73010]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 00:37:57 user nova-compute[73010]:   <vcpu placement='static'>1</vcpu>
Aug 15 00:37:57 user nova-compute[73010]:   <resource>
Aug 15 00:37:57 user nova-compute[73010]:     <partition>/machine</partition>
Aug 15 00:37:57 user nova-compute[73010]:   </resource>
Aug 15 00:37:57 user nova-compute[73010]:   <sysinfo type='smbios'>
Aug 15 00:37:57 user nova-compute[73010]:     <system>
Aug 15 00:37:57 user nova-compute[73010]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 00:37:57 user nova-compute[73010]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 00:37:57 user nova-compute[73010]:       <entry name='version'>0.0.0</entry>
Aug 15 00:37:57 user nova-compute[73010]:       <entry name='serial'>52878f3e-3ffa-4b1b-b842-ca2215454a3e</entry>
Aug 15 00:37:57 user nova-compute[73010]:       <entry name='uuid'>52878f3e-3ffa-4b1b-b842-ca2215454a3e</entry>
Aug 15 00:37:57 user nova-compute[73010]:       <entry name='family'>Virtual Machine</entry>
Aug 15 00:37:57 user nova-compute[73010]:     </system>
Aug 15 00:37:57 user nova-compute[73010]:   </sysinfo>
Aug 15 00:37:57 user nova-compute[73010]:   <os>
Aug 15 00:37:57 user nova-compute[73010]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 00:37:57 user nova-compute[73010]:     <boot dev='hd'/>
Aug 15 00:37:57 user nova-compute[73010]:     <smbios mode='sysinfo'/>
Aug 15 00:37:57 user nova-compute[73010]:   </os>
Aug 15 00:37:57 user nova-compute[73010]:   <features>
Aug 15 00:37:57 user nova-compute[73010]:     <acpi/>
Aug 15 00:37:57 user nova-compute[73010]:     <apic/>
Aug 15 00:37:57 user nova-compute[73010]:     <vmcoreinfo state='on'/>
Aug 15 00:37:57 user nova-compute[73010]:   </features>
Aug 15 00:37:57 user nova-compute[73010]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 00:37:57 user nova-compute[73010]:     <model fallback='forbid'>Nehalem</model>
Aug 15 00:37:57 user nova-compute[73010]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 00:37:57 user nova-compute[73010]:     <feature policy='require' name='vme'/>
Aug 15 00:37:57 user nova-compute[73010]:     <feature policy='require' name='x2apic'/>
Aug 15 00:37:57 user nova-compute[73010]:     <feature policy='require' name='hypervisor'/>
Aug 15 00:37:57 user nova-compute[73010]:   </cpu>
Aug 15 00:37:57 user nova-compute[73010]:   <clock offset='utc'>
Aug 15 00:37:57 user nova-compute[73010]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 00:37:57 user nova-compute[73010]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 00:37:57 user nova-compute[73010]:     <timer name='hpet' present='no'/>
Aug 15 00:37:57 user nova-compute[73010]:   </clock>
Aug 15 00:37:57 user nova-compute[73010]:   <on_poweroff>destroy</on_poweroff>
Aug 15 00:37:57 user nova-compute[73010]:   <on_reboot>restart</on_reboot>
Aug 15 00:37:57 user nova-compute[73010]:   <on_crash>destroy</on_crash>
Aug 15 00:37:57 user nova-compute[73010]:   <devices>
Aug 15 00:37:57 user nova-compute[73010]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 00:37:57 user nova-compute[73010]:     <disk type='file' device='disk'>
Aug 15 00:37:57 user nova-compute[73010]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 00:37:57 user nova-compute[73010]:       <source file='/opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk' index='2'/>
Aug 15 00:37:57 user nova-compute[73010]:       <backingStore type='file' index='3'>
Aug 15 00:37:57 user nova-compute[73010]:         <format type='raw'/>
Aug 15 00:37:57 user nova-compute[73010]:         <source file='/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36'/>
Aug 15 00:37:57 user nova-compute[73010]:         <backingStore/>
Aug 15 00:37:57 user nova-compute[73010]:       </backingStore>
Aug 15 00:37:57 user nova-compute[73010]:       <target dev='vda' bus='virtio'/>
Aug 15 00:37:57 user nova-compute[73010]:       <alias name='virtio-disk0'/>
Aug 15 00:37:57 user nova-compute[73010]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 00:37:57 user nova-compute[73010]:     </disk>
Aug 15 00:37:57 user nova-compute[73010]:     <disk type='file' device='cdrom'>
Aug 15 00:37:57 user nova-compute[73010]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 00:37:57 user nova-compute[73010]:       <source file='/opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk.config' index='1'/>
Aug 15 00:37:57 user nova-compute[73010]:       <backingStore/>
Aug 15 00:37:57 user nova-compute[73010]:       <target dev='hda' bus='ide'/>
Aug 15 00:37:57 user nova-compute[73010]:       <readonly/>
Aug 15 00:37:57 user nova-compute[73010]:       <alias name='ide0-0-0'/>
Aug 15 00:37:57 user nova-compute[73010]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 00:37:57 user nova-compute[73010]:     </disk>
Aug 15 00:37:57 user nova-compute[73010]:     <controller type='usb' index='0' model='none'>
Aug 15 00:37:57 user nova-compute[73010]:       <alias name='usb'/>
Aug 15 00:37:57 user nova-compute[73010]:     </controller>
Aug 15 00:37:57 user nova-compute[73010]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 00:37:57 user nova-compute[73010]:       <alias name='pci.0'/>
Aug 15 00:37:57 user nova-compute[73010]:     </controller>
Aug 15 00:37:57 user nova-compute[73010]:     <controller type='ide' index='0'>
Aug 15 00:37:57 user nova-compute[73010]:       <alias name='ide'/>
Aug 15 00:37:57 user nova-compute[73010]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 00:37:57 user nova-compute[73010]:     </controller>
Aug 15 00:37:57 user nova-compute[73010]:     <interface type='ethernet'>
Aug 15 00:37:57 user nova-compute[73010]:       <mac address='fa:16:3e:4d:03:9e'/>
Aug 15 00:37:57 user nova-compute[73010]:       <target dev='tap30aa2ade-cf'/>
Aug 15 00:37:57 user nova-compute[73010]:       <model type='virtio'/>
Aug 15 00:37:57 user nova-compute[73010]:       <mtu size='1442'/>
Aug 15 00:37:57 user nova-compute[73010]:       <alias name='net0'/>
Aug 15 00:37:57 user nova-compute[73010]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 00:37:57 user nova-compute[73010]:     </interface>
Aug 15 00:37:57 user nova-compute[73010]:     <interface type='ethernet'>
Aug 15 00:37:57 user nova-compute[73010]:       <mac address='fa:16:3e:37:8d:8d'/>
Aug 15 00:37:57 user nova-compute[73010]:       <target dev='tapabc9fcfb-93'/>
Aug 15 00:37:57 user nova-compute[73010]:       <model type='virtio'/>
Aug 15 00:37:57 user nova-compute[73010]:       <mtu size='1442'/>
Aug 15 00:37:57 user nova-compute[73010]:       <alias name='net1'/>
Aug 15 00:37:57 user nova-compute[73010]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 15 00:37:57 user nova-compute[73010]:     </interface>
Aug 15 00:37:57 user nova-compute[73010]:     <serial type='pty'>
Aug 15 00:37:57 user nova-compute[73010]:       <source path='/dev/pts/2'/>
Aug 15 00:37:57 user nova-compute[73010]:       <log file='/opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/console.log' append='off'/>
Aug 15 00:37:57 user nova-compute[73010]:       <target type='isa-serial' port='0'>
Aug 15 00:37:57 user nova-compute[73010]:         <model name='isa-serial'/>
Aug 15 00:37:57 user nova-compute[73010]:       </target>
Aug 15 00:37:57 user nova-compute[73010]:       <alias name='serial0'/>
Aug 15 00:37:57 user nova-compute[73010]:     </serial>
Aug 15 00:37:57 user nova-compute[73010]:     <console type='pty' tty='/dev/pts/2'>
Aug 15 00:37:57 user nova-compute[73010]:       <source path='/dev/pts/2'/>
Aug 15 00:37:57 user nova-compute[73010]:       <log file='/opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/console.log' append='off'/>
Aug 15 00:37:57 user nova-compute[73010]:       <target type='serial' port='0'/>
Aug 15 00:37:57 user nova-compute[73010]:       <alias name='serial0'/>
Aug 15 00:37:57 user nova-compute[73010]:     </console>
Aug 15 00:37:57 user nova-compute[73010]:     <input type='mouse' bus='ps2'>
Aug 15 00:37:57 user nova-compute[73010]:       <alias name='input0'/>
Aug 15 00:37:57 user nova-compute[73010]:     </input>
Aug 15 00:37:57 user nova-compute[73010]:     <input type='keyboard' bus='ps2'>
Aug 15 00:37:57 user nova-compute[73010]:       <alias name='input1'/>
Aug 15 00:37:57 user nova-compute[73010]:     </input>
Aug 15 00:37:57 user nova-compute[73010]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
Aug 15 00:37:57 user nova-compute[73010]:       <listen type='address' address='0.0.0.0'/>
Aug 15 00:37:57 user nova-compute[73010]:     </graphics>
Aug 15 00:37:57 user nova-compute[73010]:     <audio id='1' type='none'/>
Aug 15 00:37:57 user nova-compute[73010]:     <video>
Aug 15 00:37:57 user nova-compute[73010]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 00:37:57 user nova-compute[73010]:       <alias name='video0'/>
Aug 15 00:37:57 user nova-compute[73010]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 00:37:57 user nova-compute[73010]:     </video>
Aug 15 00:37:57 user nova-compute[73010]:     <memballoon model='virtio'>
Aug 15 00:37:57 user nova-compute[73010]:       <stats period='10'/>
Aug 15 00:37:57 user nova-compute[73010]:       <alias name='balloon0'/>
Aug 15 00:37:57 user nova-compute[73010]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 00:37:57 user nova-compute[73010]:     </memballoon>
Aug 15 00:37:57 user nova-compute[73010]:     <rng model='virtio'>
Aug 15 00:37:57 user nova-compute[73010]:       <backend model='random'>/dev/urandom</backend>
Aug 15 00:37:57 user nova-compute[73010]:       <alias name='rng0'/>
Aug 15 00:37:57 user nova-compute[73010]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 00:37:57 user nova-compute[73010]:     </rng>
Aug 15 00:37:57 user nova-compute[73010]:   </devices>
Aug 15 00:37:57 user nova-compute[73010]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 00:37:57 user nova-compute[73010]:     <label>libvirt-52878f3e-3ffa-4b1b-b842-ca2215454a3e</label>
Aug 15 00:37:57 user nova-compute[73010]:     <imagelabel>libvirt-52878f3e-3ffa-4b1b-b842-ca2215454a3e</imagelabel>
Aug 15 00:37:57 user nova-compute[73010]:   </seclabel>
Aug 15 00:37:57 user nova-compute[73010]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 00:37:57 user nova-compute[73010]:     <label>+64055:+108</label>
Aug 15 00:37:57 user nova-compute[73010]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 00:37:57 user nova-compute[73010]:   </seclabel>
Aug 15 00:37:57 user nova-compute[73010]: </domain>
Aug 15 00:37:57 user nova-compute[73010]:  {{(pid=73010) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 00:37:57 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Successfully detached device tapabc9fcfb-93 from instance 52878f3e-3ffa-4b1b-b842-ca2215454a3e from the persistent domain config.
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] (1/8): Attempting to detach device tapabc9fcfb-93 with device alias net1 from instance 52878f3e-3ffa-4b1b-b842-ca2215454a3e from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] detach device xml: <interface type="ethernet">
Aug 15 00:37:57 user nova-compute[73010]:   <mac address="fa:16:3e:37:8d:8d"/>
Aug 15 00:37:57 user nova-compute[73010]:   <model type="virtio"/>
Aug 15 00:37:57 user nova-compute[73010]:   <mtu size="1442"/>
Aug 15 00:37:57 user nova-compute[73010]:   <target dev="tapabc9fcfb-93"/>
Aug 15 00:37:57 user nova-compute[73010]: </interface>
Aug 15 00:37:57 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:37:57 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Instance spawned successfully.
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:57 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059877.62514, 9058e3fc-9958-4143-9bd7-507396fa619b => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:37:57 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] VM Started (Lifecycle Event)
Aug 15 00:37:57 user nova-compute[73010]: INFO nova.compute.manager [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Detaching volume 4b15bb6b-3a19-4857-b779-8264e831296c
Aug 15 00:37:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.compute.manager [req-da097e17-19c9-4ccf-af0a-3ba3dd3d2237 req-f318cf67-8bda-449c-bdbb-e9129fb11e39 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received event network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-da097e17-19c9-4ccf-af0a-3ba3dd3d2237 req-f318cf67-8bda-449c-bdbb-e9129fb11e39 service nova] Acquiring lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-da097e17-19c9-4ccf-af0a-3ba3dd3d2237 req-f318cf67-8bda-449c-bdbb-e9129fb11e39 service nova] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-da097e17-19c9-4ccf-af0a-3ba3dd3d2237 req-f318cf67-8bda-449c-bdbb-e9129fb11e39 service nova] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.compute.manager [req-da097e17-19c9-4ccf-af0a-3ba3dd3d2237 req-f318cf67-8bda-449c-bdbb-e9129fb11e39 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] No waiting events found dispatching network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:37:57 user nova-compute[73010]: WARNING nova.compute.manager [req-da097e17-19c9-4ccf-af0a-3ba3dd3d2237 req-f318cf67-8bda-449c-bdbb-e9129fb11e39 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received unexpected event network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 for instance with vm_state resized and task_state resize_reverting.
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:57 user nova-compute[73010]: DEBUG nova.objects.instance [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lazy-loading 'migration_context' on Instance uuid 983577b5-4abb-4280-b8e8-a63f42d8f796 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:37:57 user nova-compute[73010]: INFO nova.virt.block_device [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Attempting to driver detach volume 4b15bb6b-3a19-4857-b779-8264e831296c from mountpoint /dev/vdb
Aug 15 00:37:58 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:37:58 user nova-compute[73010]: INFO nova.compute.manager [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Took 6.76 seconds to spawn the instance on the hypervisor.
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Attempting to detach device vdb from instance afcd0a05-e035-492e-9fbe-cd63f4c3ea42 from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:37:58 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:37:58 user nova-compute[73010]:   <source dev="/dev/sdc"/>
Aug 15 00:37:58 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:37:58 user nova-compute[73010]:   <serial>4b15bb6b-3a19-4857-b779-8264e831296c</serial>
Aug 15 00:37:58 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 00:37:58 user nova-compute[73010]: </disk>
Aug 15 00:37:58 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Successfully detached device vdb from instance afcd0a05-e035-492e-9fbe-cd63f4c3ea42 from the persistent domain config.
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance afcd0a05-e035-492e-9fbe-cd63f4c3ea42 from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:37:58 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:37:58 user nova-compute[73010]:   <source dev="/dev/sdc"/>
Aug 15 00:37:58 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:37:58 user nova-compute[73010]:   <serial>4b15bb6b-3a19-4857-b779-8264e831296c</serial>
Aug 15 00:37:58 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 00:37:58 user nova-compute[73010]: </disk>
Aug 15 00:37:58 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692059878.0785747, 52878f3e-3ffa-4b1b-b842-ca2215454a3e => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Start waiting for the detach event from libvirt for device tapabc9fcfb-93 with device alias net1 for instance 52878f3e-3ffa-4b1b-b842-ca2215454a3e {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:37:8d:8d"/><model type="virtio"/><mtu size="1442"/><target dev="tapabc9fcfb-93"/></interface> {{(pid=73010) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:37:8d:8d"/><model type="virtio"/><mtu size="1442"/><target dev="tapabc9fcfb-93"/></interface>not found in domain: <domain type='kvm' id='14'>
Aug 15 00:37:58 user nova-compute[73010]:   <name>instance-0000000e</name>
Aug 15 00:37:58 user nova-compute[73010]:   <uuid>52878f3e-3ffa-4b1b-b842-ca2215454a3e</uuid>
Aug 15 00:37:58 user nova-compute[73010]:   <metadata>
Aug 15 00:37:58 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:37:58 user nova-compute[73010]:   <nova:package version="0.0.0"/>
Aug 15 00:37:58 user nova-compute[73010]:   <nova:name>tempest-device-tagging-server-1403916647</nova:name>
Aug 15 00:37:58 user nova-compute[73010]:   <nova:creationTime>2023-08-15 00:37:39</nova:creationTime>
Aug 15 00:37:58 user nova-compute[73010]:   <nova:flavor name="m1.tiny">
Aug 15 00:37:58 user nova-compute[73010]:     <nova:memory>512</nova:memory>
Aug 15 00:37:58 user nova-compute[73010]:     <nova:disk>1</nova:disk>
Aug 15 00:37:58 user nova-compute[73010]:     <nova:swap>0</nova:swap>
Aug 15 00:37:58 user nova-compute[73010]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:37:58 user nova-compute[73010]:     <nova:vcpus>1</nova:vcpus>
Aug 15 00:37:58 user nova-compute[73010]:   </nova:flavor>
Aug 15 00:37:58 user nova-compute[73010]:   <nova:owner>
Aug 15 00:37:58 user nova-compute[73010]:     <nova:user uuid="ca2df8041ee64a82a97814ab342008b4">tempest-TaggedAttachmentsTest-1572033819-project-member</nova:user>
Aug 15 00:37:58 user nova-compute[73010]:     <nova:project uuid="05feaf1f5e24465d9e3560741bb5f595">tempest-TaggedAttachmentsTest-1572033819</nova:project>
Aug 15 00:37:58 user nova-compute[73010]:   </nova:owner>
Aug 15 00:37:58 user nova-compute[73010]:   <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:37:58 user nova-compute[73010]:   <nova:ports>
Aug 15 00:37:58 user nova-compute[73010]:     <nova:port uuid="30aa2ade-cfae-4c5a-aecc-3ddfadea1000">
Aug 15 00:37:58 user nova-compute[73010]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 00:37:58 user nova-compute[73010]:     </nova:port>
Aug 15 00:37:58 user nova-compute[73010]:     <nova:port uuid="abc9fcfb-9358-4a10-8c8b-edcf21901762">
Aug 15 00:37:58 user nova-compute[73010]:       <nova:ip type="fixed" address="10.10.10.44" ipVersion="4"/>
Aug 15 00:37:58 user nova-compute[73010]:     </nova:port>
Aug 15 00:37:58 user nova-compute[73010]:   </nova:ports>
Aug 15 00:37:58 user nova-compute[73010]: </nova:instance>
Aug 15 00:37:58 user nova-compute[73010]:   </metadata>
Aug 15 00:37:58 user nova-compute[73010]:   <memory unit='KiB'>524288</memory>
Aug 15 00:37:58 user nova-compute[73010]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 00:37:58 user nova-compute[73010]:   <vcpu placement='static'>1</vcpu>
Aug 15 00:37:58 user nova-compute[73010]:   <resource>
Aug 15 00:37:58 user nova-compute[73010]:     <partition>/machine</partition>
Aug 15 00:37:58 user nova-compute[73010]:   </resource>
Aug 15 00:37:58 user nova-compute[73010]:   <sysinfo type='smbios'>
Aug 15 00:37:58 user nova-compute[73010]:     <system>
Aug 15 00:37:58 user nova-compute[73010]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 00:37:58 user nova-compute[73010]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 00:37:58 user nova-compute[73010]:       <entry name='version'>0.0.0</entry>
Aug 15 00:37:58 user nova-compute[73010]:       <entry name='serial'>52878f3e-3ffa-4b1b-b842-ca2215454a3e</entry>
Aug 15 00:37:58 user nova-compute[73010]:       <entry name='uuid'>52878f3e-3ffa-4b1b-b842-ca2215454a3e</entry>
Aug 15 00:37:58 user nova-compute[73010]:       <entry name='family'>Virtual Machine</entry>
Aug 15 00:37:58 user nova-compute[73010]:     </system>
Aug 15 00:37:58 user nova-compute[73010]:   </sysinfo>
Aug 15 00:37:58 user nova-compute[73010]:   <os>
Aug 15 00:37:58 user nova-compute[73010]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 00:37:58 user nova-compute[73010]:     <boot dev='hd'/>
Aug 15 00:37:58 user nova-compute[73010]:     <smbios mode='sysinfo'/>
Aug 15 00:37:58 user nova-compute[73010]:   </os>
Aug 15 00:37:58 user nova-compute[73010]:   <features>
Aug 15 00:37:58 user nova-compute[73010]:     <acpi/>
Aug 15 00:37:58 user nova-compute[73010]:     <apic/>
Aug 15 00:37:58 user nova-compute[73010]:     <vmcoreinfo state='on'/>
Aug 15 00:37:58 user nova-compute[73010]:   </features>
Aug 15 00:37:58 user nova-compute[73010]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 00:37:58 user nova-compute[73010]:     <model fallback='forbid'>Nehalem</model>
Aug 15 00:37:58 user nova-compute[73010]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 00:37:58 user nova-compute[73010]:     <feature policy='require' name='vme'/>
Aug 15 00:37:58 user nova-compute[73010]:     <feature policy='require' name='x2apic'/>
Aug 15 00:37:58 user nova-compute[73010]:     <feature policy='require' name='hypervisor'/>
Aug 15 00:37:58 user nova-compute[73010]:   </cpu>
Aug 15 00:37:58 user nova-compute[73010]:   <clock offset='utc'>
Aug 15 00:37:58 user nova-compute[73010]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 00:37:58 user nova-compute[73010]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 00:37:58 user nova-compute[73010]:     <timer name='hpet' present='no'/>
Aug 15 00:37:58 user nova-compute[73010]:   </clock>
Aug 15 00:37:58 user nova-compute[73010]:   <on_poweroff>destroy</on_poweroff>
Aug 15 00:37:58 user nova-compute[73010]:   <on_reboot>restart</on_reboot>
Aug 15 00:37:58 user nova-compute[73010]:   <on_crash>destroy</on_crash>
Aug 15 00:37:58 user nova-compute[73010]:   <devices>
Aug 15 00:37:58 user nova-compute[73010]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 00:37:58 user nova-compute[73010]:     <disk type='file' device='disk'>
Aug 15 00:37:58 user nova-compute[73010]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 00:37:58 user nova-compute[73010]:       <source file='/opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk' index='2'/>
Aug 15 00:37:58 user nova-compute[73010]:       <backingStore type='file' index='3'>
Aug 15 00:37:58 user nova-compute[73010]:         <format type='raw'/>
Aug 15 00:37:58 user nova-compute[73010]:         <source file='/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36'/>
Aug 15 00:37:58 user nova-compute[73010]:         <backingStore/>
Aug 15 00:37:58 user nova-compute[73010]:       </backingStore>
Aug 15 00:37:58 user nova-compute[73010]:       <target dev='vda' bus='virtio'/>
Aug 15 00:37:58 user nova-compute[73010]:       <alias name='virtio-disk0'/>
Aug 15 00:37:58 user nova-compute[73010]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 00:37:58 user nova-compute[73010]:     </disk>
Aug 15 00:37:58 user nova-compute[73010]:     <disk type='file' device='cdrom'>
Aug 15 00:37:58 user nova-compute[73010]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 00:37:58 user nova-compute[73010]:       <source file='/opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk.config' index='1'/>
Aug 15 00:37:58 user nova-compute[73010]:       <backingStore/>
Aug 15 00:37:58 user nova-compute[73010]:       <target dev='hda' bus='ide'/>
Aug 15 00:37:58 user nova-compute[73010]:       <readonly/>
Aug 15 00:37:58 user nova-compute[73010]:       <alias name='ide0-0-0'/>
Aug 15 00:37:58 user nova-compute[73010]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 00:37:58 user nova-compute[73010]:     </disk>
Aug 15 00:37:58 user nova-compute[73010]:     <controller type='usb' index='0' model='none'>
Aug 15 00:37:58 user nova-compute[73010]:       <alias name='usb'/>
Aug 15 00:37:58 user nova-compute[73010]:     </controller>
Aug 15 00:37:58 user nova-compute[73010]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 00:37:58 user nova-compute[73010]:       <alias name='pci.0'/>
Aug 15 00:37:58 user nova-compute[73010]:     </controller>
Aug 15 00:37:58 user nova-compute[73010]:     <controller type='ide' index='0'>
Aug 15 00:37:58 user nova-compute[73010]:       <alias name='ide'/>
Aug 15 00:37:58 user nova-compute[73010]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 00:37:58 user nova-compute[73010]:     </controller>
Aug 15 00:37:58 user nova-compute[73010]:     <interface type='ethernet'>
Aug 15 00:37:58 user nova-compute[73010]:       <mac address='fa:16:3e:4d:03:9e'/>
Aug 15 00:37:58 user nova-compute[73010]:       <target dev='tap30aa2ade-cf'/>
Aug 15 00:37:58 user nova-compute[73010]:       <model type='virtio'/>
Aug 15 00:37:58 user nova-compute[73010]:       <mtu size='1442'/>
Aug 15 00:37:58 user nova-compute[73010]:       <alias name='net0'/>
Aug 15 00:37:58 user nova-compute[73010]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 00:37:58 user nova-compute[73010]:     </interface>
Aug 15 00:37:58 user nova-compute[73010]:     <serial type='pty'>
Aug 15 00:37:58 user nova-compute[73010]:       <source path='/dev/pts/2'/>
Aug 15 00:37:58 user nova-compute[73010]:       <log file='/opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/console.log' append='off'/>
Aug 15 00:37:58 user nova-compute[73010]:       <target type='isa-serial' port='0'>
Aug 15 00:37:58 user nova-compute[73010]:         <model name='isa-serial'/>
Aug 15 00:37:58 user nova-compute[73010]:       </target>
Aug 15 00:37:58 user nova-compute[73010]:       <alias name='serial0'/>
Aug 15 00:37:58 user nova-compute[73010]:     </serial>
Aug 15 00:37:58 user nova-compute[73010]:     <console type='pty' tty='/dev/pts/2'>
Aug 15 00:37:58 user nova-compute[73010]:       <source path='/dev/pts/2'/>
Aug 15 00:37:58 user nova-compute[73010]:       <log file='/opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/console.log' append='off'/>
Aug 15 00:37:58 user nova-compute[73010]:       <target type='serial' port='0'/>
Aug 15 00:37:58 user nova-compute[73010]:       <alias name='serial0'/>
Aug 15 00:37:58 user nova-compute[73010]:     </console>
Aug 15 00:37:58 user nova-compute[73010]:     <input type='mouse' bus='ps2'>
Aug 15 00:37:58 user nova-compute[73010]:       <alias name='input0'/>
Aug 15 00:37:58 user nova-compute[73010]:     </input>
Aug 15 00:37:58 user nova-compute[73010]:     <input type='keyboard' bus='ps2'>
Aug 15 00:37:58 user nova-compute[73010]:       <alias name='input1'/>
Aug 15 00:37:58 user nova-compute[73010]:     </input>
Aug 15 00:37:58 user nova-compute[73010]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
Aug 15 00:37:58 user nova-compute[73010]:       <listen type='address' address='0.0.0.0'/>
Aug 15 00:37:58 user nova-compute[73010]:     </graphics>
Aug 15 00:37:58 user nova-compute[73010]:     <audio id='1' type='none'/>
Aug 15 00:37:58 user nova-compute[73010]:     <video>
Aug 15 00:37:58 user nova-compute[73010]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 00:37:58 user nova-compute[73010]:       <alias name='video0'/>
Aug 15 00:37:58 user nova-compute[73010]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 00:37:58 user nova-compute[73010]:     </video>
Aug 15 00:37:58 user nova-compute[73010]:     <memballoon model='virtio'>
Aug 15 00:37:58 user nova-compute[73010]:       <stats period='10'/>
Aug 15 00:37:58 user nova-compute[73010]:       <alias name='balloon0'/>
Aug 15 00:37:58 user nova-compute[73010]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 00:37:58 user nova-compute[73010]:     </memballoon>
Aug 15 00:37:58 user nova-compute[73010]:     <rng model='virtio'>
Aug 15 00:37:58 user nova-compute[73010]:       <backend model='random'>/dev/urandom</backend>
Aug 15 00:37:58 user nova-compute[73010]:       <alias name='rng0'/>
Aug 15 00:37:58 user nova-compute[73010]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 00:37:58 user nova-compute[73010]:     </rng>
Aug 15 00:37:58 user nova-compute[73010]:   </devices>
Aug 15 00:37:58 user nova-compute[73010]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 00:37:58 user nova-compute[73010]:     <label>libvirt-52878f3e-3ffa-4b1b-b842-ca2215454a3e</label>
Aug 15 00:37:58 user nova-compute[73010]:     <imagelabel>libvirt-52878f3e-3ffa-4b1b-b842-ca2215454a3e</imagelabel>
Aug 15 00:37:58 user nova-compute[73010]:   </seclabel>
Aug 15 00:37:58 user nova-compute[73010]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 00:37:58 user nova-compute[73010]:     <label>+64055:+108</label>
Aug 15 00:37:58 user nova-compute[73010]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 00:37:58 user nova-compute[73010]:   </seclabel>
Aug 15 00:37:58 user nova-compute[73010]: </domain>
Aug 15 00:37:58 user nova-compute[73010]:  {{(pid=73010) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 00:37:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Successfully detached device tapabc9fcfb-93 from instance 52878f3e-3ffa-4b1b-b842-ca2215454a3e from the live domain config.
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1403916647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1403916647',id=14,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTpqd0AO5cR/8y8DOTel0pu1KfJ9BbuQ2tYkoDS5WHMZgu+jFCinV11caUfGX5tzP78Z/KTQ4jpvDxB89/wwhV2id1x6y1BOAyCNEVTVJLgpj3ceNjhqPbgEXUOXteS+w==',key_name='tempest-keypair-434770644',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:35:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05feaf1f5e24465d9e3560741bb5f595',ramdisk_id='',reservation_id='r-wnii2rsz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1572033819',owner_user_name='tempest-TaggedAttachmentsTest-1572033819-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:35:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca2df8041ee64a82a97814ab342008b4',uuid=52878f3e-3ffa-4b1b-b842-ca2215454a3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abc9fcfb-9358-4a10-8c8b-edcf21901762", "address": "fa:16:3e:37:8d:8d", "network": {"id": "89f6414b-a104-4e54-ac37-a4b659a3c132", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1528839876", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "05feaf1f5e24465d9e3560741bb5f595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9fcfb-93", "ovs_interfaceid": "abc9fcfb-9358-4a10-8c8b-edcf21901762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Converting VIF {"id": "abc9fcfb-9358-4a10-8c8b-edcf21901762", "address": "fa:16:3e:37:8d:8d", "network": {"id": "89f6414b-a104-4e54-ac37-a4b659a3c132", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1528839876", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "05feaf1f5e24465d9e3560741bb5f595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9fcfb-93", "ovs_interfaceid": "abc9fcfb-9358-4a10-8c8b-edcf21901762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:8d:8d,bridge_name='br-int',has_traffic_filtering=True,id=abc9fcfb-9358-4a10-8c8b-edcf21901762,network=Network(89f6414b-a104-4e54-ac37-a4b659a3c132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc9fcfb-93') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG os_vif [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:8d:8d,bridge_name='br-int',has_traffic_filtering=True,id=abc9fcfb-9358-4a10-8c8b-edcf21901762,network=Network(89f6414b-a104-4e54-ac37-a4b659a3c132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc9fcfb-93') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabc9fcfb-93, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:58 user nova-compute[73010]: INFO os_vif [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:8d:8d,bridge_name='br-int',has_traffic_filtering=True,id=abc9fcfb-9358-4a10-8c8b-edcf21901762,network=Network(89f6414b-a104-4e54-ac37-a4b659a3c132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc9fcfb-93')
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:37:58 user nova-compute[73010]:   <nova:package version="0.0.0"/>
Aug 15 00:37:58 user nova-compute[73010]:   <nova:name>tempest-device-tagging-server-1403916647</nova:name>
Aug 15 00:37:58 user nova-compute[73010]:   <nova:creationTime>2023-08-15 00:37:58</nova:creationTime>
Aug 15 00:37:58 user nova-compute[73010]:   <nova:flavor name="m1.tiny">
Aug 15 00:37:58 user nova-compute[73010]:     <nova:memory>512</nova:memory>
Aug 15 00:37:58 user nova-compute[73010]:     <nova:disk>1</nova:disk>
Aug 15 00:37:58 user nova-compute[73010]:     <nova:swap>0</nova:swap>
Aug 15 00:37:58 user nova-compute[73010]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:37:58 user nova-compute[73010]:     <nova:vcpus>1</nova:vcpus>
Aug 15 00:37:58 user nova-compute[73010]:   </nova:flavor>
Aug 15 00:37:58 user nova-compute[73010]:   <nova:owner>
Aug 15 00:37:58 user nova-compute[73010]:     <nova:user uuid="ca2df8041ee64a82a97814ab342008b4">tempest-TaggedAttachmentsTest-1572033819-project-member</nova:user>
Aug 15 00:37:58 user nova-compute[73010]:     <nova:project uuid="05feaf1f5e24465d9e3560741bb5f595">tempest-TaggedAttachmentsTest-1572033819</nova:project>
Aug 15 00:37:58 user nova-compute[73010]:   </nova:owner>
Aug 15 00:37:58 user nova-compute[73010]:   <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:37:58 user nova-compute[73010]:   <nova:ports>
Aug 15 00:37:58 user nova-compute[73010]:     <nova:port uuid="30aa2ade-cfae-4c5a-aecc-3ddfadea1000">
Aug 15 00:37:58 user nova-compute[73010]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 00:37:58 user nova-compute[73010]:     </nova:port>
Aug 15 00:37:58 user nova-compute[73010]:   </nova:ports>
Aug 15 00:37:58 user nova-compute[73010]: </nova:instance>
Aug 15 00:37:58 user nova-compute[73010]:  {{(pid=73010) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Refreshing inventories for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 00:37:58 user nova-compute[73010]: INFO nova.compute.manager [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Took 7.95 seconds to build instance.
Aug 15 00:37:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Updating ProviderTree inventory for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Updating inventory in ProviderTree for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6cba2d16-6d3b-40bc-9a1c-aad820c98d08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "9058e3fc-9958-4143-9bd7-507396fa619b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.177s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Refreshing aggregate associations for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e, aggregates: None {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Refreshing trait associations for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Acquiring lock "refresh_cache-52878f3e-3ffa-4b1b-b842-ca2215454a3e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Acquired lock "refresh_cache-52878f3e-3ffa-4b1b-b842-ca2215454a3e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.network.neutron [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.955s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692059878.9403148, afcd0a05-e035-492e-9fbe-cd63f4c3ea42 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:37:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Successfully detached device vdb from instance afcd0a05-e035-492e-9fbe-cd63f4c3ea42 from the live domain config.
Aug 15 00:37:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Instance destroyed successfully.
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.objects.instance [None req-a9a65e8e-4fc2-4558-b170-70f2606b6f2f tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lazy-loading 'resources' on Instance uuid da32613e-b1a9-4733-831f-e4fb1f34995f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpgnlPGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:37:58 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:37:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-a9a65e8e-4fc2-4558-b170-70f2606b6f2f tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:33:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-531470164',display_name='tempest-TestServerVolumeAttachmentScenario-server-531470164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-531470164',id=12,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWXVbtC7rbFKH9QYL0TO5ogfzTkB1eHPcN6Fh0UPB2QEa6wWQnw6/XDLmu3UF5gK817DgglsdwJtlFj2ZGo+yI1E4dUtaJrT81Q/3NpIc1tCwpjJtN6ualkFB04ZKO3Jw==',key_name='tempest-keypair-1207935503',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:33:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6eb4bd98cbb410d81ae8a21d01056fc',ramdisk_id='',reservation_id='r-tirqejy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-724413436',owner_user_name='tempest-TestServerVolumeAttachmentScenario-724413436-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:33:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3feadea26619474b8bb0a5d9bea7c9ef',uuid=da32613e-b1a9-4733-831f-e4fb1f34995f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c7bfe51-bb5e-4147-8013-a2f175ac4e26", "address": "fa:16:3e:5a:3b:0f", "network": {"id": "830487d5-0366-4d38-a7f2-10c0c754c6df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1078972361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eb4bd98cbb410d81ae8a21d01056fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7bfe51-bb", "ovs_interfaceid": "0c7bfe51-bb5e-4147-8013-a2f175ac4e26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-a9a65e8e-4fc2-4558-b170-70f2606b6f2f tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Converting VIF {"id": "0c7bfe51-bb5e-4147-8013-a2f175ac4e26", "address": "fa:16:3e:5a:3b:0f", "network": {"id": "830487d5-0366-4d38-a7f2-10c0c754c6df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1078972361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eb4bd98cbb410d81ae8a21d01056fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7bfe51-bb", "ovs_interfaceid": "0c7bfe51-bb5e-4147-8013-a2f175ac4e26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-a9a65e8e-4fc2-4558-b170-70f2606b6f2f tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:3b:0f,bridge_name='br-int',has_traffic_filtering=True,id=0c7bfe51-bb5e-4147-8013-a2f175ac4e26,network=Network(830487d5-0366-4d38-a7f2-10c0c754c6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c7bfe51-bb') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG os_vif [None req-a9a65e8e-4fc2-4558-b170-70f2606b6f2f tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:3b:0f,bridge_name='br-int',has_traffic_filtering=True,id=0c7bfe51-bb5e-4147-8013-a2f175ac4e26,network=Network(830487d5-0366-4d38-a7f2-10c0c754c6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c7bfe51-bb') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c7bfe51-bb, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:37:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:37:58 user nova-compute[73010]: INFO os_vif [None req-a9a65e8e-4fc2-4558-b170-70f2606b6f2f tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:3b:0f,bridge_name='br-int',has_traffic_filtering=True,id=0c7bfe51-bb5e-4147-8013-a2f175ac4e26,network=Network(830487d5-0366-4d38-a7f2-10c0c754c6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c7bfe51-bb')
Aug 15 00:37:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-a9a65e8e-4fc2-4558-b170-70f2606b6f2f tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Deleting instance files /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f_del
Aug 15 00:37:59 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-a9a65e8e-4fc2-4558-b170-70f2606b6f2f tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Deletion of /opt/stack/data/nova/instances/da32613e-b1a9-4733-831f-e4fb1f34995f_del complete
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e233b805-2200-4974-bf4e-b9df0b644974]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[794fe188-213d-4d41-b156-4fd3a8a4cf8b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:37:59 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c (non-flash)
Aug 15 00:37:59 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec505e09d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c'): ({'sdc'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Removing single pathed devices sdc {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a44fa07-9a71-4e1b-b685-5c10d09898a5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:59 user nova-compute[73010]: INFO nova.compute.manager [None req-a9a65e8e-4fc2-4558-b170-70f2606b6f2f tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Took 1.50 seconds to destroy the instance on the hypervisor.
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-a9a65e8e-4fc2-4558-b170-70f2606b6f2f tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e47d30-aa22-4012-aae4-9dc9c6880e7f]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Flushing IO for device /dev/sdc {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:59 user nova-compute[73010]: INFO nova.compute.manager [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Swapping old allocation on dict_keys(['76a450bc-e3b1-48a7-9fac-9bdbe0890d8e']) held by migration 29f41887-4ebb-4d2f-a4e9-270027a77f26 for instance
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[06eaa94a-86d3-4d42-9e8d-ec01bb64cd45]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Overwriting current allocation {'allocations': {'76a450bc-e3b1-48a7-9fac-9bdbe0890d8e': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 23}}, 'project_id': '1588cfc0b04643a881de076bea2e23b5', 'user_id': 'a5e4be2f71154849a225adb0628fa70e', 'consumer_generation': 1} on consumer 983577b5-4abb-4280-b8e8-a63f42d8f796 {{(pid=73010) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc09d9dd-cfdb-42e7-afb9-7b5e13ec502f]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] SCSI volumes sdc have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[15106fcb-9be6-45be-a9f9-d7938e5bf68c]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c35006-0c91-4a9e-a07d-c0a15395d898]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c, portal: 172.16.0.220,3260]
Aug 15 00:37:59 user nova-compute[73010]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c, portal: 172.16.0.220,3260] successful.
Aug 15 00:37:59 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15bb6b-3a19-4857-b779-8264e831296c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f138fe-1e42-42fc-8bcb-15f9399c243a]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] <== disconnect_volume: return (336ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-89a20b2e-3980-461a-8082-7882860b9093 req-879d5778-0b68-4f01-843d-5a6d4206c9dc service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Received event network-vif-unplugged-0c7bfe51-bb5e-4147-8013-a2f175ac4e26 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-89a20b2e-3980-461a-8082-7882860b9093 req-879d5778-0b68-4f01-843d-5a6d4206c9dc service nova] Acquiring lock "da32613e-b1a9-4733-831f-e4fb1f34995f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-89a20b2e-3980-461a-8082-7882860b9093 req-879d5778-0b68-4f01-843d-5a6d4206c9dc service nova] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-89a20b2e-3980-461a-8082-7882860b9093 req-879d5778-0b68-4f01-843d-5a6d4206c9dc service nova] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-89a20b2e-3980-461a-8082-7882860b9093 req-879d5778-0b68-4f01-843d-5a6d4206c9dc service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] No waiting events found dispatching network-vif-unplugged-0c7bfe51-bb5e-4147-8013-a2f175ac4e26 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-89a20b2e-3980-461a-8082-7882860b9093 req-879d5778-0b68-4f01-843d-5a6d4206c9dc service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Received event network-vif-unplugged-0c7bfe51-bb5e-4147-8013-a2f175ac4e26 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-89a20b2e-3980-461a-8082-7882860b9093 req-879d5778-0b68-4f01-843d-5a6d4206c9dc service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Received event network-vif-plugged-0c7bfe51-bb5e-4147-8013-a2f175ac4e26 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-89a20b2e-3980-461a-8082-7882860b9093 req-879d5778-0b68-4f01-843d-5a6d4206c9dc service nova] Acquiring lock "da32613e-b1a9-4733-831f-e4fb1f34995f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-89a20b2e-3980-461a-8082-7882860b9093 req-879d5778-0b68-4f01-843d-5a6d4206c9dc service nova] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-89a20b2e-3980-461a-8082-7882860b9093 req-879d5778-0b68-4f01-843d-5a6d4206c9dc service nova] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-89a20b2e-3980-461a-8082-7882860b9093 req-879d5778-0b68-4f01-843d-5a6d4206c9dc service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] No waiting events found dispatching network-vif-plugged-0c7bfe51-bb5e-4147-8013-a2f175ac4e26 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:37:59 user nova-compute[73010]: WARNING nova.compute.manager [req-89a20b2e-3980-461a-8082-7882860b9093 req-879d5778-0b68-4f01-843d-5a6d4206c9dc service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Received unexpected event network-vif-plugged-0c7bfe51-bb5e-4147-8013-a2f175ac4e26 for instance with vm_state active and task_state deleting.
Aug 15 00:37:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-89a20b2e-3980-461a-8082-7882860b9093 req-879d5778-0b68-4f01-843d-5a6d4206c9dc service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Received event network-vif-plugged-abc9fcfb-9358-4a10-8c8b-edcf21901762 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-89a20b2e-3980-461a-8082-7882860b9093 req-879d5778-0b68-4f01-843d-5a6d4206c9dc service nova] Acquiring lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-89a20b2e-3980-461a-8082-7882860b9093 req-879d5778-0b68-4f01-843d-5a6d4206c9dc service nova] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-89a20b2e-3980-461a-8082-7882860b9093 req-879d5778-0b68-4f01-843d-5a6d4206c9dc service nova] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-89a20b2e-3980-461a-8082-7882860b9093 req-879d5778-0b68-4f01-843d-5a6d4206c9dc service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] No waiting events found dispatching network-vif-plugged-abc9fcfb-9358-4a10-8c8b-edcf21901762 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:37:59 user nova-compute[73010]: WARNING nova.compute.manager [req-89a20b2e-3980-461a-8082-7882860b9093 req-879d5778-0b68-4f01-843d-5a6d4206c9dc service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Received unexpected event network-vif-plugged-abc9fcfb-9358-4a10-8c8b-edcf21901762 for instance with vm_state active and task_state None.
Aug 15 00:37:59 user nova-compute[73010]: INFO nova.network.neutron [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Port abc9fcfb-9358-4a10-8c8b-edcf21901762 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 15 00:37:59 user nova-compute[73010]: DEBUG nova.network.neutron [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Updating instance_info_cache with network_info: [{"id": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "address": "fa:16:3e:4d:03:9e", "network": {"id": "35a82886-0b11-43bd-adcf-7d64cd9afdc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719337962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05feaf1f5e24465d9e3560741bb5f595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30aa2ade-cf", "ovs_interfaceid": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquired lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG nova.network.neutron [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Releasing lock "refresh_cache-52878f3e-3ffa-4b1b-b842-ca2215454a3e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-19637ab6-578d-4050-b6be-91e636b2ddec tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "interface-52878f3e-3ffa-4b1b-b842-ca2215454a3e-abc9fcfb-9358-4a10-8c8b-edcf21901762" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.980s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:37:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-1d672494-85a9-4e8f-8d84-84d579cbe970 req-d545b7d7-f8be-4a0f-a478-d5b2b81876a7 service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Received event network-vif-deleted-abc9fcfb-9358-4a10-8c8b-edcf21901762 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG nova.objects.instance [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'flavor' on Instance uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-40b925c5-2148-4544-ab09-861a43358249 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.441s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_power_states {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG nova.network.neutron [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Updating instance_info_cache with network_info: [{"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Releasing lock "refresh_cache-983577b5-4abb-4280-b8e8-a63f42d8f796" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG os_brick.utils [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:00 user nova-compute[73010]: WARNING nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] While synchronizing instance power states, found 11 instances in the database and 9 instances on the hypervisor.
Aug 15 00:38:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid 983577b5-4abb-4280-b8e8-a63f42d8f796 {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid 0588a46c-2314-47e3-b984-1e04518e8a63 {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid e2410ee7-7351-460a-8d9c-47fe54e08c8b {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid da32613e-b1a9-4733-831f-e4fb1f34995f {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid 52878f3e-3ffa-4b1b-b842-ca2215454a3e {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid dde74512-c8c3-436c-a6dc-a9327340229e {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9 {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid 6dfc356b-953a-47b0-9da7-70cc59a80853 {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid 9058e3fc-9958-4143-9bd7-507396fa619b {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "983577b5-4abb-4280-b8e8-a63f42d8f796" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:00 user nova-compute[73010]: INFO nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "0588a46c-2314-47e3-b984-1e04518e8a63" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "0588a46c-2314-47e3-b984-1e04518e8a63" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "da32613e-b1a9-4733-831f-e4fb1f34995f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "dde74512-c8c3-436c-a6dc-a9327340229e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "6dfc356b-953a-47b0-9da7-70cc59a80853" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "6dfc356b-953a-47b0-9da7-70cc59a80853" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "9058e3fc-9958-4143-9bd7-507396fa619b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "9058e3fc-9958-4143-9bd7-507396fa619b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[11324422-9e0a-4319-bd5a-479d87578586]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc1742c-6eda-4033-9c6b-c37cd38a48c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b736d3-b708-4d48-8d37-c1b51f7e0ad5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1237828-c501-4999-a447-2ed5d0303f58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.166s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.165s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "0588a46c-2314-47e3-b984-1e04518e8a63" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.169s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.167s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.171s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "6dfc356b-953a-47b0-9da7-70cc59a80853" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.180s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:00 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8faa8d-fa3d-46c5-bb9f-fb32cb37f2ed]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG os_brick.utils [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] <== get_connector_properties: return (210ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:38:00 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Took 1.76 seconds to deallocate network for instance.
Aug 15 00:38:00 user nova-compute[73010]: DEBUG nova.compute.manager [req-e9a38cba-5281-4229-a6b5-874c19adb2fd req-c3178bf9-c444-4d9f-a8fe-6ebcbaead2ed service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Received event network-vif-deleted-0c7bfe51-bb5e-4147-8013-a2f175ac4e26 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:38:00 user nova-compute[73010]: INFO nova.compute.manager [req-e9a38cba-5281-4229-a6b5-874c19adb2fd req-c3178bf9-c444-4d9f-a8fe-6ebcbaead2ed service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Neutron deleted interface 0c7bfe51-bb5e-4147-8013-a2f175ac4e26; detaching it from the instance and deleting it from the info cache
Aug 15 00:38:00 user nova-compute[73010]: DEBUG nova.network.neutron [req-e9a38cba-5281-4229-a6b5-874c19adb2fd req-c3178bf9-c444-4d9f-a8fe-6ebcbaead2ed service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.220s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "9058e3fc-9958-4143-9bd7-507396fa619b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.220s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG nova.compute.manager [req-e9a38cba-5281-4229-a6b5-874c19adb2fd req-c3178bf9-c444-4d9f-a8fe-6ebcbaead2ed service nova] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Detach interface failed, port_id=0c7bfe51-bb5e-4147-8013-a2f175ac4e26, reason: Instance da32613e-b1a9-4733-831f-e4fb1f34995f could not be found. {{(pid=73010) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a9a65e8e-4fc2-4558-b170-70f2606b6f2f tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a9a65e8e-4fc2-4558-b170-70f2606b6f2f tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1e53a312-2988-41e5-84b0-d366a14a2e91 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1e53a312-2988-41e5-84b0-d366a14a2e91 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-1e53a312-2988-41e5-84b0-d366a14a2e91 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:38:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-1e53a312-2988-41e5-84b0-d366a14a2e91 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73010) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 15 00:38:01 user nova-compute[73010]: DEBUG nova.objects.instance [None req-1e53a312-2988-41e5-84b0-d366a14a2e91 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'flavor' on Instance uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:38:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:01 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-a9a65e8e-4fc2-4558-b170-70f2606b6f2f tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:38:01 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-a9a65e8e-4fc2-4558-b170-70f2606b6f2f tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:38:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a9a65e8e-4fc2-4558-b170-70f2606b6f2f tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.528s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:01 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-a9a65e8e-4fc2-4558-b170-70f2606b6f2f tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Deleted allocations for instance da32613e-b1a9-4733-831f-e4fb1f34995f
Aug 15 00:38:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a9a65e8e-4fc2-4558-b170-70f2606b6f2f tempest-TestServerVolumeAttachmentScenario-724413436 tempest-TestServerVolumeAttachmentScenario-724413436-project-member] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.054s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.994s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:01 user nova-compute[73010]: INFO nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] During sync_power_state the instance has a pending task (deleting). Skip.
Aug 15 00:38:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "da32613e-b1a9-4733-831f-e4fb1f34995f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:02 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Instance destroyed successfully.
Aug 15 00:38:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-1e53a312-2988-41e5-84b0-d366a14a2e91 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:38:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1e53a312-2988-41e5-84b0-d366a14a2e91 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.886s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-5e796707-b50d-4017-a5af-f9162a4c11cc req-69fba5d3-6de0-4b63-9bcc-cf7f74e4e5ea service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received event network-vif-unplugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:38:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5e796707-b50d-4017-a5af-f9162a4c11cc req-69fba5d3-6de0-4b63-9bcc-cf7f74e4e5ea service nova] Acquiring lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5e796707-b50d-4017-a5af-f9162a4c11cc req-69fba5d3-6de0-4b63-9bcc-cf7f74e4e5ea service nova] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5e796707-b50d-4017-a5af-f9162a4c11cc req-69fba5d3-6de0-4b63-9bcc-cf7f74e4e5ea service nova] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-5e796707-b50d-4017-a5af-f9162a4c11cc req-69fba5d3-6de0-4b63-9bcc-cf7f74e4e5ea service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] No waiting events found dispatching network-vif-unplugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:38:02 user nova-compute[73010]: WARNING nova.compute.manager [req-5e796707-b50d-4017-a5af-f9162a4c11cc req-69fba5d3-6de0-4b63-9bcc-cf7f74e4e5ea service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received unexpected event network-vif-unplugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 for instance with vm_state stopped and task_state None.
Aug 15 00:38:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-5e796707-b50d-4017-a5af-f9162a4c11cc req-69fba5d3-6de0-4b63-9bcc-cf7f74e4e5ea service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received event network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:38:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5e796707-b50d-4017-a5af-f9162a4c11cc req-69fba5d3-6de0-4b63-9bcc-cf7f74e4e5ea service nova] Acquiring lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5e796707-b50d-4017-a5af-f9162a4c11cc req-69fba5d3-6de0-4b63-9bcc-cf7f74e4e5ea service nova] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5e796707-b50d-4017-a5af-f9162a4c11cc req-69fba5d3-6de0-4b63-9bcc-cf7f74e4e5ea service nova] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-5e796707-b50d-4017-a5af-f9162a4c11cc req-69fba5d3-6de0-4b63-9bcc-cf7f74e4e5ea service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] No waiting events found dispatching network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:38:02 user nova-compute[73010]: WARNING nova.compute.manager [req-5e796707-b50d-4017-a5af-f9162a4c11cc req-69fba5d3-6de0-4b63-9bcc-cf7f74e4e5ea service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received unexpected event network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 for instance with vm_state stopped and task_state None.
Aug 15 00:38:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AZpjzPJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:38:03 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:38:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:38:03 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:38:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:38:03 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2ee632-81cc-498b-841f-87be67209dab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:38:03 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d17316-27d6-428c-9799-f80cabf8b38a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195] added
Aug 15 00:38:03 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[000b5491-30ce-44f9-931e-87f01eecb135]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4336c05f-c8f3-42e7-bb72-53831bc7fd8b]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AZpjzPJh {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AZpjzPJh" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9b34fd-2081-460b-b97c-f5f088a222c0]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AZpjzPJh'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.046s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bada4c9-2b86-4c0e-8136-fb27e8dfcdfd]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6c5f54-991f-466b-b26e-6c4f60f64feb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 00:38:03 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 00:38:03 user nova-compute[73010]:  {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:38:03 user nova-compute[73010]: WARNING os_brick.initiator.connectors.iscsi [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 00:38:03 user nova-compute[73010]: 
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[541f834f-285a-485e-9d1e-14ef897ebe00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195, portal: 172.16.0.220,3260]
Aug 15 00:38:03 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195, portal: 172.16.0.220,3260] successful.
Aug 15 00:38:03 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[475b5335-f7f9-4eff-9dca-58c97797193a]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f64504-cd30-4f89-9663-279fad5f1784]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)
Aug 15 00:38:03 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)
Aug 15 00:38:03 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[682bac68-ea57-4f06-ba0c-a4fa2c6086c4]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: None {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:38:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:04 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:38:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AZpjzPJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:38:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:38:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26532633230633362', 'path': '/dev/sdb'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:38:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532633230633362', 'path': '/dev/sdb'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:38:04 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lazy-loading 'flavor' on Instance uuid dde74512-c8c3-436c-a6dc-a9327340229e {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:38:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:38:04 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:38:04 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:38:04 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:38:04 user nova-compute[73010]:   <serial>37f5c72a-3808-437e-93b5-428de784e195</serial>
Aug 15 00:38:04 user nova-compute[73010]: </disk>
Aug 15 00:38:04 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:38:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:38:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:38:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] No VIF found with MAC fa:16:3e:8b:20:c2, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:38:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b2233fed-4edf-4e45-b3ea-c7461e1bfbe7 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "dde74512-c8c3-436c-a6dc-a9327340229e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.696s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "dde74512-c8c3-436c-a6dc-a9327340229e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.039s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "dde74512-c8c3-436c-a6dc-a9327340229e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "362829aa-9659-4ced-9537-d11de1b6b2d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "362829aa-9659-4ced-9537-d11de1b6b2d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:38:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:09 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:38:09 user nova-compute[73010]: INFO nova.compute.claims [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Claim successful on node user
Aug 15 00:38:09 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:38:09 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:38:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:38:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:38:09 user nova-compute[73010]: DEBUG nova.network.neutron [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:38:09 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:38:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG nova.policy [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '928ab235d55d4bfc86de82f2387c9d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e962745e3a554f2b8f42d97434173a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:38:10 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Creating image(s)
Aug 15 00:38:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "/opt/stack/data/nova/instances/362829aa-9659-4ced-9537-d11de1b6b2d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "/opt/stack/data/nova/instances/362829aa-9659-4ced-9537-d11de1b6b2d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "/opt/stack/data/nova/instances/362829aa-9659-4ced-9537-d11de1b6b2d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.186s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/362829aa-9659-4ced-9537-d11de1b6b2d7/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/362829aa-9659-4ced-9537-d11de1b6b2d7/disk 1073741824" returned: 0 in 0.062s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG nova.network.neutron [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Successfully created port: d2a83a47-48c9-4483-ab88-c719b6b9c268 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.225s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Checking if we can resize image /opt/stack/data/nova/instances/362829aa-9659-4ced-9537-d11de1b6b2d7/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362829aa-9659-4ced-9537-d11de1b6b2d7/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Starting finish_revert_migration {{(pid=73010) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Start _get_guest_xml network_info=[{"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AZTKRHrL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '983577b5-4abb-4280-b8e8-a63f42d8f796', 'attached_at': '2023-08-15T00:38:11.000000', 'detached_at': '', 'volume_id': 'e4ddadda-c939-425a-bcb3-4e454e0db7f4', 'serial': 'e4ddadda-c939-425a-bcb3-4e454e0db7f4'}, 'disk_bus': 'virtio', 'attachment_id': 'f9a97b20-6127-410d-b32f-5262694ded63', 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:38:10 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:38:10 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:38:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:38:10 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG nova.objects.instance [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lazy-loading 'vcpu_model' on Instance uuid 983577b5-4abb-4280-b8e8-a63f42d8f796 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362829aa-9659-4ced-9537-d11de1b6b2d7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Cannot resize image /opt/stack/data/nova/instances/362829aa-9659-4ced-9537-d11de1b6b2d7/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG nova.objects.instance [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lazy-loading 'migration_context' on Instance uuid 362829aa-9659-4ced-9537-d11de1b6b2d7 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AZTKRHrL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:38:11 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:38:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:38:11 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:38:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:38:11 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:38:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Ensure instance console log exists: /opt/stack/data/nova/instances/362829aa-9659-4ced-9537-d11de1b6b2d7/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bec7c8a-a50f-48ce-b3ae-f267a4523601]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:38:11 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5890efcc-45f0-4228-b6e4-2505eb94b20f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4] added
Aug 15 00:38:11 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c20d007-86bd-45d8-8549-04e91041cffd]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5f27f7-da53-4cd8-bfa4-b05f077706f3]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AZTKRHrL {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AZTKRHrL" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cd0553-8f7f-4768-8562-3f1c3a28a188]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AZTKRHrL'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d79ca7-9acf-4aac-a5aa-7d3fa1e9b27e]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[037e4603-9d4a-4a2b-8ecc-c3a80f63056a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)
Aug 15 00:38:11 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)
Aug 15 00:38:11 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03be86d-a81d-42e8-9069-5e2a27fab186]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4, portal: 172.16.0.220,3260]
Aug 15 00:38:11 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4, portal: 172.16.0.220,3260] successful.
Aug 15 00:38:11 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f388a44e-badb-4083-852c-b1f0438eed15]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b49122-786e-4a4c-bc4d-b15c9bb619f3]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)
Aug 15 00:38:11 user nova-compute[73010]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:38:11 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)
Aug 15 00:38:11 user nova-compute[73010]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:38:11 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9689fc-16fc-4806-adb3-7854d6ef09d8]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AZTKRHrL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692059876.4437456, 983577b5-4abb-4280-b8e8-a63f42d8f796 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:38:11 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] VM Stopped (Lifecycle Event)
Aug 15 00:38:11 user nova-compute[73010]: DEBUG nova.compute.manager [None req-10c16704-0fd8-46ea-b8be-0e0dc3301cd6 None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG nova.network.neutron [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Successfully updated port: d2a83a47-48c9-4483-ab88-c719b6b9c268 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-f37b1cfc-5694-4f05-b172-9b743134d140 req-f07a4489-f5e0-4287-8c4d-dbb89ce6539d service nova] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Received event network-changed-d2a83a47-48c9-4483-ab88-c719b6b9c268 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-f37b1cfc-5694-4f05-b172-9b743134d140 req-f07a4489-f5e0-4287-8c4d-dbb89ce6539d service nova] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Refreshing instance network info cache due to event network-changed-d2a83a47-48c9-4483-ab88-c719b6b9c268. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f37b1cfc-5694-4f05-b172-9b743134d140 req-f07a4489-f5e0-4287-8c4d-dbb89ce6539d service nova] Acquiring lock "refresh_cache-362829aa-9659-4ced-9537-d11de1b6b2d7" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f37b1cfc-5694-4f05-b172-9b743134d140 req-f07a4489-f5e0-4287-8c4d-dbb89ce6539d service nova] Acquired lock "refresh_cache-362829aa-9659-4ced-9537-d11de1b6b2d7" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG nova.network.neutron [req-f37b1cfc-5694-4f05-b172-9b743134d140 req-f07a4489-f5e0-4287-8c4d-dbb89ce6539d service nova] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Refreshing network info cache for port d2a83a47-48c9-4483-ab88-c719b6b9c268 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:38:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "refresh_cache-362829aa-9659-4ced-9537-d11de1b6b2d7" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.network.neutron [req-f37b1cfc-5694-4f05-b172-9b743134d140 req-f07a4489-f5e0-4287-8c4d-dbb89ce6539d service nova] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.network.neutron [req-f37b1cfc-5694-4f05-b172-9b743134d140 req-f07a4489-f5e0-4287-8c4d-dbb89ce6539d service nova] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f37b1cfc-5694-4f05-b172-9b743134d140 req-f07a4489-f5e0-4287-8c4d-dbb89ce6539d service nova] Releasing lock "refresh_cache-362829aa-9659-4ced-9537-d11de1b6b2d7" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquired lock "refresh_cache-362829aa-9659-4ced-9537-d11de1b6b2d7" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.network.neutron [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.network.neutron [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26466376665656565', 'path': '/dev/sdc'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466376665656565', 'path': '/dev/sdc'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1216295700',display_name='tempest-ServerActionsTestOtherB-server-1216295700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1216295700',id=2,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVoikkIiX9fqlWUgAuNi/64W1pPax2fim7TT4ZilB7kZJFBTddrjL8mZ+9EedRXSwMMm3xZIb3UP53hHNu173Z0/TxgKI44bIEdZkISEoJSalzaVJQjVXA5W+j4ISJAVA==',key_name='tempest-keypair-1664333158',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:36:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1588cfc0b04643a881de076bea2e23b5',ramdisk_id='',reservation_id='r-t3ok78f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-594907864',owner_user_name='tempest-ServerActionsTestOtherB-594907864-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:37:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5e4be2f71154849a225adb0628fa70e',uuid=983577b5-4abb-4280-b8e8-a63f42d8f796,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Converting VIF {"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:64:22,bridge_name='br-int',has_traffic_filtering=True,id=ba4444c9-ca0d-4265-a567-f931f42b3115,network=Network(25ddd6d0-e3f6-4a35-b15f-a41da18091ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4444c9-ca') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:38:12 user nova-compute[73010]:   <uuid>983577b5-4abb-4280-b8e8-a63f42d8f796</uuid>
Aug 15 00:38:12 user nova-compute[73010]:   <name>instance-00000002</name>
Aug 15 00:38:12 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:38:12 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:38:12 user nova-compute[73010]:   <metadata>
Aug 15 00:38:12 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:38:12 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:38:12 user nova-compute[73010]:       <nova:name>tempest-ServerActionsTestOtherB-server-1216295700</nova:name>
Aug 15 00:38:12 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:38:10</nova:creationTime>
Aug 15 00:38:12 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:38:12 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:38:12 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:38:12 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:38:12 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:38:12 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:38:12 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:38:12 user nova-compute[73010]:       <nova:owner>
Aug 15 00:38:12 user nova-compute[73010]:         <nova:user uuid="a5e4be2f71154849a225adb0628fa70e">tempest-ServerActionsTestOtherB-594907864-project-member</nova:user>
Aug 15 00:38:12 user nova-compute[73010]:         <nova:project uuid="1588cfc0b04643a881de076bea2e23b5">tempest-ServerActionsTestOtherB-594907864</nova:project>
Aug 15 00:38:12 user nova-compute[73010]:       </nova:owner>
Aug 15 00:38:12 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:38:12 user nova-compute[73010]:       <nova:ports>
Aug 15 00:38:12 user nova-compute[73010]:         <nova:port uuid="ba4444c9-ca0d-4265-a567-f931f42b3115">
Aug 15 00:38:12 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 00:38:12 user nova-compute[73010]:         </nova:port>
Aug 15 00:38:12 user nova-compute[73010]:       </nova:ports>
Aug 15 00:38:12 user nova-compute[73010]:     </nova:instance>
Aug 15 00:38:12 user nova-compute[73010]:   </metadata>
Aug 15 00:38:12 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:38:12 user nova-compute[73010]:     <system>
Aug 15 00:38:12 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:38:12 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:38:12 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:38:12 user nova-compute[73010]:       <entry name="serial">983577b5-4abb-4280-b8e8-a63f42d8f796</entry>
Aug 15 00:38:12 user nova-compute[73010]:       <entry name="uuid">983577b5-4abb-4280-b8e8-a63f42d8f796</entry>
Aug 15 00:38:12 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:38:12 user nova-compute[73010]:     </system>
Aug 15 00:38:12 user nova-compute[73010]:   </sysinfo>
Aug 15 00:38:12 user nova-compute[73010]:   <os>
Aug 15 00:38:12 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:38:12 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:38:12 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:38:12 user nova-compute[73010]:   </os>
Aug 15 00:38:12 user nova-compute[73010]:   <features>
Aug 15 00:38:12 user nova-compute[73010]:     <acpi/>
Aug 15 00:38:12 user nova-compute[73010]:     <apic/>
Aug 15 00:38:12 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:38:12 user nova-compute[73010]:   </features>
Aug 15 00:38:12 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:38:12 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:38:12 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:38:12 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:38:12 user nova-compute[73010]:   </clock>
Aug 15 00:38:12 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:38:12 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:38:12 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:38:12 user nova-compute[73010]:   </cpu>
Aug 15 00:38:12 user nova-compute[73010]:   <devices>
Aug 15 00:38:12 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:38:12 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:38:12 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk"/>
Aug 15 00:38:12 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:38:12 user nova-compute[73010]:     </disk>
Aug 15 00:38:12 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 00:38:12 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:38:12 user nova-compute[73010]:       <source dev="/dev/sdc"/>
Aug 15 00:38:12 user nova-compute[73010]:       <target dev="vdb" bus="virtio"/>
Aug 15 00:38:12 user nova-compute[73010]:       <serial>e4ddadda-c939-425a-bcb3-4e454e0db7f4</serial>
Aug 15 00:38:12 user nova-compute[73010]:     </disk>
Aug 15 00:38:12 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:38:12 user nova-compute[73010]:       <mac address="fa:16:3e:b9:64:22"/>
Aug 15 00:38:12 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:38:12 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:38:12 user nova-compute[73010]:       <target dev="tapba4444c9-ca"/>
Aug 15 00:38:12 user nova-compute[73010]:     </interface>
Aug 15 00:38:12 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:38:12 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/console.log" append="off"/>
Aug 15 00:38:12 user nova-compute[73010]:     </serial>
Aug 15 00:38:12 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:38:12 user nova-compute[73010]:     <video>
Aug 15 00:38:12 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:38:12 user nova-compute[73010]:     </video>
Aug 15 00:38:12 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:38:12 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:38:12 user nova-compute[73010]:     </rng>
Aug 15 00:38:12 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:38:12 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:38:12 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:38:12 user nova-compute[73010]:     </memballoon>
Aug 15 00:38:12 user nova-compute[73010]:   </devices>
Aug 15 00:38:12 user nova-compute[73010]: </domain>
Aug 15 00:38:12 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1216295700',display_name='tempest-ServerActionsTestOtherB-server-1216295700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1216295700',id=2,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVoikkIiX9fqlWUgAuNi/64W1pPax2fim7TT4ZilB7kZJFBTddrjL8mZ+9EedRXSwMMm3xZIb3UP53hHNu173Z0/TxgKI44bIEdZkISEoJSalzaVJQjVXA5W+j4ISJAVA==',key_name='tempest-keypair-1664333158',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:36:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1588cfc0b04643a881de076bea2e23b5',ramdisk_id='',reservation_id='r-t3ok78f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-594907864',owner_user_name='tempest-ServerActionsTestOtherB-594907864-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:37:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5e4be2f71154849a225adb0628fa70e',uuid=983577b5-4abb-4280-b8e8-a63f42d8f796,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Converting VIF {"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:64:22,bridge_name='br-int',has_traffic_filtering=True,id=ba4444c9-ca0d-4265-a567-f931f42b3115,network=Network(25ddd6d0-e3f6-4a35-b15f-a41da18091ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4444c9-ca') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG os_vif [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:64:22,bridge_name='br-int',has_traffic_filtering=True,id=ba4444c9-ca0d-4265-a567-f931f42b3115,network=Network(25ddd6d0-e3f6-4a35-b15f-a41da18091ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4444c9-ca') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba4444c9-ca, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba4444c9-ca, col_values=(('external_ids', {'iface-id': 'ba4444c9-ca0d-4265-a567-f931f42b3115', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:64:22', 'vm-uuid': '983577b5-4abb-4280-b8e8-a63f42d8f796'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:12 user nova-compute[73010]: INFO os_vif [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:64:22,bridge_name='br-int',has_traffic_filtering=True,id=ba4444c9-ca0d-4265-a567-f931f42b3115,network=Network(25ddd6d0-e3f6-4a35-b15f-a41da18091ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4444c9-ca')
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.network.neutron [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Updating instance_info_cache with network_info: [{"id": "d2a83a47-48c9-4483-ab88-c719b6b9c268", "address": "fa:16:3e:fd:35:cf", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a83a47-48", "ovs_interfaceid": "d2a83a47-48c9-4483-ab88-c719b6b9c268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Releasing lock "refresh_cache-362829aa-9659-4ced-9537-d11de1b6b2d7" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.compute.manager [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Instance network_info: |[{"id": "d2a83a47-48c9-4483-ab88-c719b6b9c268", "address": "fa:16:3e:fd:35:cf", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a83a47-48", "ovs_interfaceid": "d2a83a47-48c9-4483-ab88-c719b6b9c268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Start _get_guest_xml network_info=[{"id": "d2a83a47-48c9-4483-ab88-c719b6b9c268", "address": "fa:16:3e:fd:35:cf", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a83a47-48", "ovs_interfaceid": "d2a83a47-48c9-4483-ab88-c719b6b9c268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:38:12 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:38:12 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:38:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2097443447',display_name='tempest-AttachVolumeNegativeTest-server-2097443447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2097443447',id=20,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5DwxlnWA/NEr4+h4zKmrWxM3ExxIiG5grV/4wrpQXES/w9sY/rz0T3P5jdSvQ6Ku2CSJpqwYLPF9NlK8o7lskm5vMz058rCOZKQGWQEa5gyKuWRJZrJuhRpXaY7DoCOg==',key_name='tempest-keypair-167307316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e962745e3a554f2b8f42d97434173a7a',ramdisk_id='',reservation_id='r-a0gs42wj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-865469153',owner_user_name='tempest-AttachVolumeNegativeTest-865469153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:38:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928ab235d55d4bfc86de82f2387c9d06',uuid=362829aa-9659-4ced-9537-d11de1b6b2d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2a83a47-48c9-4483-ab88-c719b6b9c268", "address": "fa:16:3e:fd:35:cf", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a83a47-48", "ovs_interfaceid": "d2a83a47-48c9-4483-ab88-c719b6b9c268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Converting VIF {"id": "d2a83a47-48c9-4483-ab88-c719b6b9c268", "address": "fa:16:3e:fd:35:cf", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a83a47-48", "ovs_interfaceid": "d2a83a47-48c9-4483-ab88-c719b6b9c268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:35:cf,bridge_name='br-int',has_traffic_filtering=True,id=d2a83a47-48c9-4483-ab88-c719b6b9c268,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a83a47-48') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.objects.instance [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lazy-loading 'pci_devices' on Instance uuid 362829aa-9659-4ced-9537-d11de1b6b2d7 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:38:12 user nova-compute[73010]:   <uuid>362829aa-9659-4ced-9537-d11de1b6b2d7</uuid>
Aug 15 00:38:12 user nova-compute[73010]:   <name>instance-00000014</name>
Aug 15 00:38:12 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:38:12 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:38:12 user nova-compute[73010]:   <metadata>
Aug 15 00:38:12 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:38:12 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:38:12 user nova-compute[73010]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2097443447</nova:name>
Aug 15 00:38:12 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:38:12</nova:creationTime>
Aug 15 00:38:12 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:38:12 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:38:12 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:38:12 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:38:12 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:38:12 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:38:12 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:38:12 user nova-compute[73010]:       <nova:owner>
Aug 15 00:38:12 user nova-compute[73010]:         <nova:user uuid="928ab235d55d4bfc86de82f2387c9d06">tempest-AttachVolumeNegativeTest-865469153-project-member</nova:user>
Aug 15 00:38:12 user nova-compute[73010]:         <nova:project uuid="e962745e3a554f2b8f42d97434173a7a">tempest-AttachVolumeNegativeTest-865469153</nova:project>
Aug 15 00:38:12 user nova-compute[73010]:       </nova:owner>
Aug 15 00:38:12 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:38:12 user nova-compute[73010]:       <nova:ports>
Aug 15 00:38:12 user nova-compute[73010]:         <nova:port uuid="d2a83a47-48c9-4483-ab88-c719b6b9c268">
Aug 15 00:38:12 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 00:38:12 user nova-compute[73010]:         </nova:port>
Aug 15 00:38:12 user nova-compute[73010]:       </nova:ports>
Aug 15 00:38:12 user nova-compute[73010]:     </nova:instance>
Aug 15 00:38:12 user nova-compute[73010]:   </metadata>
Aug 15 00:38:12 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:38:12 user nova-compute[73010]:     <system>
Aug 15 00:38:12 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:38:12 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:38:12 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:38:12 user nova-compute[73010]:       <entry name="serial">362829aa-9659-4ced-9537-d11de1b6b2d7</entry>
Aug 15 00:38:12 user nova-compute[73010]:       <entry name="uuid">362829aa-9659-4ced-9537-d11de1b6b2d7</entry>
Aug 15 00:38:12 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:38:12 user nova-compute[73010]:     </system>
Aug 15 00:38:12 user nova-compute[73010]:   </sysinfo>
Aug 15 00:38:12 user nova-compute[73010]:   <os>
Aug 15 00:38:12 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:38:12 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:38:12 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:38:12 user nova-compute[73010]:   </os>
Aug 15 00:38:12 user nova-compute[73010]:   <features>
Aug 15 00:38:12 user nova-compute[73010]:     <acpi/>
Aug 15 00:38:12 user nova-compute[73010]:     <apic/>
Aug 15 00:38:12 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:38:12 user nova-compute[73010]:   </features>
Aug 15 00:38:12 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:38:12 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:38:12 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:38:12 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:38:12 user nova-compute[73010]:   </clock>
Aug 15 00:38:12 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:38:12 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:38:12 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:38:12 user nova-compute[73010]:   </cpu>
Aug 15 00:38:12 user nova-compute[73010]:   <devices>
Aug 15 00:38:12 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:38:12 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:38:12 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/362829aa-9659-4ced-9537-d11de1b6b2d7/disk"/>
Aug 15 00:38:12 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:38:12 user nova-compute[73010]:     </disk>
Aug 15 00:38:12 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:38:12 user nova-compute[73010]:       <mac address="fa:16:3e:fd:35:cf"/>
Aug 15 00:38:12 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:38:12 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:38:12 user nova-compute[73010]:       <target dev="tapd2a83a47-48"/>
Aug 15 00:38:12 user nova-compute[73010]:     </interface>
Aug 15 00:38:12 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:38:12 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/362829aa-9659-4ced-9537-d11de1b6b2d7/console.log" append="off"/>
Aug 15 00:38:12 user nova-compute[73010]:     </serial>
Aug 15 00:38:12 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:38:12 user nova-compute[73010]:     <video>
Aug 15 00:38:12 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:38:12 user nova-compute[73010]:     </video>
Aug 15 00:38:12 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:38:12 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:38:12 user nova-compute[73010]:     </rng>
Aug 15 00:38:12 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:38:12 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:38:12 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:38:12 user nova-compute[73010]:     </memballoon>
Aug 15 00:38:12 user nova-compute[73010]:   </devices>
Aug 15 00:38:12 user nova-compute[73010]: </domain>
Aug 15 00:38:12 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:38:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2097443447',display_name='tempest-AttachVolumeNegativeTest-server-2097443447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2097443447',id=20,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5DwxlnWA/NEr4+h4zKmrWxM3ExxIiG5grV/4wrpQXES/w9sY/rz0T3P5jdSvQ6Ku2CSJpqwYLPF9NlK8o7lskm5vMz058rCOZKQGWQEa5gyKuWRJZrJuhRpXaY7DoCOg==',key_name='tempest-keypair-167307316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e962745e3a554f2b8f42d97434173a7a',ramdisk_id='',reservation_id='r-a0gs42wj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-865469153',owner_user_name='tempest-AttachVolumeNegativeTest-865469153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:38:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928ab235d55d4bfc86de82f2387c9d06',uuid=362829aa-9659-4ced-9537-d11de1b6b2d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2a83a47-48c9-4483-ab88-c719b6b9c268", "address": "fa:16:3e:fd:35:cf", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a83a47-48", "ovs_interfaceid": "d2a83a47-48c9-4483-ab88-c719b6b9c268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Converting VIF {"id": "d2a83a47-48c9-4483-ab88-c719b6b9c268", "address": "fa:16:3e:fd:35:cf", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a83a47-48", "ovs_interfaceid": "d2a83a47-48c9-4483-ab88-c719b6b9c268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:35:cf,bridge_name='br-int',has_traffic_filtering=True,id=d2a83a47-48c9-4483-ab88-c719b6b9c268,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a83a47-48') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG os_vif [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:35:cf,bridge_name='br-int',has_traffic_filtering=True,id=d2a83a47-48c9-4483-ab88-c719b6b9c268,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a83a47-48') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2a83a47-48, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2a83a47-48, col_values=(('external_ids', {'iface-id': 'd2a83a47-48c9-4483-ab88-c719b6b9c268', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:35:cf', 'vm-uuid': '362829aa-9659-4ced-9537-d11de1b6b2d7'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:12 user nova-compute[73010]: INFO os_vif [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:35:cf,bridge_name='br-int',has_traffic_filtering=True,id=d2a83a47-48c9-4483-ab88-c719b6b9c268,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a83a47-48')
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:38:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] No VIF found with MAC fa:16:3e:fd:35:cf, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:38:13 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692059878.9408133, da32613e-b1a9-4733-831f-e4fb1f34995f => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:38:13 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] VM Stopped (Lifecycle Event)
Aug 15 00:38:13 user nova-compute[73010]: DEBUG nova.compute.manager [None req-cf7779e4-9da9-47de-aef8-154559834c79 None None] [instance: da32613e-b1a9-4733-831f-e4fb1f34995f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:38:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-7601a595-db45-4155-8742-6a11ecf0769b req-eb5fa473-c037-4512-bbde-ac77f62c3241 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received event network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:38:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7601a595-db45-4155-8742-6a11ecf0769b req-eb5fa473-c037-4512-bbde-ac77f62c3241 service nova] Acquiring lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7601a595-db45-4155-8742-6a11ecf0769b req-eb5fa473-c037-4512-bbde-ac77f62c3241 service nova] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7601a595-db45-4155-8742-6a11ecf0769b req-eb5fa473-c037-4512-bbde-ac77f62c3241 service nova] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-7601a595-db45-4155-8742-6a11ecf0769b req-eb5fa473-c037-4512-bbde-ac77f62c3241 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] No waiting events found dispatching network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:38:15 user nova-compute[73010]: WARNING nova.compute.manager [req-7601a595-db45-4155-8742-6a11ecf0769b req-eb5fa473-c037-4512-bbde-ac77f62c3241 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received unexpected event network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 for instance with vm_state resized and task_state resize_reverting.
Aug 15 00:38:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-871b3fea-e348-4c6f-8e20-1aa0b288425c req-f5880fa6-804f-441f-9b11-ab687ae3b8a2 service nova] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Received event network-vif-plugged-d2a83a47-48c9-4483-ab88-c719b6b9c268 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:38:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-871b3fea-e348-4c6f-8e20-1aa0b288425c req-f5880fa6-804f-441f-9b11-ab687ae3b8a2 service nova] Acquiring lock "362829aa-9659-4ced-9537-d11de1b6b2d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-871b3fea-e348-4c6f-8e20-1aa0b288425c req-f5880fa6-804f-441f-9b11-ab687ae3b8a2 service nova] Lock "362829aa-9659-4ced-9537-d11de1b6b2d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-871b3fea-e348-4c6f-8e20-1aa0b288425c req-f5880fa6-804f-441f-9b11-ab687ae3b8a2 service nova] Lock "362829aa-9659-4ced-9537-d11de1b6b2d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-871b3fea-e348-4c6f-8e20-1aa0b288425c req-f5880fa6-804f-441f-9b11-ab687ae3b8a2 service nova] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] No waiting events found dispatching network-vif-plugged-d2a83a47-48c9-4483-ab88-c719b6b9c268 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:38:15 user nova-compute[73010]: WARNING nova.compute.manager [req-871b3fea-e348-4c6f-8e20-1aa0b288425c req-f5880fa6-804f-441f-9b11-ab687ae3b8a2 service nova] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Received unexpected event network-vif-plugged-d2a83a47-48c9-4483-ab88-c719b6b9c268 for instance with vm_state building and task_state spawning.
Aug 15 00:38:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:17 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692059882.0580404, afcd0a05-e035-492e-9fbe-cd63f4c3ea42 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:38:17 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] VM Stopped (Lifecycle Event)
Aug 15 00:38:17 user nova-compute[73010]: DEBUG nova.compute.manager [None req-16748a8e-8154-4395-b88d-50ed8d73a07f None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:38:17 user nova-compute[73010]: DEBUG nova.compute.manager [None req-16748a8e-8154-4395-b88d-50ed8d73a07f None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:38:17 user nova-compute[73010]: DEBUG nova.compute.manager [req-e693062a-01b8-4277-9997-5916eb545247 req-8524aa45-a3c0-4b47-9e7e-3d2887939bc1 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received event network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:38:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e693062a-01b8-4277-9997-5916eb545247 req-8524aa45-a3c0-4b47-9e7e-3d2887939bc1 service nova] Acquiring lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e693062a-01b8-4277-9997-5916eb545247 req-8524aa45-a3c0-4b47-9e7e-3d2887939bc1 service nova] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e693062a-01b8-4277-9997-5916eb545247 req-8524aa45-a3c0-4b47-9e7e-3d2887939bc1 service nova] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:17 user nova-compute[73010]: DEBUG nova.compute.manager [req-e693062a-01b8-4277-9997-5916eb545247 req-8524aa45-a3c0-4b47-9e7e-3d2887939bc1 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] No waiting events found dispatching network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:38:17 user nova-compute[73010]: WARNING nova.compute.manager [req-e693062a-01b8-4277-9997-5916eb545247 req-8524aa45-a3c0-4b47-9e7e-3d2887939bc1 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received unexpected event network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 for instance with vm_state resized and task_state resize_reverting.
Aug 15 00:38:17 user nova-compute[73010]: DEBUG nova.compute.manager [req-94f65357-1be8-47c3-86b0-513d89baef01 req-d24042a2-3718-4904-9c71-85caa322438e service nova] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Received event network-vif-plugged-d2a83a47-48c9-4483-ab88-c719b6b9c268 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:38:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-94f65357-1be8-47c3-86b0-513d89baef01 req-d24042a2-3718-4904-9c71-85caa322438e service nova] Acquiring lock "362829aa-9659-4ced-9537-d11de1b6b2d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-94f65357-1be8-47c3-86b0-513d89baef01 req-d24042a2-3718-4904-9c71-85caa322438e service nova] Lock "362829aa-9659-4ced-9537-d11de1b6b2d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-94f65357-1be8-47c3-86b0-513d89baef01 req-d24042a2-3718-4904-9c71-85caa322438e service nova] Lock "362829aa-9659-4ced-9537-d11de1b6b2d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:17 user nova-compute[73010]: DEBUG nova.compute.manager [req-94f65357-1be8-47c3-86b0-513d89baef01 req-d24042a2-3718-4904-9c71-85caa322438e service nova] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] No waiting events found dispatching network-vif-plugged-d2a83a47-48c9-4483-ab88-c719b6b9c268 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:38:17 user nova-compute[73010]: WARNING nova.compute.manager [req-94f65357-1be8-47c3-86b0-513d89baef01 req-d24042a2-3718-4904-9c71-85caa322438e service nova] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Received unexpected event network-vif-plugged-d2a83a47-48c9-4483-ab88-c719b6b9c268 for instance with vm_state building and task_state spawning.
Aug 15 00:38:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:17 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059897.9683883, 983577b5-4abb-4280-b8e8-a63f42d8f796 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:38:17 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] VM Resumed (Lifecycle Event)
Aug 15 00:38:17 user nova-compute[73010]: DEBUG nova.compute.manager [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:38:17 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Instance running successfully.
Aug 15 00:38:17 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] finish_revert_migration finished successfully. {{(pid=73010) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 15 00:38:17 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:38:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:38:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:38:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:38:18 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Instance spawned successfully.
Aug 15 00:38:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:38:18 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 15 00:38:18 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059897.9720883, 983577b5-4abb-4280-b8e8-a63f42d8f796 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:38:18 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] VM Started (Lifecycle Event)
Aug 15 00:38:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:38:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:38:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:38:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:38:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:38:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:38:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:38:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:38:18 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 15 00:38:18 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059898.0030804, 362829aa-9659-4ced-9537-d11de1b6b2d7 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:38:18 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] VM Resumed (Lifecycle Event)
Aug 15 00:38:18 user nova-compute[73010]: INFO nova.compute.manager [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Took 8.00 seconds to spawn the instance on the hypervisor.
Aug 15 00:38:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:38:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:38:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:38:18 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:38:18 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059898.0035484, 362829aa-9659-4ced-9537-d11de1b6b2d7 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:38:18 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] VM Started (Lifecycle Event)
Aug 15 00:38:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:38:18 user nova-compute[73010]: INFO nova.compute.manager [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Took 8.82 seconds to build instance.
Aug 15 00:38:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:38:18 user nova-compute[73010]: INFO nova.compute.manager [None req-1b0497a9-69c4-41ea-8047-be6a2ba63f9a tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Updating instance to original state: 'active'
Aug 15 00:38:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5ff39f97-0eb1-4f32-bc06-573dd0373dc1 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "362829aa-9659-4ced-9537-d11de1b6b2d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.939s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4a805265-6519-480b-af8a-7a94bcd98e21 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquiring lock "0588a46c-2314-47e3-b984-1e04518e8a63" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4a805265-6519-480b-af8a-7a94bcd98e21 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "0588a46c-2314-47e3-b984-1e04518e8a63" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4a805265-6519-480b-af8a-7a94bcd98e21 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquiring lock "0588a46c-2314-47e3-b984-1e04518e8a63-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4a805265-6519-480b-af8a-7a94bcd98e21 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "0588a46c-2314-47e3-b984-1e04518e8a63-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4a805265-6519-480b-af8a-7a94bcd98e21 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "0588a46c-2314-47e3-b984-1e04518e8a63-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:23 user nova-compute[73010]: INFO nova.compute.manager [None req-4a805265-6519-480b-af8a-7a94bcd98e21 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Terminating instance
Aug 15 00:38:23 user nova-compute[73010]: DEBUG nova.compute.manager [None req-4a805265-6519-480b-af8a-7a94bcd98e21 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:38:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:24 user nova-compute[73010]: DEBUG nova.compute.manager [req-553eff2d-39c1-4133-ad7f-913773b6a545 req-d7c8e158-e8cb-4ab9-b8ae-4da9ab203f0d service nova] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Received event network-vif-unplugged-61021aff-d0dd-4ba3-b862-d989711f4b33 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:38:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-553eff2d-39c1-4133-ad7f-913773b6a545 req-d7c8e158-e8cb-4ab9-b8ae-4da9ab203f0d service nova] Acquiring lock "0588a46c-2314-47e3-b984-1e04518e8a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-553eff2d-39c1-4133-ad7f-913773b6a545 req-d7c8e158-e8cb-4ab9-b8ae-4da9ab203f0d service nova] Lock "0588a46c-2314-47e3-b984-1e04518e8a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-553eff2d-39c1-4133-ad7f-913773b6a545 req-d7c8e158-e8cb-4ab9-b8ae-4da9ab203f0d service nova] Lock "0588a46c-2314-47e3-b984-1e04518e8a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:24 user nova-compute[73010]: DEBUG nova.compute.manager [req-553eff2d-39c1-4133-ad7f-913773b6a545 req-d7c8e158-e8cb-4ab9-b8ae-4da9ab203f0d service nova] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] No waiting events found dispatching network-vif-unplugged-61021aff-d0dd-4ba3-b862-d989711f4b33 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:38:24 user nova-compute[73010]: DEBUG nova.compute.manager [req-553eff2d-39c1-4133-ad7f-913773b6a545 req-d7c8e158-e8cb-4ab9-b8ae-4da9ab203f0d service nova] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Received event network-vif-unplugged-61021aff-d0dd-4ba3-b862-d989711f4b33 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:38:24 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Instance destroyed successfully.
Aug 15 00:38:24 user nova-compute[73010]: DEBUG nova.objects.instance [None req-4a805265-6519-480b-af8a-7a94bcd98e21 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lazy-loading 'resources' on Instance uuid 0588a46c-2314-47e3-b984-1e04518e8a63 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:38:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-4a805265-6519-480b-af8a-7a94bcd98e21 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1541399817',display_name='tempest-VolumesAdminNegativeTest-server-1541399817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1541399817',id=4,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIDG6KZ1SQQWytzmi+qJLQk42ncLAqL/vSUZ0cDedrwxb7bEd+3/FVJXYwCTK4wbpXhcrhaA3TluovYJlwjPTWI1cUglevyMOihUHmGcGFvmMoPkeW6YngjG8YATveRUQ==',key_name='tempest-keypair-506867360',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:32:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a620c803f76045d6a5b5b78ec1894c5f',ramdisk_id='',reservation_id='r-p4yxauga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-507850758',owner_user_name='tempest-VolumesAdminNegativeTest-507850758-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:32:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8948cbf02ab4061a56a10037186f60e',uuid=0588a46c-2314-47e3-b984-1e04518e8a63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61021aff-d0dd-4ba3-b862-d989711f4b33", "address": "fa:16:3e:8d:63:82", "network": {"id": "9aa91991-9d4c-4b0d-a955-652df703cde1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-393715584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a620c803f76045d6a5b5b78ec1894c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61021aff-d0", "ovs_interfaceid": "61021aff-d0dd-4ba3-b862-d989711f4b33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:38:24 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-4a805265-6519-480b-af8a-7a94bcd98e21 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Converting VIF {"id": "61021aff-d0dd-4ba3-b862-d989711f4b33", "address": "fa:16:3e:8d:63:82", "network": {"id": "9aa91991-9d4c-4b0d-a955-652df703cde1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-393715584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a620c803f76045d6a5b5b78ec1894c5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61021aff-d0", "ovs_interfaceid": "61021aff-d0dd-4ba3-b862-d989711f4b33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:38:24 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-4a805265-6519-480b-af8a-7a94bcd98e21 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:63:82,bridge_name='br-int',has_traffic_filtering=True,id=61021aff-d0dd-4ba3-b862-d989711f4b33,network=Network(9aa91991-9d4c-4b0d-a955-652df703cde1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61021aff-d0') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:38:24 user nova-compute[73010]: DEBUG os_vif [None req-4a805265-6519-480b-af8a-7a94bcd98e21 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:63:82,bridge_name='br-int',has_traffic_filtering=True,id=61021aff-d0dd-4ba3-b862-d989711f4b33,network=Network(9aa91991-9d4c-4b0d-a955-652df703cde1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61021aff-d0') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:38:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61021aff-d0, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:38:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:38:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:24 user nova-compute[73010]: INFO os_vif [None req-4a805265-6519-480b-af8a-7a94bcd98e21 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:63:82,bridge_name='br-int',has_traffic_filtering=True,id=61021aff-d0dd-4ba3-b862-d989711f4b33,network=Network(9aa91991-9d4c-4b0d-a955-652df703cde1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61021aff-d0')
Aug 15 00:38:24 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-4a805265-6519-480b-af8a-7a94bcd98e21 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Deleting instance files /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63_del
Aug 15 00:38:24 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-4a805265-6519-480b-af8a-7a94bcd98e21 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Deletion of /opt/stack/data/nova/instances/0588a46c-2314-47e3-b984-1e04518e8a63_del complete
Aug 15 00:38:24 user nova-compute[73010]: INFO nova.compute.manager [None req-4a805265-6519-480b-af8a-7a94bcd98e21 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 15 00:38:24 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-4a805265-6519-480b-af8a-7a94bcd98e21 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:38:24 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:38:24 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:38:26 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:38:26 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Took 1.19 seconds to deallocate network for instance.
Aug 15 00:38:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4a805265-6519-480b-af8a-7a94bcd98e21 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4a805265-6519-480b-af8a-7a94bcd98e21 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:26 user nova-compute[73010]: DEBUG nova.compute.manager [req-0cac7fc5-a4ab-45bd-9c91-ff801b4423dd req-76a4068c-c671-47dc-9845-fe329772759a service nova] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Received event network-vif-plugged-61021aff-d0dd-4ba3-b862-d989711f4b33 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:38:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0cac7fc5-a4ab-45bd-9c91-ff801b4423dd req-76a4068c-c671-47dc-9845-fe329772759a service nova] Acquiring lock "0588a46c-2314-47e3-b984-1e04518e8a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0cac7fc5-a4ab-45bd-9c91-ff801b4423dd req-76a4068c-c671-47dc-9845-fe329772759a service nova] Lock "0588a46c-2314-47e3-b984-1e04518e8a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0cac7fc5-a4ab-45bd-9c91-ff801b4423dd req-76a4068c-c671-47dc-9845-fe329772759a service nova] Lock "0588a46c-2314-47e3-b984-1e04518e8a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:26 user nova-compute[73010]: DEBUG nova.compute.manager [req-0cac7fc5-a4ab-45bd-9c91-ff801b4423dd req-76a4068c-c671-47dc-9845-fe329772759a service nova] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] No waiting events found dispatching network-vif-plugged-61021aff-d0dd-4ba3-b862-d989711f4b33 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:38:26 user nova-compute[73010]: WARNING nova.compute.manager [req-0cac7fc5-a4ab-45bd-9c91-ff801b4423dd req-76a4068c-c671-47dc-9845-fe329772759a service nova] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Received unexpected event network-vif-plugged-61021aff-d0dd-4ba3-b862-d989711f4b33 for instance with vm_state deleted and task_state None.
Aug 15 00:38:26 user nova-compute[73010]: DEBUG nova.compute.manager [req-0cac7fc5-a4ab-45bd-9c91-ff801b4423dd req-76a4068c-c671-47dc-9845-fe329772759a service nova] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Received event network-vif-deleted-61021aff-d0dd-4ba3-b862-d989711f4b33 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:38:26 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-4a805265-6519-480b-af8a-7a94bcd98e21 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:38:26 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-4a805265-6519-480b-af8a-7a94bcd98e21 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:38:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4a805265-6519-480b-af8a-7a94bcd98e21 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.480s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:26 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-4a805265-6519-480b-af8a-7a94bcd98e21 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Deleted allocations for instance 0588a46c-2314-47e3-b984-1e04518e8a63
Aug 15 00:38:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4a805265-6519-480b-af8a-7a94bcd98e21 tempest-VolumesAdminNegativeTest-507850758 tempest-VolumesAdminNegativeTest-507850758-project-member] Lock "0588a46c-2314-47e3-b984-1e04518e8a63" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.919s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:39 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692059904.7423708, 0588a46c-2314-47e3-b984-1e04518e8a63 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:38:39 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] VM Stopped (Lifecycle Event)
Aug 15 00:38:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-bd1c8be5-be92-46f2-87bd-42752ca7b073 None None] [instance: 0588a46c-2314-47e3-b984-1e04518e8a63] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:38:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:46 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:38:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:46 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:38:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c4015b5-3ae9-4486-878c-e7a2b01ff5c9/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c4015b5-3ae9-4486-878c-e7a2b01ff5c9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c4015b5-3ae9-4486-878c-e7a2b01ff5c9/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c4015b5-3ae9-4486-878c-e7a2b01ff5c9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362829aa-9659-4ced-9537-d11de1b6b2d7/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362829aa-9659-4ced-9537-d11de1b6b2d7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362829aa-9659-4ced-9537-d11de1b6b2d7/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362829aa-9659-4ced-9537-d11de1b6b2d7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:38:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9058e3fc-9958-4143-9bd7-507396fa619b/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9058e3fc-9958-4143-9bd7-507396fa619b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9058e3fc-9958-4143-9bd7-507396fa619b/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9058e3fc-9958-4143-9bd7-507396fa619b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-be71cf88-c7bf-4d42-84ac-063228132de2 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Acquiring lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-be71cf88-c7bf-4d42-84ac-063228132de2 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-be71cf88-c7bf-4d42-84ac-063228132de2 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Acquiring lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-be71cf88-c7bf-4d42-84ac-063228132de2 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-be71cf88-c7bf-4d42-84ac-063228132de2 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:48 user nova-compute[73010]: INFO nova.compute.manager [None req-be71cf88-c7bf-4d42-84ac-063228132de2 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Terminating instance
Aug 15 00:38:48 user nova-compute[73010]: DEBUG nova.compute.manager [None req-be71cf88-c7bf-4d42-84ac-063228132de2 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG nova.compute.manager [req-5c97af08-d455-4064-8aac-fa838b302af3 req-22127c92-365a-4c4a-a9b5-82a701923631 service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Received event network-vif-unplugged-30aa2ade-cfae-4c5a-aecc-3ddfadea1000 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5c97af08-d455-4064-8aac-fa838b302af3 req-22127c92-365a-4c4a-a9b5-82a701923631 service nova] Acquiring lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5c97af08-d455-4064-8aac-fa838b302af3 req-22127c92-365a-4c4a-a9b5-82a701923631 service nova] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5c97af08-d455-4064-8aac-fa838b302af3 req-22127c92-365a-4c4a-a9b5-82a701923631 service nova] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG nova.compute.manager [req-5c97af08-d455-4064-8aac-fa838b302af3 req-22127c92-365a-4c4a-a9b5-82a701923631 service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] No waiting events found dispatching network-vif-unplugged-30aa2ade-cfae-4c5a-aecc-3ddfadea1000 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:38:48 user nova-compute[73010]: DEBUG nova.compute.manager [req-5c97af08-d455-4064-8aac-fa838b302af3 req-22127c92-365a-4c4a-a9b5-82a701923631 service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Received event network-vif-unplugged-30aa2ade-cfae-4c5a-aecc-3ddfadea1000 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG nova.compute.manager [req-c99cb39e-24ef-4bb0-93f8-b19105a49c21 req-4a9504e2-c572-4937-baf2-72e9045f57b2 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Received event network-changed-4ff59e78-ba56-4896-8f62-3cd1cc2465b4 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG nova.compute.manager [req-c99cb39e-24ef-4bb0-93f8-b19105a49c21 req-4a9504e2-c572-4937-baf2-72e9045f57b2 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Refreshing instance network info cache due to event network-changed-4ff59e78-ba56-4896-8f62-3cd1cc2465b4. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c99cb39e-24ef-4bb0-93f8-b19105a49c21 req-4a9504e2-c572-4937-baf2-72e9045f57b2 service nova] Acquiring lock "refresh_cache-6dfc356b-953a-47b0-9da7-70cc59a80853" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c99cb39e-24ef-4bb0-93f8-b19105a49c21 req-4a9504e2-c572-4937-baf2-72e9045f57b2 service nova] Acquired lock "refresh_cache-6dfc356b-953a-47b0-9da7-70cc59a80853" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG nova.network.neutron [req-c99cb39e-24ef-4bb0-93f8-b19105a49c21 req-4a9504e2-c572-4937-baf2-72e9045f57b2 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Refreshing network info cache for port 4ff59e78-ba56-4896-8f62-3cd1cc2465b4 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:49 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Instance destroyed successfully.
Aug 15 00:38:49 user nova-compute[73010]: DEBUG nova.objects.instance [None req-be71cf88-c7bf-4d42-84ac-063228132de2 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lazy-loading 'resources' on Instance uuid 52878f3e-3ffa-4b1b-b842-ca2215454a3e {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-be71cf88-c7bf-4d42-84ac-063228132de2 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T00:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1403916647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1403916647',id=14,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTpqd0AO5cR/8y8DOTel0pu1KfJ9BbuQ2tYkoDS5WHMZgu+jFCinV11caUfGX5tzP78Z/KTQ4jpvDxB89/wwhV2id1x6y1BOAyCNEVTVJLgpj3ceNjhqPbgEXUOXteS+w==',key_name='tempest-keypair-434770644',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:35:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05feaf1f5e24465d9e3560741bb5f595',ramdisk_id='',reservation_id='r-wnii2rsz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1572033819',owner_user_name='tempest-TaggedAttachmentsTest-1572033819-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:35:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca2df8041ee64a82a97814ab342008b4',uuid=52878f3e-3ffa-4b1b-b842-ca2215454a3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "address": "fa:16:3e:4d:03:9e", "network": {"id": "35a82886-0b11-43bd-adcf-7d64cd9afdc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719337962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05feaf1f5e24465d9e3560741bb5f595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30aa2ade-cf", "ovs_interfaceid": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-be71cf88-c7bf-4d42-84ac-063228132de2 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Converting VIF {"id": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "address": "fa:16:3e:4d:03:9e", "network": {"id": "35a82886-0b11-43bd-adcf-7d64cd9afdc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719337962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05feaf1f5e24465d9e3560741bb5f595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30aa2ade-cf", "ovs_interfaceid": "30aa2ade-cfae-4c5a-aecc-3ddfadea1000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-be71cf88-c7bf-4d42-84ac-063228132de2 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:03:9e,bridge_name='br-int',has_traffic_filtering=True,id=30aa2ade-cfae-4c5a-aecc-3ddfadea1000,network=Network(35a82886-0b11-43bd-adcf-7d64cd9afdc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30aa2ade-cf') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG os_vif [None req-be71cf88-c7bf-4d42-84ac-063228132de2 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:03:9e,bridge_name='br-int',has_traffic_filtering=True,id=30aa2ade-cfae-4c5a-aecc-3ddfadea1000,network=Network(35a82886-0b11-43bd-adcf-7d64cd9afdc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30aa2ade-cf') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30aa2ade-cf, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:49 user nova-compute[73010]: INFO os_vif [None req-be71cf88-c7bf-4d42-84ac-063228132de2 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:03:9e,bridge_name='br-int',has_traffic_filtering=True,id=30aa2ade-cfae-4c5a-aecc-3ddfadea1000,network=Network(35a82886-0b11-43bd-adcf-7d64cd9afdc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30aa2ade-cf')
Aug 15 00:38:49 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-be71cf88-c7bf-4d42-84ac-063228132de2 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Deleting instance files /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e_del
Aug 15 00:38:49 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-be71cf88-c7bf-4d42-84ac-063228132de2 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Deletion of /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e_del complete
Aug 15 00:38:49 user nova-compute[73010]: INFO nova.compute.manager [None req-be71cf88-c7bf-4d42-84ac-063228132de2 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 15 00:38:49 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-be71cf88-c7bf-4d42-84ac-063228132de2 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk --force-share --output=json" returned: 1 in 0.215s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk --force-share --output=json' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:38:49 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000000e, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/52878f3e-3ffa-4b1b-b842-ca2215454a3e/disk
Aug 15 00:38:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:50 user nova-compute[73010]: DEBUG nova.compute.manager [req-e8d9f929-e76a-4912-9e16-adca1301f69c req-c9ed671e-85e6-40f0-ac33-3d9294825c08 service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Received event network-changed-eac88317-fb48-4ff8-b519-8695d8b3ac57 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:38:50 user nova-compute[73010]: DEBUG nova.compute.manager [req-e8d9f929-e76a-4912-9e16-adca1301f69c req-c9ed671e-85e6-40f0-ac33-3d9294825c08 service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Refreshing instance network info cache due to event network-changed-eac88317-fb48-4ff8-b519-8695d8b3ac57. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:38:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e8d9f929-e76a-4912-9e16-adca1301f69c req-c9ed671e-85e6-40f0-ac33-3d9294825c08 service nova] Acquiring lock "refresh_cache-3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:38:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e8d9f929-e76a-4912-9e16-adca1301f69c req-c9ed671e-85e6-40f0-ac33-3d9294825c08 service nova] Acquired lock "refresh_cache-3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:38:50 user nova-compute[73010]: DEBUG nova.network.neutron [req-e8d9f929-e76a-4912-9e16-adca1301f69c req-c9ed671e-85e6-40f0-ac33-3d9294825c08 service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Refreshing network info cache for port eac88317-fb48-4ff8-b519-8695d8b3ac57 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:38:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:38:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:50 user nova-compute[73010]: DEBUG nova.network.neutron [req-c99cb39e-24ef-4bb0-93f8-b19105a49c21 req-4a9504e2-c572-4937-baf2-72e9045f57b2 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Updated VIF entry in instance network info cache for port 4ff59e78-ba56-4896-8f62-3cd1cc2465b4. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:38:50 user nova-compute[73010]: DEBUG nova.network.neutron [req-c99cb39e-24ef-4bb0-93f8-b19105a49c21 req-4a9504e2-c572-4937-baf2-72e9045f57b2 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Updating instance_info_cache with network_info: [{"id": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "address": "fa:16:3e:63:99:69", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff59e78-ba", "ovs_interfaceid": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:38:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c99cb39e-24ef-4bb0-93f8-b19105a49c21 req-4a9504e2-c572-4937-baf2-72e9045f57b2 service nova] Releasing lock "refresh_cache-6dfc356b-953a-47b0-9da7-70cc59a80853" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:38:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG nova.compute.manager [req-c2781830-bb90-4784-94fa-9ba9d3729ff4 req-91033f2a-4afd-4e33-95e0-b576c5663000 service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Received event network-vif-plugged-30aa2ade-cfae-4c5a-aecc-3ddfadea1000 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c2781830-bb90-4784-94fa-9ba9d3729ff4 req-91033f2a-4afd-4e33-95e0-b576c5663000 service nova] Acquiring lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c2781830-bb90-4784-94fa-9ba9d3729ff4 req-91033f2a-4afd-4e33-95e0-b576c5663000 service nova] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c2781830-bb90-4784-94fa-9ba9d3729ff4 req-91033f2a-4afd-4e33-95e0-b576c5663000 service nova] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG nova.compute.manager [req-c2781830-bb90-4784-94fa-9ba9d3729ff4 req-91033f2a-4afd-4e33-95e0-b576c5663000 service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] No waiting events found dispatching network-vif-plugged-30aa2ade-cfae-4c5a-aecc-3ddfadea1000 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:38:51 user nova-compute[73010]: WARNING nova.compute.manager [req-c2781830-bb90-4784-94fa-9ba9d3729ff4 req-91033f2a-4afd-4e33-95e0-b576c5663000 service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Received unexpected event network-vif-plugged-30aa2ade-cfae-4c5a-aecc-3ddfadea1000 for instance with vm_state active and task_state deleting.
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:38:51 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:38:51 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:38:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=7150MB free_disk=25.60513687133789GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG nova.objects.instance [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lazy-loading 'flavor' on Instance uuid 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:38:51 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Took 1.82 seconds to deallocate network for instance.
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-be71cf88-c7bf-4d42-84ac-063228132de2 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG nova.network.neutron [req-e8d9f929-e76a-4912-9e16-adca1301f69c req-c9ed671e-85e6-40f0-ac33-3d9294825c08 service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Updated VIF entry in instance network info cache for port eac88317-fb48-4ff8-b519-8695d8b3ac57. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG nova.network.neutron [req-e8d9f929-e76a-4912-9e16-adca1301f69c req-c9ed671e-85e6-40f0-ac33-3d9294825c08 service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Updating instance_info_cache with network_info: [{"id": "eac88317-fb48-4ff8-b519-8695d8b3ac57", "address": "fa:16:3e:59:f7:fc", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac88317-fb", "ovs_interfaceid": "eac88317-fb48-4ff8-b519-8695d8b3ac57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e8d9f929-e76a-4912-9e16-adca1301f69c req-c9ed671e-85e6-40f0-ac33-3d9294825c08 service nova] Releasing lock "refresh_cache-3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance afcd0a05-e035-492e-9fbe-cd63f4c3ea42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance e2410ee7-7351-460a-8d9c-47fe54e08c8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 52878f3e-3ffa-4b1b-b842-ca2215454a3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance dde74512-c8c3-436c-a6dc-a9327340229e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 983577b5-4abb-4280-b8e8-a63f42d8f796 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6dfc356b-953a-47b0-9da7-70cc59a80853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 9058e3fc-9958-4143-9bd7-507396fa619b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 362829aa-9659-4ced-9537-d11de1b6b2d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:51 user nova-compute[73010]: INFO nova.compute.manager [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Attaching volume e2e92efd-591d-4634-aa9a-cbc3361ebde4 to /dev/vdb
Aug 15 00:38:51 user nova-compute[73010]: DEBUG os_brick.utils [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8dd304-1b4c-4455-bdf2-ef15872da2ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[372a1868-7786-4815-b522-c0d2d0409d7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0b9c9f-a03b-43cf-a936-12f50f450e5f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4571d8b4-33c5-40df-a0d9-127967d99c0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:38:51 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3ea3ec-0f47-4ab3-9cb6-2f29d4a2516b]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG os_brick.utils [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Updating existing volume attachment record: 90c939ac-7b5c-4bad-a4c1-3c0004157f38 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.616s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-be71cf88-c7bf-4d42-84ac-063228132de2 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.545s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:38:52 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-be71cf88-c7bf-4d42-84ac-063228132de2 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:38:52 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-be71cf88-c7bf-4d42-84ac-063228132de2 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:38:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-be71cf88-c7bf-4d42-84ac-063228132de2 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:52 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-be71cf88-c7bf-4d42-84ac-063228132de2 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Deleted allocations for instance 52878f3e-3ffa-4b1b-b842-ca2215454a3e
Aug 15 00:38:52 user nova-compute[73010]: DEBUG nova.compute.manager [req-3ae02c2e-ebe2-446c-83f0-83199b17e5fd req-f4588838-0ff7-4adc-bd46-0062dabf11f9 service nova] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Received event network-vif-deleted-30aa2ade-cfae-4c5a-aecc-3ddfadea1000 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:38:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-be71cf88-c7bf-4d42-84ac-063228132de2 tempest-TaggedAttachmentsTest-1572033819 tempest-TaggedAttachmentsTest-1572033819-project-member] Lock "52878f3e-3ffa-4b1b-b842-ca2215454a3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.873s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:38:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:54 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:38:54 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:38:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:38:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-afcd0a05-e035-492e-9fbe-cd63f4c3ea42" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:38:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-afcd0a05-e035-492e-9fbe-cd63f4c3ea42" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:38:55 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 00:38:55 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Updating instance_info_cache with network_info: [{"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:38:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-afcd0a05-e035-492e-9fbe-cd63f4c3ea42" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:38:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 00:38:55 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:38:55 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:38:55 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:38:55 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:38:55 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:38:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:38:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:38:58 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:38:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDNZxoEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:39:01 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:39:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:39:01 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:39:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:39:01 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a10abd0-5d16-45a1-9ad8-0e21e7dbdad1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:39:01 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b059a04-1556-4847-a9f7-dddf45584d60]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4] added
Aug 15 00:39:01 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[496b5cc5-890d-4a27-9950-c95b7f171c35]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a10dd1e-7ac5-4154-8e88-0c447bf98af2]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rDNZxoEC {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rDNZxoEC" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b76030-26c8-471f-80df-761db4399acb]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rDNZxoEC'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d77c3a6-7026-4742-b3ad-5c9747b94e3c]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[208c2b73-383b-458c-8e20-42b2fec49e71]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01219631-e29a-4cb8-acfa-4773eabf19d1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d33e67d-c8d2-4297-ad12-29433896bf6b (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)
Aug 15 00:39:01 user nova-compute[73010]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:39:01 user nova-compute[73010]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01219631-e29a-4cb8-acfa-4773eabf19d1 (non-flash)
Aug 15 00:39:01 user nova-compute[73010]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d33e67d-c8d2-4297-ad12-29433896bf6b (non-flash)
Aug 15 00:39:01 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)
Aug 15 00:39:01 user nova-compute[73010]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:39:01 user nova-compute[73010]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01219631-e29a-4cb8-acfa-4773eabf19d1 (non-flash)
Aug 15 00:39:01 user nova-compute[73010]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d33e67d-c8d2-4297-ad12-29433896bf6b (non-flash)
Aug 15 00:39:01 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f657a42d-f891-4190-b370-2569d98032d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4, portal: 172.16.0.220,3260]
Aug 15 00:39:01 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4, portal: 172.16.0.220,3260] successful.
Aug 15 00:39:01 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f669bea5-8f75-46f9-8a4b-4634bec127f9]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a697214c-f010-410c-814b-8fc5076b1a41]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01219631-e29a-4cb8-acfa-4773eabf19d1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d33e67d-c8d2-4297-ad12-29433896bf6b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)
Aug 15 00:39:01 user nova-compute[73010]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:39:01 user nova-compute[73010]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01219631-e29a-4cb8-acfa-4773eabf19d1 (non-flash)
Aug 15 00:39:01 user nova-compute[73010]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d33e67d-c8d2-4297-ad12-29433896bf6b (non-flash)
Aug 15 00:39:01 user nova-compute[73010]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 (non-flash)
Aug 15 00:39:01 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)
Aug 15 00:39:01 user nova-compute[73010]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:39:01 user nova-compute[73010]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01219631-e29a-4cb8-acfa-4773eabf19d1 (non-flash)
Aug 15 00:39:01 user nova-compute[73010]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d33e67d-c8d2-4297-ad12-29433896bf6b (non-flash)
Aug 15 00:39:01 user nova-compute[73010]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 (non-flash)
Aug 15 00:39:01 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc4be60-92e3-4af7-bf9b-5beb90128528]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:39:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDNZxoEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:39:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:39:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26165356632323263', 'path': '/dev/sdf'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:39:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165356632323263', 'path': '/dev/sdf'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:39:02 user nova-compute[73010]: DEBUG nova.objects.instance [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lazy-loading 'flavor' on Instance uuid 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:39:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:39:02 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:39:02 user nova-compute[73010]:   <source dev="/dev/sdf"/>
Aug 15 00:39:02 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:39:02 user nova-compute[73010]:   <serial>e2e92efd-591d-4634-aa9a-cbc3361ebde4</serial>
Aug 15 00:39:02 user nova-compute[73010]: </disk>
Aug 15 00:39:02 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:39:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:39:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:39:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] No VIF found with MAC fa:16:3e:59:f7:fc, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:39:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-151383d7-7693-4d4a-add0-4a539d09aec0 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.781s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:39:04 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692059929.3653095, 52878f3e-3ffa-4b1b-b842-ca2215454a3e => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:39:04 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] VM Stopped (Lifecycle Event)
Aug 15 00:39:04 user nova-compute[73010]: DEBUG nova.compute.manager [None req-4761aa67-d511-40d6-add6-5c546a7251b6 None None] [instance: 52878f3e-3ffa-4b1b-b842-ca2215454a3e] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:39:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:39:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:39:05 user nova-compute[73010]: INFO nova.compute.manager [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Detaching volume e2e92efd-591d-4634-aa9a-cbc3361ebde4
Aug 15 00:39:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:06 user nova-compute[73010]: INFO nova.virt.block_device [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Attempting to driver detach volume e2e92efd-591d-4634-aa9a-cbc3361ebde4 from mountpoint /dev/vdb
Aug 15 00:39:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Attempting to detach device vdb from instance 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9 from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:39:06 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:39:06 user nova-compute[73010]:   <source dev="/dev/sdf"/>
Aug 15 00:39:06 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:39:06 user nova-compute[73010]:   <serial>e2e92efd-591d-4634-aa9a-cbc3361ebde4</serial>
Aug 15 00:39:06 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:39:06 user nova-compute[73010]: </disk>
Aug 15 00:39:06 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:39:06 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Successfully detached device vdb from instance 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9 from the persistent domain config.
Aug 15 00:39:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9 from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:39:06 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:39:06 user nova-compute[73010]:   <source dev="/dev/sdf"/>
Aug 15 00:39:06 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:39:06 user nova-compute[73010]:   <serial>e2e92efd-591d-4634-aa9a-cbc3361ebde4</serial>
Aug 15 00:39:06 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:39:06 user nova-compute[73010]: </disk>
Aug 15 00:39:06 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692059946.7506466, 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9 {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:39:06 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Successfully detached device vdb from instance 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9 from the live domain config.
Aug 15 00:39:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDNZxoEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:39:06 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:39:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4bbaf5-3e29-4c51-a2a0-6e6f19c3b3a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01219631-e29a-4cb8-acfa-4773eabf19d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d33e67d-c8d2-4297-ad12-29433896bf6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3c3d3f-5a6d-4c2d-8c18-465165656b04]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01219631-e29a-4cb8-acfa-4773eabf19d1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d33e67d-c8d2-4297-ad12-29433896bf6b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)
Aug 15 00:39:06 user nova-compute[73010]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:39:06 user nova-compute[73010]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01219631-e29a-4cb8-acfa-4773eabf19d1 (non-flash)
Aug 15 00:39:06 user nova-compute[73010]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d33e67d-c8d2-4297-ad12-29433896bf6b (non-flash)
Aug 15 00:39:06 user nova-compute[73010]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 (non-flash)
Aug 15 00:39:06 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)
Aug 15 00:39:06 user nova-compute[73010]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:39:06 user nova-compute[73010]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01219631-e29a-4cb8-acfa-4773eabf19d1 (non-flash)
Aug 15 00:39:06 user nova-compute[73010]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d33e67d-c8d2-4297-ad12-29433896bf6b (non-flash)
Aug 15 00:39:06 user nova-compute[73010]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 (non-flash)
Aug 15 00:39:06 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec306480d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4'): ({'sdf'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Removing single pathed devices sdf {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc9d4b0-ce25-4dd9-8844-9acd59e857fb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb4d5b8-74fa-4ff9-a9c9-ced88aebf7b6]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Flushing IO for device /dev/sdf {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cd2185-415c-4490-b5b2-534d67dac699]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2a32e7-85c5-417c-8f04-615e272bc2fe]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] SCSI volumes sdf have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:39:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ee6966-d9ca-4cef-9676-f5035b330bb1]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:39:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca4c408-9d10-4c3e-8ad6-4d7e44fc9af5]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4, portal: 172.16.0.220,3260]
Aug 15 00:39:07 user nova-compute[73010]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4, portal: 172.16.0.220,3260] successful.
Aug 15 00:39:07 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:39:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e92efd-591d-4634-aa9a-cbc3361ebde4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[258e3383-087a-4f3b-a8f6-3e2181b236fa]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:39:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:39:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] <== disconnect_volume: return (361ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:39:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:39:08 user nova-compute[73010]: DEBUG nova.objects.instance [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lazy-loading 'flavor' on Instance uuid 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:39:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9c6ce677-73ca-4798-819f-d478097b3f58 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.366s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:39:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-9d0ffc3f-6504-47f1-94f9-e7e8ebaf4d48 req-2b8db774-fb70-404b-8748-86272b88f9c3 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received event network-changed-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:39:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-9d0ffc3f-6504-47f1-94f9-e7e8ebaf4d48 req-2b8db774-fb70-404b-8748-86272b88f9c3 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Refreshing instance network info cache due to event network-changed-5db62e1b-e013-4958-8470-da256258503d. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:39:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9d0ffc3f-6504-47f1-94f9-e7e8ebaf4d48 req-2b8db774-fb70-404b-8748-86272b88f9c3 service nova] Acquiring lock "refresh_cache-f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:39:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9d0ffc3f-6504-47f1-94f9-e7e8ebaf4d48 req-2b8db774-fb70-404b-8748-86272b88f9c3 service nova] Acquired lock "refresh_cache-f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:39:30 user nova-compute[73010]: DEBUG nova.network.neutron [req-9d0ffc3f-6504-47f1-94f9-e7e8ebaf4d48 req-2b8db774-fb70-404b-8748-86272b88f9c3 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Refreshing network info cache for port 5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:39:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:31 user nova-compute[73010]: DEBUG nova.network.neutron [req-9d0ffc3f-6504-47f1-94f9-e7e8ebaf4d48 req-2b8db774-fb70-404b-8748-86272b88f9c3 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Updated VIF entry in instance network info cache for port 5db62e1b-e013-4958-8470-da256258503d. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:39:31 user nova-compute[73010]: DEBUG nova.network.neutron [req-9d0ffc3f-6504-47f1-94f9-e7e8ebaf4d48 req-2b8db774-fb70-404b-8748-86272b88f9c3 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Updating instance_info_cache with network_info: [{"id": "5db62e1b-e013-4958-8470-da256258503d", "address": "fa:16:3e:71:55:dd", "network": {"id": "22954f6c-78d2-40d7-91fc-1e8eb0881e40", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1057005040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadfec8dd5ed4c8b8c8730c98b2711ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db62e1b-e0", "ovs_interfaceid": "5db62e1b-e013-4958-8470-da256258503d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:39:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9d0ffc3f-6504-47f1-94f9-e7e8ebaf4d48 req-2b8db774-fb70-404b-8748-86272b88f9c3 service nova] Releasing lock "refresh_cache-f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:39:31 user nova-compute[73010]: DEBUG nova.compute.manager [None req-035809bb-a06b-47c4-bc02-1460f2d02a42 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:39:31 user nova-compute[73010]: INFO nova.compute.manager [None req-035809bb-a06b-47c4-bc02-1460f2d02a42 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] instance snapshotting
Aug 15 00:39:31 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-035809bb-a06b-47c4-bc02-1460f2d02a42 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Beginning live snapshot process
Aug 15 00:39:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-035809bb-a06b-47c4-bc02-1460f2d02a42 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json -f qcow2 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-035809bb-a06b-47c4-bc02-1460f2d02a42 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-035809bb-a06b-47c4-bc02-1460f2d02a42 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json -f qcow2 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-035809bb-a06b-47c4-bc02-1460f2d02a42 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-035809bb-a06b-47c4-bc02-1460f2d02a42 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-035809bb-a06b-47c4-bc02-1460f2d02a42 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.177s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-035809bb-a06b-47c4-bc02-1460f2d02a42 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp67tilri7/5e6db72f205447e99a4918b15cdce0e7.delta 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-035809bb-a06b-47c4-bc02-1460f2d02a42 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp67tilri7/5e6db72f205447e99a4918b15cdce0e7.delta 1073741824" returned: 0 in 0.051s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:32 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-035809bb-a06b-47c4-bc02-1460f2d02a42 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 00:39:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-035809bb-a06b-47c4-bc02-1460f2d02a42 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 00:39:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-035809bb-a06b-47c4-bc02-1460f2d02a42 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 00:39:33 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-035809bb-a06b-47c4-bc02-1460f2d02a42 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 00:39:33 user nova-compute[73010]: DEBUG nova.privsep.utils [None req-035809bb-a06b-47c4-bc02-1460f2d02a42 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73010) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 00:39:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-035809bb-a06b-47c4-bc02-1460f2d02a42 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp67tilri7/5e6db72f205447e99a4918b15cdce0e7.delta /opt/stack/data/nova/instances/snapshots/tmp67tilri7/5e6db72f205447e99a4918b15cdce0e7 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:34 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-035809bb-a06b-47c4-bc02-1460f2d02a42 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp67tilri7/5e6db72f205447e99a4918b15cdce0e7.delta /opt/stack/data/nova/instances/snapshots/tmp67tilri7/5e6db72f205447e99a4918b15cdce0e7" returned: 0 in 0.672s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:34 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-035809bb-a06b-47c4-bc02-1460f2d02a42 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Snapshot extracted, beginning image upload
Aug 15 00:39:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:37 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-035809bb-a06b-47c4-bc02-1460f2d02a42 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Snapshot image upload complete
Aug 15 00:39:37 user nova-compute[73010]: INFO nova.compute.manager [None req-035809bb-a06b-47c4-bc02-1460f2d02a42 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Took 5.78 seconds to snapshot the instance on the hypervisor.
Aug 15 00:39:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-65289fd7-4359-4067-af32-d48e5d7a0c08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Acquiring lock "9058e3fc-9958-4143-9bd7-507396fa619b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:39:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-65289fd7-4359-4067-af32-d48e5d7a0c08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "9058e3fc-9958-4143-9bd7-507396fa619b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:39:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-65289fd7-4359-4067-af32-d48e5d7a0c08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Acquiring lock "9058e3fc-9958-4143-9bd7-507396fa619b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:39:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-65289fd7-4359-4067-af32-d48e5d7a0c08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "9058e3fc-9958-4143-9bd7-507396fa619b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:39:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-65289fd7-4359-4067-af32-d48e5d7a0c08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "9058e3fc-9958-4143-9bd7-507396fa619b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:39:40 user nova-compute[73010]: INFO nova.compute.manager [None req-65289fd7-4359-4067-af32-d48e5d7a0c08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Terminating instance
Aug 15 00:39:40 user nova-compute[73010]: DEBUG nova.compute.manager [None req-65289fd7-4359-4067-af32-d48e5d7a0c08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:39:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:40 user nova-compute[73010]: DEBUG nova.compute.manager [req-6d0d726c-7267-485d-aa12-949a99ab9c07 req-1f2be54a-ea1c-488d-9764-eae64377e7c9 service nova] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Received event network-vif-unplugged-5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:39:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6d0d726c-7267-485d-aa12-949a99ab9c07 req-1f2be54a-ea1c-488d-9764-eae64377e7c9 service nova] Acquiring lock "9058e3fc-9958-4143-9bd7-507396fa619b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:39:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6d0d726c-7267-485d-aa12-949a99ab9c07 req-1f2be54a-ea1c-488d-9764-eae64377e7c9 service nova] Lock "9058e3fc-9958-4143-9bd7-507396fa619b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:39:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6d0d726c-7267-485d-aa12-949a99ab9c07 req-1f2be54a-ea1c-488d-9764-eae64377e7c9 service nova] Lock "9058e3fc-9958-4143-9bd7-507396fa619b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:39:40 user nova-compute[73010]: DEBUG nova.compute.manager [req-6d0d726c-7267-485d-aa12-949a99ab9c07 req-1f2be54a-ea1c-488d-9764-eae64377e7c9 service nova] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] No waiting events found dispatching network-vif-unplugged-5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:39:40 user nova-compute[73010]: DEBUG nova.compute.manager [req-6d0d726c-7267-485d-aa12-949a99ab9c07 req-1f2be54a-ea1c-488d-9764-eae64377e7c9 service nova] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Received event network-vif-unplugged-5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:39:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:41 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Instance destroyed successfully.
Aug 15 00:39:41 user nova-compute[73010]: DEBUG nova.objects.instance [None req-65289fd7-4359-4067-af32-d48e5d7a0c08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lazy-loading 'resources' on Instance uuid 9058e3fc-9958-4143-9bd7-507396fa619b {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:39:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-65289fd7-4359-4067-af32-d48e5d7a0c08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1749373973',display_name='tempest-VolumesActionsTest-instance-1749373973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1749373973',id=19,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:37:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3735c817d3d2455ca95902bd1eaea878',ramdisk_id='',reservation_id='r-l74de20z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1275308888',owner_user_name='tempest-VolumesActionsTest-1275308888-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:37:58Z,user_data=None,user_id='40b76f3f670f4808817395410be6d6bf',uuid=9058e3fc-9958-4143-9bd7-507396fa619b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4", "address": "fa:16:3e:51:cb:59", "network": {"id": "258ca453-3ceb-467a-8fc8-f5d5041c510c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1411807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c817d3d2455ca95902bd1eaea878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba905d3-9e", "ovs_interfaceid": "5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:39:41 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-65289fd7-4359-4067-af32-d48e5d7a0c08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Converting VIF {"id": "5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4", "address": "fa:16:3e:51:cb:59", "network": {"id": "258ca453-3ceb-467a-8fc8-f5d5041c510c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1411807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c817d3d2455ca95902bd1eaea878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba905d3-9e", "ovs_interfaceid": "5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:39:41 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-65289fd7-4359-4067-af32-d48e5d7a0c08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:cb:59,bridge_name='br-int',has_traffic_filtering=True,id=5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4,network=Network(258ca453-3ceb-467a-8fc8-f5d5041c510c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba905d3-9e') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:39:41 user nova-compute[73010]: DEBUG os_vif [None req-65289fd7-4359-4067-af32-d48e5d7a0c08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:cb:59,bridge_name='br-int',has_traffic_filtering=True,id=5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4,network=Network(258ca453-3ceb-467a-8fc8-f5d5041c510c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba905d3-9e') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:39:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ba905d3-9e, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:39:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:39:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:41 user nova-compute[73010]: INFO os_vif [None req-65289fd7-4359-4067-af32-d48e5d7a0c08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:cb:59,bridge_name='br-int',has_traffic_filtering=True,id=5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4,network=Network(258ca453-3ceb-467a-8fc8-f5d5041c510c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba905d3-9e')
Aug 15 00:39:41 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-65289fd7-4359-4067-af32-d48e5d7a0c08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Deleting instance files /opt/stack/data/nova/instances/9058e3fc-9958-4143-9bd7-507396fa619b_del
Aug 15 00:39:41 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-65289fd7-4359-4067-af32-d48e5d7a0c08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Deletion of /opt/stack/data/nova/instances/9058e3fc-9958-4143-9bd7-507396fa619b_del complete
Aug 15 00:39:41 user nova-compute[73010]: INFO nova.compute.manager [None req-65289fd7-4359-4067-af32-d48e5d7a0c08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 15 00:39:41 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-65289fd7-4359-4067-af32-d48e5d7a0c08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:39:41 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:39:41 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:39:42 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:39:42 user nova-compute[73010]: DEBUG nova.compute.manager [req-d01a0c8e-7b97-455d-a3dd-292694dd213c req-d6536e6e-eb6d-4640-bde9-aaee0b68cf1d service nova] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Received event network-vif-deleted-5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:39:42 user nova-compute[73010]: INFO nova.compute.manager [req-d01a0c8e-7b97-455d-a3dd-292694dd213c req-d6536e6e-eb6d-4640-bde9-aaee0b68cf1d service nova] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Neutron deleted interface 5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4; detaching it from the instance and deleting it from the info cache
Aug 15 00:39:42 user nova-compute[73010]: DEBUG nova.network.neutron [req-d01a0c8e-7b97-455d-a3dd-292694dd213c req-d6536e6e-eb6d-4640-bde9-aaee0b68cf1d service nova] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:39:42 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Took 0.69 seconds to deallocate network for instance.
Aug 15 00:39:42 user nova-compute[73010]: DEBUG nova.compute.manager [req-d01a0c8e-7b97-455d-a3dd-292694dd213c req-d6536e6e-eb6d-4640-bde9-aaee0b68cf1d service nova] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Detach interface failed, port_id=5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4, reason: Instance 9058e3fc-9958-4143-9bd7-507396fa619b could not be found. {{(pid=73010) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 00:39:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-65289fd7-4359-4067-af32-d48e5d7a0c08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:39:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-65289fd7-4359-4067-af32-d48e5d7a0c08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:39:42 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-65289fd7-4359-4067-af32-d48e5d7a0c08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:39:42 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-65289fd7-4359-4067-af32-d48e5d7a0c08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:39:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-65289fd7-4359-4067-af32-d48e5d7a0c08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:39:42 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-65289fd7-4359-4067-af32-d48e5d7a0c08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Deleted allocations for instance 9058e3fc-9958-4143-9bd7-507396fa619b
Aug 15 00:39:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-65289fd7-4359-4067-af32-d48e5d7a0c08 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "9058e3fc-9958-4143-9bd7-507396fa619b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.272s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:39:43 user nova-compute[73010]: DEBUG nova.compute.manager [req-9000092b-57c9-489f-843b-5b8200a66622 req-0c4dbdbd-97dd-41db-8089-1857a0c44746 service nova] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Received event network-vif-plugged-5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:39:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9000092b-57c9-489f-843b-5b8200a66622 req-0c4dbdbd-97dd-41db-8089-1857a0c44746 service nova] Acquiring lock "9058e3fc-9958-4143-9bd7-507396fa619b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:39:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9000092b-57c9-489f-843b-5b8200a66622 req-0c4dbdbd-97dd-41db-8089-1857a0c44746 service nova] Lock "9058e3fc-9958-4143-9bd7-507396fa619b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:39:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9000092b-57c9-489f-843b-5b8200a66622 req-0c4dbdbd-97dd-41db-8089-1857a0c44746 service nova] Lock "9058e3fc-9958-4143-9bd7-507396fa619b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:39:43 user nova-compute[73010]: DEBUG nova.compute.manager [req-9000092b-57c9-489f-843b-5b8200a66622 req-0c4dbdbd-97dd-41db-8089-1857a0c44746 service nova] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] No waiting events found dispatching network-vif-plugged-5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:39:43 user nova-compute[73010]: WARNING nova.compute.manager [req-9000092b-57c9-489f-843b-5b8200a66622 req-0c4dbdbd-97dd-41db-8089-1857a0c44746 service nova] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Received unexpected event network-vif-plugged-5ba905d3-9e4f-4f64-a8d2-1d26e7a2bdc4 for instance with vm_state deleted and task_state None.
Aug 15 00:39:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Acquiring lock "6bf89433-15f9-44fd-a4c1-00b72287f65f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:39:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:39:44 user nova-compute[73010]: DEBUG nova.compute.manager [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:39:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:39:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:39:44 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:39:44 user nova-compute[73010]: INFO nova.compute.claims [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Claim successful on node user
Aug 15 00:39:44 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:39:44 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG nova.compute.manager [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG nova.compute.manager [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG nova.network.neutron [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:39:45 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:39:45 user nova-compute[73010]: DEBUG nova.compute.manager [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:39:45 user nova-compute[73010]: INFO nova.virt.block_device [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Booting with volume 83bdf3fa-8592-419d-90c9-a3d7a56f1a2c at /dev/vda
Aug 15 00:39:45 user nova-compute[73010]: DEBUG nova.policy [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19782b910361424ba7740c41f9331814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869253a2da7e4e95bb720ab7b203284c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG os_brick.utils [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[011cd7b2-970b-4535-96c8-40e2a15293aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[582c2468-edd4-433f-9939-e15ad223d23e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e499d22f-2f72-4927-b151-db5f7bbda436]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[251ac125-6ec7-45b1-888a-8c7b2cabd22a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:39:45 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:39:45 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73220e3-e7ea-43fc-94b7-dc4c041072cf]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG os_brick.utils [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:39:45 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Updating existing volume attachment record: bb01a9f9-0e12-484b-b759-a0a39d3887ea {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:39:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:46 user nova-compute[73010]: DEBUG nova.network.neutron [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Successfully created port: f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:39:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:47 user nova-compute[73010]: DEBUG nova.network.neutron [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Successfully updated port: f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:39:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Acquiring lock "refresh_cache-6bf89433-15f9-44fd-a4c1-00b72287f65f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:39:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Acquired lock "refresh_cache-6bf89433-15f9-44fd-a4c1-00b72287f65f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:39:47 user nova-compute[73010]: DEBUG nova.network.neutron [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:39:47 user nova-compute[73010]: DEBUG nova.compute.manager [req-70c63212-5e95-40cc-9362-c6c622a54b03 req-84f81edf-9d86-4f65-949e-4fb0c5f350b0 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Received event network-changed-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:39:47 user nova-compute[73010]: DEBUG nova.compute.manager [req-70c63212-5e95-40cc-9362-c6c622a54b03 req-84f81edf-9d86-4f65-949e-4fb0c5f350b0 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Refreshing instance network info cache due to event network-changed-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:39:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-70c63212-5e95-40cc-9362-c6c622a54b03 req-84f81edf-9d86-4f65-949e-4fb0c5f350b0 service nova] Acquiring lock "refresh_cache-6bf89433-15f9-44fd-a4c1-00b72287f65f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:39:47 user nova-compute[73010]: DEBUG nova.network.neutron [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:39:47 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:39:47 user nova-compute[73010]: DEBUG nova.network.neutron [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Updating instance_info_cache with network_info: [{"id": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "address": "fa:16:3e:e1:57:94", "network": {"id": "df55f352-d3b0-4133-939b-74d35a420b49", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159866404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869253a2da7e4e95bb720ab7b203284c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c6a8bc-4f", "ovs_interfaceid": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:39:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:39:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:39:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:39:47 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:39:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Releasing lock "refresh_cache-6bf89433-15f9-44fd-a4c1-00b72287f65f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:39:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Instance network_info: |[{"id": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "address": "fa:16:3e:e1:57:94", "network": {"id": "df55f352-d3b0-4133-939b-74d35a420b49", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159866404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869253a2da7e4e95bb720ab7b203284c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c6a8bc-4f", "ovs_interfaceid": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:39:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-70c63212-5e95-40cc-9362-c6c622a54b03 req-84f81edf-9d86-4f65-949e-4fb0c5f350b0 service nova] Acquired lock "refresh_cache-6bf89433-15f9-44fd-a4c1-00b72287f65f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:39:47 user nova-compute[73010]: DEBUG nova.network.neutron [req-70c63212-5e95-40cc-9362-c6c622a54b03 req-84f81edf-9d86-4f65-949e-4fb0c5f350b0 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Refreshing network info cache for port f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:39:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c4015b5-3ae9-4486-878c-e7a2b01ff5c9/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c4015b5-3ae9-4486-878c-e7a2b01ff5c9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c4015b5-3ae9-4486-878c-e7a2b01ff5c9/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:48 user nova-compute[73010]: DEBUG nova.network.neutron [req-70c63212-5e95-40cc-9362-c6c622a54b03 req-84f81edf-9d86-4f65-949e-4fb0c5f350b0 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Updated VIF entry in instance network info cache for port f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:39:48 user nova-compute[73010]: DEBUG nova.network.neutron [req-70c63212-5e95-40cc-9362-c6c622a54b03 req-84f81edf-9d86-4f65-949e-4fb0c5f350b0 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Updating instance_info_cache with network_info: [{"id": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "address": "fa:16:3e:e1:57:94", "network": {"id": "df55f352-d3b0-4133-939b-74d35a420b49", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159866404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869253a2da7e4e95bb720ab7b203284c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c6a8bc-4f", "ovs_interfaceid": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:39:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-70c63212-5e95-40cc-9362-c6c622a54b03 req-84f81edf-9d86-4f65-949e-4fb0c5f350b0 service nova] Releasing lock "refresh_cache-6bf89433-15f9-44fd-a4c1-00b72287f65f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:39:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c4015b5-3ae9-4486-878c-e7a2b01ff5c9/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362829aa-9659-4ced-9537-d11de1b6b2d7/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362829aa-9659-4ced-9537-d11de1b6b2d7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362829aa-9659-4ced-9537-d11de1b6b2d7/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/362829aa-9659-4ced-9537-d11de1b6b2d7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:39:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:39:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Acquiring lock "009d9050-1720-45de-8bc9-16f404e65911" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:39:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "009d9050-1720-45de-8bc9-16f404e65911" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:39:50 user nova-compute[73010]: DEBUG nova.compute.manager [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:39:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:51 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:39:51 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:39:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=7628MB free_disk=25.597614288330078GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:39:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:39:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:39:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:39:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance afcd0a05-e035-492e-9fbe-cd63f4c3ea42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:39:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance e2410ee7-7351-460a-8d9c-47fe54e08c8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:39:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance dde74512-c8c3-436c-a6dc-a9327340229e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:39:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 983577b5-4abb-4280-b8e8-a63f42d8f796 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:39:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:39:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6dfc356b-953a-47b0-9da7-70cc59a80853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:39:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:39:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 362829aa-9659-4ced-9537-d11de1b6b2d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:39:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6bf89433-15f9-44fd-a4c1-00b72287f65f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:39:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 009d9050-1720-45de-8bc9-16f404e65911 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 15 00:39:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:39:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:39:51 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:39:51 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:39:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:39:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.468s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:39:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.453s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:39:51 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:39:51 user nova-compute[73010]: INFO nova.compute.claims [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Claim successful on node user
Aug 15 00:39:52 user nova-compute[73010]: DEBUG nova.objects.instance [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'flavor' on Instance uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "refresh_cache-afcd0a05-e035-492e-9fbe-cd63f4c3ea42" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquired lock "refresh_cache-afcd0a05-e035-492e-9fbe-cd63f4c3ea42" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG nova.network.neutron [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG nova.objects.instance [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'info_cache' on Instance uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG nova.compute.manager [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG nova.compute.manager [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG nova.network.neutron [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:39:52 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:39:52 user nova-compute[73010]: DEBUG nova.compute.manager [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:52 user nova-compute[73010]: INFO nova.virt.block_device [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Booting with volume 72f87474-057f-402d-883f-be3d848431a6 at /dev/vda
Aug 15 00:39:52 user nova-compute[73010]: DEBUG nova.policy [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c8c404d2a364ce6be183c14da241836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c735a6d80a64492baf3346d0c96a872b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG os_brick.utils [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2dddaf-1973-4ca8-b69b-fe00ffab328b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c20190e-3ba8-4323-a875-51ecfec261cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3964c8e9-5577-4f25-a25b-010d5569c001]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[507cbb61-9915-423e-8fe5-802a4b793180]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:39:52 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:39:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8a28dd-c83e-47e0-80ed-6aea3461bca9]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG os_brick.utils [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:39:52 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Updating existing volume attachment record: 83ebf4ae-be76-410d-aec9-f516c28256ca {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.network.neutron [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Updating instance_info_cache with network_info: [{"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Releasing lock "refresh_cache-afcd0a05-e035-492e-9fbe-cd63f4c3ea42" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:39:53 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Instance destroyed successfully.
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.objects.instance [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'resources' on Instance uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1899570606',display_name='tempest-AttachVolumeTestJSON-server-1899570606',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1899570606',id=3,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMV9Ia1g6S1Dqv5u52uv7YpM19NUmr26Hj+tCSO6tG0aZL4zk5VCqdKIe6IWKX3KiHIXyqR1c1NApawOfSvd8OOhU+aA7fYaPBkxC185NYPaDo0+I9Vsdwf99lfNe8lrhw==',key_name='tempest-keypair-1489578241',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:32:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e50aaf528c8c4d4ba8d39b3b203b5a52',ramdisk_id='',reservation_id='r-abzuan7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-338922600',owner_user_name='tempest-AttachVolumeTestJSON-338922600-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:38:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53c8150819854d29b1d8c865da2642ca',uuid=afcd0a05-e035-492e-9fbe-cd63f4c3ea42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Converting VIF {"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:68:0b,bridge_name='br-int',has_traffic_filtering=True,id=2f2b345b-67b5-4d95-bbd3-3fe48aafaee5,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b345b-67') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG os_vif [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:68:0b,bridge_name='br-int',has_traffic_filtering=True,id=2f2b345b-67b5-4d95-bbd3-3fe48aafaee5,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b345b-67') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f2b345b-67, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:39:53 user nova-compute[73010]: INFO os_vif [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:68:0b,bridge_name='br-int',has_traffic_filtering=True,id=2f2b345b-67b5-4d95-bbd3-3fe48aafaee5,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b345b-67')
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Start _get_guest_xml network_info=[{"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.objects.instance [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'numa_topology' on Instance uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:39:53 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:39:53 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.objects.instance [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'vcpu_model' on Instance uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1899570606',display_name='tempest-AttachVolumeTestJSON-server-1899570606',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1899570606',id=3,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMV9Ia1g6S1Dqv5u52uv7YpM19NUmr26Hj+tCSO6tG0aZL4zk5VCqdKIe6IWKX3KiHIXyqR1c1NApawOfSvd8OOhU+aA7fYaPBkxC185NYPaDo0+I9Vsdwf99lfNe8lrhw==',key_name='tempest-keypair-1489578241',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:32:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e50aaf528c8c4d4ba8d39b3b203b5a52',ramdisk_id='',reservation_id='r-abzuan7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-338922600',owner_user_name='tempest-AttachVolumeTestJSON-338922600-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:38:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53c8150819854d29b1d8c865da2642ca',uuid=afcd0a05-e035-492e-9fbe-cd63f4c3ea42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Converting VIF {"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:68:0b,bridge_name='br-int',has_traffic_filtering=True,id=2f2b345b-67b5-4d95-bbd3-3fe48aafaee5,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b345b-67') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.objects.instance [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'pci_devices' on Instance uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.network.neutron [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Successfully created port: 96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:39:53 user nova-compute[73010]:   <uuid>afcd0a05-e035-492e-9fbe-cd63f4c3ea42</uuid>
Aug 15 00:39:53 user nova-compute[73010]:   <name>instance-00000003</name>
Aug 15 00:39:53 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:39:53 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:39:53 user nova-compute[73010]:   <metadata>
Aug 15 00:39:53 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:39:53 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:39:53 user nova-compute[73010]:       <nova:name>tempest-AttachVolumeTestJSON-server-1899570606</nova:name>
Aug 15 00:39:53 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:39:53</nova:creationTime>
Aug 15 00:39:53 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:39:53 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:39:53 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:39:53 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:39:53 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:39:53 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:39:53 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:39:53 user nova-compute[73010]:       <nova:owner>
Aug 15 00:39:53 user nova-compute[73010]:         <nova:user uuid="53c8150819854d29b1d8c865da2642ca">tempest-AttachVolumeTestJSON-338922600-project-member</nova:user>
Aug 15 00:39:53 user nova-compute[73010]:         <nova:project uuid="e50aaf528c8c4d4ba8d39b3b203b5a52">tempest-AttachVolumeTestJSON-338922600</nova:project>
Aug 15 00:39:53 user nova-compute[73010]:       </nova:owner>
Aug 15 00:39:53 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:39:53 user nova-compute[73010]:       <nova:ports>
Aug 15 00:39:53 user nova-compute[73010]:         <nova:port uuid="2f2b345b-67b5-4d95-bbd3-3fe48aafaee5">
Aug 15 00:39:53 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 00:39:53 user nova-compute[73010]:         </nova:port>
Aug 15 00:39:53 user nova-compute[73010]:       </nova:ports>
Aug 15 00:39:53 user nova-compute[73010]:     </nova:instance>
Aug 15 00:39:53 user nova-compute[73010]:   </metadata>
Aug 15 00:39:53 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:39:53 user nova-compute[73010]:     <system>
Aug 15 00:39:53 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:39:53 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:39:53 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:39:53 user nova-compute[73010]:       <entry name="serial">afcd0a05-e035-492e-9fbe-cd63f4c3ea42</entry>
Aug 15 00:39:53 user nova-compute[73010]:       <entry name="uuid">afcd0a05-e035-492e-9fbe-cd63f4c3ea42</entry>
Aug 15 00:39:53 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:39:53 user nova-compute[73010]:     </system>
Aug 15 00:39:53 user nova-compute[73010]:   </sysinfo>
Aug 15 00:39:53 user nova-compute[73010]:   <os>
Aug 15 00:39:53 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:39:53 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:39:53 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:39:53 user nova-compute[73010]:   </os>
Aug 15 00:39:53 user nova-compute[73010]:   <features>
Aug 15 00:39:53 user nova-compute[73010]:     <acpi/>
Aug 15 00:39:53 user nova-compute[73010]:     <apic/>
Aug 15 00:39:53 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:39:53 user nova-compute[73010]:   </features>
Aug 15 00:39:53 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:39:53 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:39:53 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:39:53 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:39:53 user nova-compute[73010]:   </clock>
Aug 15 00:39:53 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:39:53 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:39:53 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:39:53 user nova-compute[73010]:   </cpu>
Aug 15 00:39:53 user nova-compute[73010]:   <devices>
Aug 15 00:39:53 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:39:53 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:39:53 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk"/>
Aug 15 00:39:53 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:39:53 user nova-compute[73010]:     </disk>
Aug 15 00:39:53 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:39:53 user nova-compute[73010]:       <mac address="fa:16:3e:7b:68:0b"/>
Aug 15 00:39:53 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:39:53 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:39:53 user nova-compute[73010]:       <target dev="tap2f2b345b-67"/>
Aug 15 00:39:53 user nova-compute[73010]:     </interface>
Aug 15 00:39:53 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:39:53 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/console.log" append="off"/>
Aug 15 00:39:53 user nova-compute[73010]:     </serial>
Aug 15 00:39:53 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:39:53 user nova-compute[73010]:     <video>
Aug 15 00:39:53 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:39:53 user nova-compute[73010]:     </video>
Aug 15 00:39:53 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:39:53 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:39:53 user nova-compute[73010]:     </rng>
Aug 15 00:39:53 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:39:53 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:39:53 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:39:53 user nova-compute[73010]:     </memballoon>
Aug 15 00:39:53 user nova-compute[73010]:   </devices>
Aug 15 00:39:53 user nova-compute[73010]: </domain>
Aug 15 00:39:53 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.objects.instance [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'trusted_certs' on Instance uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Checking if we can resize image /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:39:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Cannot resize image /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG nova.objects.instance [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'migration_context' on Instance uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1899570606',display_name='tempest-AttachVolumeTestJSON-server-1899570606',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1899570606',id=3,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMV9Ia1g6S1Dqv5u52uv7YpM19NUmr26Hj+tCSO6tG0aZL4zk5VCqdKIe6IWKX3KiHIXyqR1c1NApawOfSvd8OOhU+aA7fYaPBkxC185NYPaDo0+I9Vsdwf99lfNe8lrhw==',key_name='tempest-keypair-1489578241',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:32:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='e50aaf528c8c4d4ba8d39b3b203b5a52',ramdisk_id='',reservation_id='r-abzuan7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-338922600',owner_user_name='tempest-AttachVolumeTestJSON-338922600-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:38:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53c8150819854d29b1d8c865da2642ca',uuid=afcd0a05-e035-492e-9fbe-cd63f4c3ea42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Converting VIF {"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:68:0b,bridge_name='br-int',has_traffic_filtering=True,id=2f2b345b-67b5-4d95-bbd3-3fe48aafaee5,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b345b-67') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG os_vif [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:68:0b,bridge_name='br-int',has_traffic_filtering=True,id=2f2b345b-67b5-4d95-bbd3-3fe48aafaee5,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b345b-67') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f2b345b-67, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2f2b345b-67, col_values=(('external_ids', {'iface-id': '2f2b345b-67b5-4d95-bbd3-3fe48aafaee5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:68:0b', 'vm-uuid': 'afcd0a05-e035-492e-9fbe-cd63f4c3ea42'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:54 user nova-compute[73010]: INFO os_vif [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:68:0b,bridge_name='br-int',has_traffic_filtering=True,id=2f2b345b-67b5-4d95-bbd3-3fe48aafaee5,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b345b-67')
Aug 15 00:39:54 user nova-compute[73010]: DEBUG nova.network.neutron [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Successfully updated port: 96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Acquiring lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Acquired lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG nova.network.neutron [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG nova.compute.manager [req-0ee7c1ae-816e-46e4-9209-e5c36565ff81 req-60c3f929-95aa-45b8-8fd1-22068ae520a6 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Received event network-changed-96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG nova.compute.manager [req-0ee7c1ae-816e-46e4-9209-e5c36565ff81 req-60c3f929-95aa-45b8-8fd1-22068ae520a6 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Refreshing instance network info cache due to event network-changed-96dadd50-12c8-430b-82ab-f113031f02d8. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0ee7c1ae-816e-46e4-9209-e5c36565ff81 req-60c3f929-95aa-45b8-8fd1-22068ae520a6 service nova] Acquiring lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG nova.network.neutron [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG nova.network.neutron [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Updating instance_info_cache with network_info: [{"id": "96dadd50-12c8-430b-82ab-f113031f02d8", "address": "fa:16:3e:d4:06:17", "network": {"id": "935a0b3b-6f36-45b2-a8d0-4d4541cce103", "bridge": "br-int", "label": "tempest-TestShelveInstance-1947454102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c735a6d80a64492baf3346d0c96a872b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dadd50-12", "ovs_interfaceid": "96dadd50-12c8-430b-82ab-f113031f02d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Releasing lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Instance network_info: |[{"id": "96dadd50-12c8-430b-82ab-f113031f02d8", "address": "fa:16:3e:d4:06:17", "network": {"id": "935a0b3b-6f36-45b2-a8d0-4d4541cce103", "bridge": "br-int", "label": "tempest-TestShelveInstance-1947454102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c735a6d80a64492baf3346d0c96a872b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dadd50-12", "ovs_interfaceid": "96dadd50-12c8-430b-82ab-f113031f02d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0ee7c1ae-816e-46e4-9209-e5c36565ff81 req-60c3f929-95aa-45b8-8fd1-22068ae520a6 service nova] Acquired lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:39:54 user nova-compute[73010]: DEBUG nova.network.neutron [req-0ee7c1ae-816e-46e4-9209-e5c36565ff81 req-60c3f929-95aa-45b8-8fd1-22068ae520a6 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Refreshing network info cache for port 96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.network.neutron [req-0ee7c1ae-816e-46e4-9209-e5c36565ff81 req-60c3f929-95aa-45b8-8fd1-22068ae520a6 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Updated VIF entry in instance network info cache for port 96dadd50-12c8-430b-82ab-f113031f02d8. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.network.neutron [req-0ee7c1ae-816e-46e4-9209-e5c36565ff81 req-60c3f929-95aa-45b8-8fd1-22068ae520a6 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Updating instance_info_cache with network_info: [{"id": "96dadd50-12c8-430b-82ab-f113031f02d8", "address": "fa:16:3e:d4:06:17", "network": {"id": "935a0b3b-6f36-45b2-a8d0-4d4541cce103", "bridge": "br-int", "label": "tempest-TestShelveInstance-1947454102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c735a6d80a64492baf3346d0c96a872b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dadd50-12", "ovs_interfaceid": "96dadd50-12c8-430b-82ab-f113031f02d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0ee7c1ae-816e-46e4-9209-e5c36565ff81 req-60c3f929-95aa-45b8-8fd1-22068ae520a6 service nova] Releasing lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-e2410ee7-7351-460a-8d9c-47fe54e08c8b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-e2410ee7-7351-460a-8d9c-47fe54e08c8b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:39:55 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Creating image(s)
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Did not create local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Ensure instance console log exists: /opt/stack/data/nova/instances/6bf89433-15f9-44fd-a4c1-00b72287f65f/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Start _get_guest_xml network_info=[{"id": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "address": "fa:16:3e:e1:57:94", "network": {"id": "df55f352-d3b0-4133-939b-74d35a420b49", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159866404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869253a2da7e4e95bb720ab7b203284c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c6a8bc-4f", "ovs_interfaceid": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpZGkKBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6bf89433-15f9-44fd-a4c1-00b72287f65f', 'attached_at': '', 'detached_at': '', 'volume_id': '83bdf3fa-8592-419d-90c9-a3d7a56f1a2c', 'serial': '83bdf3fa-8592-419d-90c9-a3d7a56f1a2c'}, 'disk_bus': 'virtio', 'attachment_id': 'bb01a9f9-0e12-484b-b759-a0a39d3887ea', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:39:55 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:39:55 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpZGkKBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:39:55 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:39:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:39:55 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:39:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:39:55 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:39:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a25857-3435-4d2b-a4b0-2c4c44c43731]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:39:55 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:39:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd7b1ef-ba5c-486f-8968-d0237fd12ced]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c] added
Aug 15 00:39:56 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75423bd-9bb2-449e-ae04-5402099ee43e]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb5d39c-c42d-4b42-9509-0fed810d85dd]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xpZGkKBA {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xpZGkKBA" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[db480b05-82bc-4451-b2a8-6e4a5bd37131]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xpZGkKBA'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df10096-d5c0-458b-aa04-ce7921aa2d0b]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[abafb8e9-f49f-43c6-a4d6-ab19e17c1c90]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)
Aug 15 00:39:56 user nova-compute[73010]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:39:56 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)
Aug 15 00:39:56 user nova-compute[73010]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:39:56 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbaf944-f246-401c-aada-a04cab10d788]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c, portal: 172.16.0.220,3260]
Aug 15 00:39:56 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c, portal: 172.16.0.220,3260] successful.
Aug 15 00:39:56 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4234653c-292c-4000-8d25-965f61b8d261]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[56af57b5-2652-457d-ba64-1419f737b151]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)
Aug 15 00:39:56 user nova-compute[73010]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:39:56 user nova-compute[73010]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:39:56 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)
Aug 15 00:39:56 user nova-compute[73010]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:39:56 user nova-compute[73010]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:39:56 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e092fc4-3886-4e45-8fdd-abf07b258024]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpZGkKBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692059981.4058256, 9058e3fc-9958-4143-9bd7-507396fa619b => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:39:56 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] VM Stopped (Lifecycle Event)
Aug 15 00:39:56 user nova-compute[73010]: DEBUG nova.compute.manager [None req-a0200fb0-039a-4aac-9b57-b6ab0286c4c1 None None] [instance: 9058e3fc-9958-4143-9bd7-507396fa619b] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG nova.compute.manager [req-21af7b89-a114-4167-92c7-e27f48798c7c req-2db08ce4-3ea8-449d-b751-39e273720bfe service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received event network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-21af7b89-a114-4167-92c7-e27f48798c7c req-2db08ce4-3ea8-449d-b751-39e273720bfe service nova] Acquiring lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-21af7b89-a114-4167-92c7-e27f48798c7c req-2db08ce4-3ea8-449d-b751-39e273720bfe service nova] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-21af7b89-a114-4167-92c7-e27f48798c7c req-2db08ce4-3ea8-449d-b751-39e273720bfe service nova] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG nova.compute.manager [req-21af7b89-a114-4167-92c7-e27f48798c7c req-2db08ce4-3ea8-449d-b751-39e273720bfe service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] No waiting events found dispatching network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:39:56 user nova-compute[73010]: WARNING nova.compute.manager [req-21af7b89-a114-4167-92c7-e27f48798c7c req-2db08ce4-3ea8-449d-b751-39e273720bfe service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received unexpected event network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 for instance with vm_state stopped and task_state powering-on.
Aug 15 00:39:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Updating instance_info_cache with network_info: [{"id": "1ba74d11-2708-46c3-b73c-def3200202e4", "address": "fa:16:3e:c5:b2:68", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba74d11-27", "ovs_interfaceid": "1ba74d11-2708-46c3-b73c-def3200202e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-e2410ee7-7351-460a-8d9c-47fe54e08c8b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:39:56 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '23264383964393930', 'path': '/dev/sdd'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264383964393930', 'path': '/dev/sdd'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:39:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-100459501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-100459501',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMvoU/VZ3MSVvKPEfl46VySM54g5gxjuVwvlv2ViBOX1qb9sxUhG896E4HXK1GlhKtb8cZiIme4xtoJu/nd/1zEHxtFmbxdZPCP6Pee/6tKM6u6rfoWMfAG7Psx72fYJg==',key_name='tempest-keypair-848269880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='869253a2da7e4e95bb720ab7b203284c',ramdisk_id='',reservation_id='r-xs10r9gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-710111316',owner_user_name='tempest-ServerActionsV293TestJSON-710111316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:39:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19782b910361424ba7740c41f9331814',uuid=6bf89433-15f9-44fd-a4c1-00b72287f65f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "address": "fa:16:3e:e1:57:94", "network": {"id": "df55f352-d3b0-4133-939b-74d35a420b49", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159866404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869253a2da7e4e95bb720ab7b203284c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c6a8bc-4f", "ovs_interfaceid": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Converting VIF {"id": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "address": "fa:16:3e:e1:57:94", "network": {"id": "df55f352-d3b0-4133-939b-74d35a420b49", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159866404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869253a2da7e4e95bb720ab7b203284c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c6a8bc-4f", "ovs_interfaceid": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:57:94,bridge_name='br-int',has_traffic_filtering=True,id=f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8,network=Network(df55f352-d3b0-4133-939b-74d35a420b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c6a8bc-4f') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG nova.objects.instance [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lazy-loading 'pci_devices' on Instance uuid 6bf89433-15f9-44fd-a4c1-00b72287f65f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:39:57 user nova-compute[73010]:   <uuid>6bf89433-15f9-44fd-a4c1-00b72287f65f</uuid>
Aug 15 00:39:57 user nova-compute[73010]:   <name>instance-00000015</name>
Aug 15 00:39:57 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:39:57 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:39:57 user nova-compute[73010]:   <metadata>
Aug 15 00:39:57 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:39:57 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:39:57 user nova-compute[73010]:       <nova:name>tempest-ServerActionsV293TestJSON-server-100459501</nova:name>
Aug 15 00:39:57 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:39:55</nova:creationTime>
Aug 15 00:39:57 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:39:57 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:39:57 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:39:57 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:39:57 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:39:57 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:39:57 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:39:57 user nova-compute[73010]:       <nova:owner>
Aug 15 00:39:57 user nova-compute[73010]:         <nova:user uuid="19782b910361424ba7740c41f9331814">tempest-ServerActionsV293TestJSON-710111316-project-member</nova:user>
Aug 15 00:39:57 user nova-compute[73010]:         <nova:project uuid="869253a2da7e4e95bb720ab7b203284c">tempest-ServerActionsV293TestJSON-710111316</nova:project>
Aug 15 00:39:57 user nova-compute[73010]:       </nova:owner>
Aug 15 00:39:57 user nova-compute[73010]:       <nova:ports>
Aug 15 00:39:57 user nova-compute[73010]:         <nova:port uuid="f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8">
Aug 15 00:39:57 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 00:39:57 user nova-compute[73010]:         </nova:port>
Aug 15 00:39:57 user nova-compute[73010]:       </nova:ports>
Aug 15 00:39:57 user nova-compute[73010]:     </nova:instance>
Aug 15 00:39:57 user nova-compute[73010]:   </metadata>
Aug 15 00:39:57 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:39:57 user nova-compute[73010]:     <system>
Aug 15 00:39:57 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:39:57 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:39:57 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:39:57 user nova-compute[73010]:       <entry name="serial">6bf89433-15f9-44fd-a4c1-00b72287f65f</entry>
Aug 15 00:39:57 user nova-compute[73010]:       <entry name="uuid">6bf89433-15f9-44fd-a4c1-00b72287f65f</entry>
Aug 15 00:39:57 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:39:57 user nova-compute[73010]:     </system>
Aug 15 00:39:57 user nova-compute[73010]:   </sysinfo>
Aug 15 00:39:57 user nova-compute[73010]:   <os>
Aug 15 00:39:57 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:39:57 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:39:57 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:39:57 user nova-compute[73010]:   </os>
Aug 15 00:39:57 user nova-compute[73010]:   <features>
Aug 15 00:39:57 user nova-compute[73010]:     <acpi/>
Aug 15 00:39:57 user nova-compute[73010]:     <apic/>
Aug 15 00:39:57 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:39:57 user nova-compute[73010]:   </features>
Aug 15 00:39:57 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:39:57 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:39:57 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:39:57 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:39:57 user nova-compute[73010]:   </clock>
Aug 15 00:39:57 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:39:57 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:39:57 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:39:57 user nova-compute[73010]:   </cpu>
Aug 15 00:39:57 user nova-compute[73010]:   <devices>
Aug 15 00:39:57 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 00:39:57 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:39:57 user nova-compute[73010]:       <source dev="/dev/sdd"/>
Aug 15 00:39:57 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:39:57 user nova-compute[73010]:       <serial>83bdf3fa-8592-419d-90c9-a3d7a56f1a2c</serial>
Aug 15 00:39:57 user nova-compute[73010]:     </disk>
Aug 15 00:39:57 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:39:57 user nova-compute[73010]:       <mac address="fa:16:3e:e1:57:94"/>
Aug 15 00:39:57 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:39:57 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:39:57 user nova-compute[73010]:       <target dev="tapf5c6a8bc-4f"/>
Aug 15 00:39:57 user nova-compute[73010]:     </interface>
Aug 15 00:39:57 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:39:57 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/6bf89433-15f9-44fd-a4c1-00b72287f65f/console.log" append="off"/>
Aug 15 00:39:57 user nova-compute[73010]:     </serial>
Aug 15 00:39:57 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:39:57 user nova-compute[73010]:     <video>
Aug 15 00:39:57 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:39:57 user nova-compute[73010]:     </video>
Aug 15 00:39:57 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:39:57 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:39:57 user nova-compute[73010]:     </rng>
Aug 15 00:39:57 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:39:57 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:39:57 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:39:57 user nova-compute[73010]:     </memballoon>
Aug 15 00:39:57 user nova-compute[73010]:   </devices>
Aug 15 00:39:57 user nova-compute[73010]: </domain>
Aug 15 00:39:57 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:39:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-100459501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-100459501',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMvoU/VZ3MSVvKPEfl46VySM54g5gxjuVwvlv2ViBOX1qb9sxUhG896E4HXK1GlhKtb8cZiIme4xtoJu/nd/1zEHxtFmbxdZPCP6Pee/6tKM6u6rfoWMfAG7Psx72fYJg==',key_name='tempest-keypair-848269880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='869253a2da7e4e95bb720ab7b203284c',ramdisk_id='',reservation_id='r-xs10r9gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-710111316',owner_user_name='tempest-ServerActionsV293TestJSON-710111316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:39:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19782b910361424ba7740c41f9331814',uuid=6bf89433-15f9-44fd-a4c1-00b72287f65f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "address": "fa:16:3e:e1:57:94", "network": {"id": "df55f352-d3b0-4133-939b-74d35a420b49", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159866404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869253a2da7e4e95bb720ab7b203284c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c6a8bc-4f", "ovs_interfaceid": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Converting VIF {"id": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "address": "fa:16:3e:e1:57:94", "network": {"id": "df55f352-d3b0-4133-939b-74d35a420b49", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159866404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869253a2da7e4e95bb720ab7b203284c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c6a8bc-4f", "ovs_interfaceid": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:57:94,bridge_name='br-int',has_traffic_filtering=True,id=f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8,network=Network(df55f352-d3b0-4133-939b-74d35a420b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c6a8bc-4f') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG os_vif [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:57:94,bridge_name='br-int',has_traffic_filtering=True,id=f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8,network=Network(df55f352-d3b0-4133-939b-74d35a420b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c6a8bc-4f') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5c6a8bc-4f, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf5c6a8bc-4f, col_values=(('external_ids', {'iface-id': 'f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:57:94', 'vm-uuid': '6bf89433-15f9-44fd-a4c1-00b72287f65f'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:57 user nova-compute[73010]: INFO os_vif [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:57:94,bridge_name='br-int',has_traffic_filtering=True,id=f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8,network=Network(df55f352-d3b0-4133-939b-74d35a420b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c6a8bc-4f')
Aug 15 00:39:57 user nova-compute[73010]: DEBUG nova.compute.manager [req-fb446bca-06c2-4f6b-adf9-ea29f36d2ccf req-f731fa9a-95ce-45d8-8721-48826297de87 service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Received event network-changed-eac88317-fb48-4ff8-b519-8695d8b3ac57 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG nova.compute.manager [req-fb446bca-06c2-4f6b-adf9-ea29f36d2ccf req-f731fa9a-95ce-45d8-8721-48826297de87 service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Refreshing instance network info cache due to event network-changed-eac88317-fb48-4ff8-b519-8695d8b3ac57. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-fb446bca-06c2-4f6b-adf9-ea29f36d2ccf req-f731fa9a-95ce-45d8-8721-48826297de87 service nova] Acquiring lock "refresh_cache-3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-fb446bca-06c2-4f6b-adf9-ea29f36d2ccf req-f731fa9a-95ce-45d8-8721-48826297de87 service nova] Acquired lock "refresh_cache-3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG nova.network.neutron [req-fb446bca-06c2-4f6b-adf9-ea29f36d2ccf req-f731fa9a-95ce-45d8-8721-48826297de87 service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Refreshing network info cache for port eac88317-fb48-4ff8-b519-8695d8b3ac57 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] No VIF found with MAC fa:16:3e:e1:57:94, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-59bffc6f-df5d-47d3-a981-6a91ff66d316 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-59bffc6f-df5d-47d3-a981-6a91ff66d316 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-59bffc6f-df5d-47d3-a981-6a91ff66d316 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-59bffc6f-df5d-47d3-a981-6a91ff66d316 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-59bffc6f-df5d-47d3-a981-6a91ff66d316 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:39:57 user nova-compute[73010]: INFO nova.compute.manager [None req-59bffc6f-df5d-47d3-a981-6a91ff66d316 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Terminating instance
Aug 15 00:39:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-59bffc6f-df5d-47d3-a981-6a91ff66d316 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:57 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059997.9878862, afcd0a05-e035-492e-9fbe-cd63f4c3ea42 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:39:57 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] VM Resumed (Lifecycle Event)
Aug 15 00:39:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:39:57 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Instance rebooted successfully.
Aug 15 00:39:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-3711ef4f-531f-4305-871f-0398a319983a tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:39:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:39:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:39:58 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 00:39:58 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692059997.991648, afcd0a05-e035-492e-9fbe-cd63f4c3ea42 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:39:58 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] VM Started (Lifecycle Event)
Aug 15 00:39:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:39:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:39:58 user nova-compute[73010]: DEBUG nova.network.neutron [req-fb446bca-06c2-4f6b-adf9-ea29f36d2ccf req-f731fa9a-95ce-45d8-8721-48826297de87 service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Updated VIF entry in instance network info cache for port eac88317-fb48-4ff8-b519-8695d8b3ac57. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:39:58 user nova-compute[73010]: DEBUG nova.network.neutron [req-fb446bca-06c2-4f6b-adf9-ea29f36d2ccf req-f731fa9a-95ce-45d8-8721-48826297de87 service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Updating instance_info_cache with network_info: [{"id": "eac88317-fb48-4ff8-b519-8695d8b3ac57", "address": "fa:16:3e:59:f7:fc", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac88317-fb", "ovs_interfaceid": "eac88317-fb48-4ff8-b519-8695d8b3ac57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:39:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-fb446bca-06c2-4f6b-adf9-ea29f36d2ccf req-f731fa9a-95ce-45d8-8721-48826297de87 service nova] Releasing lock "refresh_cache-3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:39:58 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:39:58 user nova-compute[73010]: DEBUG nova.compute.manager [req-a3ff7702-0d06-48c4-ab1b-08fbe0d614d3 req-d47f2295-e047-40a6-ac55-ec1e6fc52c65 service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received event network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:39:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a3ff7702-0d06-48c4-ab1b-08fbe0d614d3 req-d47f2295-e047-40a6-ac55-ec1e6fc52c65 service nova] Acquiring lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:39:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a3ff7702-0d06-48c4-ab1b-08fbe0d614d3 req-d47f2295-e047-40a6-ac55-ec1e6fc52c65 service nova] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:39:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a3ff7702-0d06-48c4-ab1b-08fbe0d614d3 req-d47f2295-e047-40a6-ac55-ec1e6fc52c65 service nova] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:39:58 user nova-compute[73010]: DEBUG nova.compute.manager [req-a3ff7702-0d06-48c4-ab1b-08fbe0d614d3 req-d47f2295-e047-40a6-ac55-ec1e6fc52c65 service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] No waiting events found dispatching network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:39:58 user nova-compute[73010]: WARNING nova.compute.manager [req-a3ff7702-0d06-48c4-ab1b-08fbe0d614d3 req-d47f2295-e047-40a6-ac55-ec1e6fc52c65 service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received unexpected event network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 for instance with vm_state active and task_state None.
Aug 15 00:39:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Instance destroyed successfully.
Aug 15 00:39:58 user nova-compute[73010]: DEBUG nova.objects.instance [None req-59bffc6f-df5d-47d3-a981-6a91ff66d316 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lazy-loading 'resources' on Instance uuid 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:39:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-59bffc6f-df5d-47d3-a981-6a91ff66d316 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1526302439',display_name='tempest-TestStampPattern-server-1526302439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1526302439',id=16,image_ref='c872a2f0-e6f5-40a6-a946-7f455d3155b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrgFYRcqv6WgRdkBOunRQ1m/LgpwWxam7rDA0+KqfC3W5QB65YWRrvkhgBL/Sf+IJhFzjvTZJIwpzP4EtbE6dhqqF6WJsQneEfsmdXlIDI2l5CiQq/L0gFEvj2zfmLvMA==',key_name='tempest-TestStampPattern-362830252',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:37:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d0f162c9493416db7cfab122c4050af',ramdisk_id='',reservation_id='r-kdbmqx0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e2410ee7-7351-460a-8d9c-47fe54e08c8b',image_min_disk='1',image_min_ram='0',image_owner_id='9d0f162c9493416db7cfab122c4050af',image_owner_project_name='tempest-TestStampPattern-1617621274',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1617621274-project-member',image_user_id='456d295a0dfd4e96848eb4e0ce9e5604',owner_project_name='tempest-TestStampPattern-1617621274',owner_user_name='tempest-TestStampPattern-1617621274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:37:08Z,user_data=None,user_id='456d295a0dfd4e96848eb4e0ce9e5604',uuid=3c4015b5-3ae9-4486-878c-e7a2b01ff5c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eac88317-fb48-4ff8-b519-8695d8b3ac57", "address": "fa:16:3e:59:f7:fc", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac88317-fb", "ovs_interfaceid": "eac88317-fb48-4ff8-b519-8695d8b3ac57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:39:58 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-59bffc6f-df5d-47d3-a981-6a91ff66d316 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Converting VIF {"id": "eac88317-fb48-4ff8-b519-8695d8b3ac57", "address": "fa:16:3e:59:f7:fc", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac88317-fb", "ovs_interfaceid": "eac88317-fb48-4ff8-b519-8695d8b3ac57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:39:58 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-59bffc6f-df5d-47d3-a981-6a91ff66d316 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:f7:fc,bridge_name='br-int',has_traffic_filtering=True,id=eac88317-fb48-4ff8-b519-8695d8b3ac57,network=Network(a0e0995e-1753-4a7a-825f-76c1938b2d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac88317-fb') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:39:58 user nova-compute[73010]: DEBUG os_vif [None req-59bffc6f-df5d-47d3-a981-6a91ff66d316 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:f7:fc,bridge_name='br-int',has_traffic_filtering=True,id=eac88317-fb48-4ff8-b519-8695d8b3ac57,network=Network(a0e0995e-1753-4a7a-825f-76c1938b2d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac88317-fb') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:39:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeac88317-fb, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:39:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:39:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:58 user nova-compute[73010]: INFO os_vif [None req-59bffc6f-df5d-47d3-a981-6a91ff66d316 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:f7:fc,bridge_name='br-int',has_traffic_filtering=True,id=eac88317-fb48-4ff8-b519-8695d8b3ac57,network=Network(a0e0995e-1753-4a7a-825f-76c1938b2d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac88317-fb')
Aug 15 00:39:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-59bffc6f-df5d-47d3-a981-6a91ff66d316 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Deleting instance files /opt/stack/data/nova/instances/3c4015b5-3ae9-4486-878c-e7a2b01ff5c9_del
Aug 15 00:39:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-59bffc6f-df5d-47d3-a981-6a91ff66d316 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Deletion of /opt/stack/data/nova/instances/3c4015b5-3ae9-4486-878c-e7a2b01ff5c9_del complete
Aug 15 00:39:59 user nova-compute[73010]: INFO nova.compute.manager [None req-59bffc6f-df5d-47d3-a981-6a91ff66d316 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Took 1.35 seconds to destroy the instance on the hypervisor.
Aug 15 00:39:59 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-59bffc6f-df5d-47d3-a981-6a91ff66d316 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:39:59 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:39:59 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:39:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:39:59 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:39:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-dc4e1283-47ab-470b-89b6-47eda42e692b req-b28da29c-97c5-4a21-893f-e8e263538124 service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Received event network-vif-unplugged-eac88317-fb48-4ff8-b519-8695d8b3ac57 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:39:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dc4e1283-47ab-470b-89b6-47eda42e692b req-b28da29c-97c5-4a21-893f-e8e263538124 service nova] Acquiring lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:39:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dc4e1283-47ab-470b-89b6-47eda42e692b req-b28da29c-97c5-4a21-893f-e8e263538124 service nova] Lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:39:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dc4e1283-47ab-470b-89b6-47eda42e692b req-b28da29c-97c5-4a21-893f-e8e263538124 service nova] Lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:39:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-dc4e1283-47ab-470b-89b6-47eda42e692b req-b28da29c-97c5-4a21-893f-e8e263538124 service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] No waiting events found dispatching network-vif-unplugged-eac88317-fb48-4ff8-b519-8695d8b3ac57 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:39:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-dc4e1283-47ab-470b-89b6-47eda42e692b req-b28da29c-97c5-4a21-893f-e8e263538124 service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Received event network-vif-unplugged-eac88317-fb48-4ff8-b519-8695d8b3ac57 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:39:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-dc4e1283-47ab-470b-89b6-47eda42e692b req-b28da29c-97c5-4a21-893f-e8e263538124 service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Received event network-vif-plugged-eac88317-fb48-4ff8-b519-8695d8b3ac57 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:39:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dc4e1283-47ab-470b-89b6-47eda42e692b req-b28da29c-97c5-4a21-893f-e8e263538124 service nova] Acquiring lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:39:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dc4e1283-47ab-470b-89b6-47eda42e692b req-b28da29c-97c5-4a21-893f-e8e263538124 service nova] Lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:39:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dc4e1283-47ab-470b-89b6-47eda42e692b req-b28da29c-97c5-4a21-893f-e8e263538124 service nova] Lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:39:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-dc4e1283-47ab-470b-89b6-47eda42e692b req-b28da29c-97c5-4a21-893f-e8e263538124 service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] No waiting events found dispatching network-vif-plugged-eac88317-fb48-4ff8-b519-8695d8b3ac57 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:39:59 user nova-compute[73010]: WARNING nova.compute.manager [req-dc4e1283-47ab-470b-89b6-47eda42e692b req-b28da29c-97c5-4a21-893f-e8e263538124 service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Received unexpected event network-vif-plugged-eac88317-fb48-4ff8-b519-8695d8b3ac57 for instance with vm_state active and task_state deleting.
Aug 15 00:39:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-dc4e1283-47ab-470b-89b6-47eda42e692b req-b28da29c-97c5-4a21-893f-e8e263538124 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Received event network-vif-plugged-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:39:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dc4e1283-47ab-470b-89b6-47eda42e692b req-b28da29c-97c5-4a21-893f-e8e263538124 service nova] Acquiring lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:39:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dc4e1283-47ab-470b-89b6-47eda42e692b req-b28da29c-97c5-4a21-893f-e8e263538124 service nova] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:39:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dc4e1283-47ab-470b-89b6-47eda42e692b req-b28da29c-97c5-4a21-893f-e8e263538124 service nova] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:39:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-dc4e1283-47ab-470b-89b6-47eda42e692b req-b28da29c-97c5-4a21-893f-e8e263538124 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] No waiting events found dispatching network-vif-plugged-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:39:59 user nova-compute[73010]: WARNING nova.compute.manager [req-dc4e1283-47ab-470b-89b6-47eda42e692b req-b28da29c-97c5-4a21-893f-e8e263538124 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Received unexpected event network-vif-plugged-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 for instance with vm_state building and task_state spawning.
Aug 15 00:40:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:01 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:40:01 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Took 2.14 seconds to deallocate network for instance.
Aug 15 00:40:01 user nova-compute[73010]: DEBUG nova.compute.manager [req-3e12e630-3abb-477e-8bf2-3efc964c5141 req-b47fb695-a506-4155-9804-88dd3c6c7ed2 service nova] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Received event network-vif-deleted-eac88317-fb48-4ff8-b519-8695d8b3ac57 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-59bffc6f-df5d-47d3-a981-6a91ff66d316 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-59bffc6f-df5d-47d3-a981-6a91ff66d316 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:01 user nova-compute[73010]: DEBUG nova.compute.manager [req-ecfa6d1e-b00d-4cc3-af24-9a4c20657f35 req-23644e96-10ec-4edf-8822-fa9d512ae798 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Received event network-vif-plugged-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ecfa6d1e-b00d-4cc3-af24-9a4c20657f35 req-23644e96-10ec-4edf-8822-fa9d512ae798 service nova] Acquiring lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ecfa6d1e-b00d-4cc3-af24-9a4c20657f35 req-23644e96-10ec-4edf-8822-fa9d512ae798 service nova] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ecfa6d1e-b00d-4cc3-af24-9a4c20657f35 req-23644e96-10ec-4edf-8822-fa9d512ae798 service nova] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:01 user nova-compute[73010]: DEBUG nova.compute.manager [req-ecfa6d1e-b00d-4cc3-af24-9a4c20657f35 req-23644e96-10ec-4edf-8822-fa9d512ae798 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] No waiting events found dispatching network-vif-plugged-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:40:01 user nova-compute[73010]: WARNING nova.compute.manager [req-ecfa6d1e-b00d-4cc3-af24-9a4c20657f35 req-23644e96-10ec-4edf-8822-fa9d512ae798 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Received unexpected event network-vif-plugged-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 for instance with vm_state building and task_state spawning.
Aug 15 00:40:01 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-59bffc6f-df5d-47d3-a981-6a91ff66d316 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:40:01 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060001.754604, 6bf89433-15f9-44fd-a4c1-00b72287f65f => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:40:01 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] VM Resumed (Lifecycle Event)
Aug 15 00:40:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:40:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:40:01 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-59bffc6f-df5d-47d3-a981-6a91ff66d316 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:40:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:40:01 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Instance spawned successfully.
Aug 15 00:40:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:40:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:40:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-59bffc6f-df5d-47d3-a981-6a91ff66d316 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.502s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:01 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:40:01 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060001.757126, 6bf89433-15f9-44fd-a4c1-00b72287f65f => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:40:01 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] VM Started (Lifecycle Event)
Aug 15 00:40:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:40:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:40:01 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-59bffc6f-df5d-47d3-a981-6a91ff66d316 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Deleted allocations for instance 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9
Aug 15 00:40:01 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:40:02 user nova-compute[73010]: INFO nova.compute.manager [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Took 6.13 seconds to spawn the instance on the hypervisor.
Aug 15 00:40:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:40:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-59bffc6f-df5d-47d3-a981-6a91ff66d316 tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "3c4015b5-3ae9-4486-878c-e7a2b01ff5c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.340s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:02 user nova-compute[73010]: INFO nova.compute.manager [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Took 17.60 seconds to build instance.
Aug 15 00:40:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fe3ac2d8-3d71-4394-9f2c-145b8697dd31 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.709s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1af25016-a804-4b47-907f-d5dd63e831bd tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "362829aa-9659-4ced-9537-d11de1b6b2d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1af25016-a804-4b47-907f-d5dd63e831bd tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "362829aa-9659-4ced-9537-d11de1b6b2d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1af25016-a804-4b47-907f-d5dd63e831bd tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "362829aa-9659-4ced-9537-d11de1b6b2d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1af25016-a804-4b47-907f-d5dd63e831bd tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "362829aa-9659-4ced-9537-d11de1b6b2d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1af25016-a804-4b47-907f-d5dd63e831bd tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "362829aa-9659-4ced-9537-d11de1b6b2d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:02 user nova-compute[73010]: INFO nova.compute.manager [None req-1af25016-a804-4b47-907f-d5dd63e831bd tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Terminating instance
Aug 15 00:40:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-1af25016-a804-4b47-907f-d5dd63e831bd tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:40:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:40:03 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Creating image(s)
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Did not create local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Ensure instance console log exists: /opt/stack/data/nova/instances/009d9050-1720-45de-8bc9-16f404e65911/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Start _get_guest_xml network_info=[{"id": "96dadd50-12c8-430b-82ab-f113031f02d8", "address": "fa:16:3e:d4:06:17", "network": {"id": "935a0b3b-6f36-45b2-a8d0-4d4541cce103", "bridge": "br-int", "label": "tempest-TestShelveInstance-1947454102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c735a6d80a64492baf3346d0c96a872b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dadd50-12", "ovs_interfaceid": "96dadd50-12c8-430b-82ab-f113031f02d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfoiFbEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '009d9050-1720-45de-8bc9-16f404e65911', 'attached_at': '', 'detached_at': '', 'volume_id': '72f87474-057f-402d-883f-be3d848431a6', 'serial': '72f87474-057f-402d-883f-be3d848431a6'}, 'disk_bus': 'virtio', 'attachment_id': '83ebf4ae-be76-410d-aec9-f516c28256ca', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:40:03 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:40:03 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfoiFbEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:40:03 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:40:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:40:03 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:40:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:40:03 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7253e4ca-123e-49c4-b13a-b5f2a578212e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:40:03 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[66881636-76ee-4b98-9530-65d4d9d5220f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6] added
Aug 15 00:40:03 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[024eb424-ab7c-4a53-97b9-080470793f70]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ad7fe1-2c98-479b-aa8a-835faddb5ee8]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MfoiFbEz {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.compute.manager [req-81de2e64-6a78-4496-a444-2d4215ed50e2 req-969e1d3a-1663-45d5-9f31-bfea03647681 service nova] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Received event network-changed-d2a83a47-48c9-4483-ab88-c719b6b9c268 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.compute.manager [req-81de2e64-6a78-4496-a444-2d4215ed50e2 req-969e1d3a-1663-45d5-9f31-bfea03647681 service nova] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Refreshing instance network info cache due to event network-changed-d2a83a47-48c9-4483-ab88-c719b6b9c268. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-81de2e64-6a78-4496-a444-2d4215ed50e2 req-969e1d3a-1663-45d5-9f31-bfea03647681 service nova] Acquiring lock "refresh_cache-362829aa-9659-4ced-9537-d11de1b6b2d7" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-81de2e64-6a78-4496-a444-2d4215ed50e2 req-969e1d3a-1663-45d5-9f31-bfea03647681 service nova] Acquired lock "refresh_cache-362829aa-9659-4ced-9537-d11de1b6b2d7" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.network.neutron [req-81de2e64-6a78-4496-a444-2d4215ed50e2 req-969e1d3a-1663-45d5-9f31-bfea03647681 service nova] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Refreshing network info cache for port d2a83a47-48c9-4483-ab88-c719b6b9c268 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MfoiFbEz" returned: 0 in 0.044s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5a1ef6-767f-4f24-aeec-acac8867ae66]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MfoiFbEz'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2269a3f1-d6b4-4102-b764-aa12b15c51c2]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99acc07-6ba3-4330-8c2b-b77c7a3bb7b6]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)
Aug 15 00:40:03 user nova-compute[73010]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:40:03 user nova-compute[73010]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:40:03 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)
Aug 15 00:40:03 user nova-compute[73010]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:40:03 user nova-compute[73010]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:40:03 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:03 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Instance destroyed successfully.
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.objects.instance [None req-1af25016-a804-4b47-907f-d5dd63e831bd tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lazy-loading 'resources' on Instance uuid 362829aa-9659-4ced-9537-d11de1b6b2d7 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-1af25016-a804-4b47-907f-d5dd63e831bd tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:38:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2097443447',display_name='tempest-AttachVolumeNegativeTest-server-2097443447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2097443447',id=20,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5DwxlnWA/NEr4+h4zKmrWxM3ExxIiG5grV/4wrpQXES/w9sY/rz0T3P5jdSvQ6Ku2CSJpqwYLPF9NlK8o7lskm5vMz058rCOZKQGWQEa5gyKuWRJZrJuhRpXaY7DoCOg==',key_name='tempest-keypair-167307316',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:38:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e962745e3a554f2b8f42d97434173a7a',ramdisk_id='',reservation_id='r-a0gs42wj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-865469153',owner_user_name='tempest-AttachVolumeNegativeTest-865469153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:38:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928ab235d55d4bfc86de82f2387c9d06',uuid=362829aa-9659-4ced-9537-d11de1b6b2d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2a83a47-48c9-4483-ab88-c719b6b9c268", "address": "fa:16:3e:fd:35:cf", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a83a47-48", "ovs_interfaceid": "d2a83a47-48c9-4483-ab88-c719b6b9c268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-1af25016-a804-4b47-907f-d5dd63e831bd tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Converting VIF {"id": "d2a83a47-48c9-4483-ab88-c719b6b9c268", "address": "fa:16:3e:fd:35:cf", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a83a47-48", "ovs_interfaceid": "d2a83a47-48c9-4483-ab88-c719b6b9c268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-1af25016-a804-4b47-907f-d5dd63e831bd tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:35:cf,bridge_name='br-int',has_traffic_filtering=True,id=d2a83a47-48c9-4483-ab88-c719b6b9c268,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a83a47-48') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG os_vif [None req-1af25016-a804-4b47-907f-d5dd63e831bd tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:35:cf,bridge_name='br-int',has_traffic_filtering=True,id=d2a83a47-48c9-4483-ab88-c719b6b9c268,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a83a47-48') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2a83a47-48, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:40:03 user nova-compute[73010]: INFO os_vif [None req-1af25016-a804-4b47-907f-d5dd63e831bd tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:35:cf,bridge_name='br-int',has_traffic_filtering=True,id=d2a83a47-48c9-4483-ab88-c719b6b9c268,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a83a47-48')
Aug 15 00:40:03 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-1af25016-a804-4b47-907f-d5dd63e831bd tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Deleting instance files /opt/stack/data/nova/instances/362829aa-9659-4ced-9537-d11de1b6b2d7_del
Aug 15 00:40:03 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-1af25016-a804-4b47-907f-d5dd63e831bd tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Deletion of /opt/stack/data/nova/instances/362829aa-9659-4ced-9537-d11de1b6b2d7_del complete
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04eaf9c-7dad-400f-a9e2-738e6d3a43cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6, portal: 172.16.0.220,3260]
Aug 15 00:40:03 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6, portal: 172.16.0.220,3260] successful.
Aug 15 00:40:03 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fba3942-a5af-457f-b26a-3d38a208663d]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:03 user nova-compute[73010]: INFO nova.compute.manager [None req-1af25016-a804-4b47-907f-d5dd63e831bd tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-1af25016-a804-4b47-907f-d5dd63e831bd tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffece7f-653b-4abd-b5ad-d6c86f513d1b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)
Aug 15 00:40:03 user nova-compute[73010]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:40:03 user nova-compute[73010]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:40:03 user nova-compute[73010]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:40:03 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)
Aug 15 00:40:03 user nova-compute[73010]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:40:03 user nova-compute[73010]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:40:03 user nova-compute[73010]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:40:03 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6f2c9f-a3db-4d43-94e1-7ab7f51fda85]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: None {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:40:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG nova.network.neutron [req-81de2e64-6a78-4496-a444-2d4215ed50e2 req-969e1d3a-1663-45d5-9f31-bfea03647681 service nova] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Updated VIF entry in instance network info cache for port d2a83a47-48c9-4483-ab88-c719b6b9c268. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG nova.network.neutron [req-81de2e64-6a78-4496-a444-2d4215ed50e2 req-969e1d3a-1663-45d5-9f31-bfea03647681 service nova] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Updating instance_info_cache with network_info: [{"id": "d2a83a47-48c9-4483-ab88-c719b6b9c268", "address": "fa:16:3e:fd:35:cf", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a83a47-48", "ovs_interfaceid": "d2a83a47-48c9-4483-ab88-c719b6b9c268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-81de2e64-6a78-4496-a444-2d4215ed50e2 req-969e1d3a-1663-45d5-9f31-bfea03647681 service nova] Releasing lock "refresh_cache-362829aa-9659-4ced-9537-d11de1b6b2d7" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG nova.compute.manager [req-81de2e64-6a78-4496-a444-2d4215ed50e2 req-969e1d3a-1663-45d5-9f31-bfea03647681 service nova] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Received event network-vif-unplugged-d2a83a47-48c9-4483-ab88-c719b6b9c268 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-81de2e64-6a78-4496-a444-2d4215ed50e2 req-969e1d3a-1663-45d5-9f31-bfea03647681 service nova] Acquiring lock "362829aa-9659-4ced-9537-d11de1b6b2d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-81de2e64-6a78-4496-a444-2d4215ed50e2 req-969e1d3a-1663-45d5-9f31-bfea03647681 service nova] Lock "362829aa-9659-4ced-9537-d11de1b6b2d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-81de2e64-6a78-4496-a444-2d4215ed50e2 req-969e1d3a-1663-45d5-9f31-bfea03647681 service nova] Lock "362829aa-9659-4ced-9537-d11de1b6b2d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG nova.compute.manager [req-81de2e64-6a78-4496-a444-2d4215ed50e2 req-969e1d3a-1663-45d5-9f31-bfea03647681 service nova] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] No waiting events found dispatching network-vif-unplugged-d2a83a47-48c9-4483-ab88-c719b6b9c268 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG nova.compute.manager [req-81de2e64-6a78-4496-a444-2d4215ed50e2 req-969e1d3a-1663-45d5-9f31-bfea03647681 service nova] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Received event network-vif-unplugged-d2a83a47-48c9-4483-ab88-c719b6b9c268 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG nova.compute.manager [req-81de2e64-6a78-4496-a444-2d4215ed50e2 req-969e1d3a-1663-45d5-9f31-bfea03647681 service nova] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Received event network-vif-plugged-d2a83a47-48c9-4483-ab88-c719b6b9c268 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-81de2e64-6a78-4496-a444-2d4215ed50e2 req-969e1d3a-1663-45d5-9f31-bfea03647681 service nova] Acquiring lock "362829aa-9659-4ced-9537-d11de1b6b2d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-81de2e64-6a78-4496-a444-2d4215ed50e2 req-969e1d3a-1663-45d5-9f31-bfea03647681 service nova] Lock "362829aa-9659-4ced-9537-d11de1b6b2d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-81de2e64-6a78-4496-a444-2d4215ed50e2 req-969e1d3a-1663-45d5-9f31-bfea03647681 service nova] Lock "362829aa-9659-4ced-9537-d11de1b6b2d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG nova.compute.manager [req-81de2e64-6a78-4496-a444-2d4215ed50e2 req-969e1d3a-1663-45d5-9f31-bfea03647681 service nova] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] No waiting events found dispatching network-vif-plugged-d2a83a47-48c9-4483-ab88-c719b6b9c268 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:40:04 user nova-compute[73010]: WARNING nova.compute.manager [req-81de2e64-6a78-4496-a444-2d4215ed50e2 req-969e1d3a-1663-45d5-9f31-bfea03647681 service nova] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Received unexpected event network-vif-plugged-d2a83a47-48c9-4483-ab88-c719b6b9c268 for instance with vm_state active and task_state deleting.
Aug 15 00:40:04 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfoiFbEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '26534646136353233', 'path': '/dev/sde'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534646136353233', 'path': '/dev/sde'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1795734941',display_name='tempest-TestShelveInstance-server-1795734941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1795734941',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcvum5u9XWkffPgr3kUCPUYgZKMK4EupdMldEf//XaPrSY8IDVMu6jeGwbDvE83LEBISDSMbAk9hvyN1POk9rP39devk3OdD2ie6iQLoFJW3VpXHZj4RZst+OeJaRlMbw==',key_name='tempest-TestShelveInstance-1964489724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c735a6d80a64492baf3346d0c96a872b',ramdisk_id='',reservation_id='r-ganojssg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1217563266',owner_user_name='tempest-TestShelveInstance-1217563266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:39:53Z,user_data=None,user_id='9c8c404d2a364ce6be183c14da241836',uuid=009d9050-1720-45de-8bc9-16f404e65911,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96dadd50-12c8-430b-82ab-f113031f02d8", "address": "fa:16:3e:d4:06:17", "network": {"id": "935a0b3b-6f36-45b2-a8d0-4d4541cce103", "bridge": "br-int", "label": "tempest-TestShelveInstance-1947454102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c735a6d80a64492baf3346d0c96a872b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dadd50-12", "ovs_interfaceid": "96dadd50-12c8-430b-82ab-f113031f02d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Converting VIF {"id": "96dadd50-12c8-430b-82ab-f113031f02d8", "address": "fa:16:3e:d4:06:17", "network": {"id": "935a0b3b-6f36-45b2-a8d0-4d4541cce103", "bridge": "br-int", "label": "tempest-TestShelveInstance-1947454102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c735a6d80a64492baf3346d0c96a872b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dadd50-12", "ovs_interfaceid": "96dadd50-12c8-430b-82ab-f113031f02d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:06:17,bridge_name='br-int',has_traffic_filtering=True,id=96dadd50-12c8-430b-82ab-f113031f02d8,network=Network(935a0b3b-6f36-45b2-a8d0-4d4541cce103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96dadd50-12') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG nova.objects.instance [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lazy-loading 'pci_devices' on Instance uuid 009d9050-1720-45de-8bc9-16f404e65911 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:40:04 user nova-compute[73010]:   <uuid>009d9050-1720-45de-8bc9-16f404e65911</uuid>
Aug 15 00:40:04 user nova-compute[73010]:   <name>instance-00000016</name>
Aug 15 00:40:04 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:40:04 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:40:04 user nova-compute[73010]:   <metadata>
Aug 15 00:40:04 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:40:04 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:40:04 user nova-compute[73010]:       <nova:name>tempest-TestShelveInstance-server-1795734941</nova:name>
Aug 15 00:40:04 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:40:03</nova:creationTime>
Aug 15 00:40:04 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:40:04 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:40:04 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:40:04 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:40:04 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:40:04 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:40:04 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:40:04 user nova-compute[73010]:       <nova:owner>
Aug 15 00:40:04 user nova-compute[73010]:         <nova:user uuid="9c8c404d2a364ce6be183c14da241836">tempest-TestShelveInstance-1217563266-project-member</nova:user>
Aug 15 00:40:04 user nova-compute[73010]:         <nova:project uuid="c735a6d80a64492baf3346d0c96a872b">tempest-TestShelveInstance-1217563266</nova:project>
Aug 15 00:40:04 user nova-compute[73010]:       </nova:owner>
Aug 15 00:40:04 user nova-compute[73010]:       <nova:ports>
Aug 15 00:40:04 user nova-compute[73010]:         <nova:port uuid="96dadd50-12c8-430b-82ab-f113031f02d8">
Aug 15 00:40:04 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 00:40:04 user nova-compute[73010]:         </nova:port>
Aug 15 00:40:04 user nova-compute[73010]:       </nova:ports>
Aug 15 00:40:04 user nova-compute[73010]:     </nova:instance>
Aug 15 00:40:04 user nova-compute[73010]:   </metadata>
Aug 15 00:40:04 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:40:04 user nova-compute[73010]:     <system>
Aug 15 00:40:04 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:40:04 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:40:04 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:40:04 user nova-compute[73010]:       <entry name="serial">009d9050-1720-45de-8bc9-16f404e65911</entry>
Aug 15 00:40:04 user nova-compute[73010]:       <entry name="uuid">009d9050-1720-45de-8bc9-16f404e65911</entry>
Aug 15 00:40:04 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:40:04 user nova-compute[73010]:     </system>
Aug 15 00:40:04 user nova-compute[73010]:   </sysinfo>
Aug 15 00:40:04 user nova-compute[73010]:   <os>
Aug 15 00:40:04 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:40:04 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:40:04 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:40:04 user nova-compute[73010]:   </os>
Aug 15 00:40:04 user nova-compute[73010]:   <features>
Aug 15 00:40:04 user nova-compute[73010]:     <acpi/>
Aug 15 00:40:04 user nova-compute[73010]:     <apic/>
Aug 15 00:40:04 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:40:04 user nova-compute[73010]:   </features>
Aug 15 00:40:04 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:40:04 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:40:04 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:40:04 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:40:04 user nova-compute[73010]:   </clock>
Aug 15 00:40:04 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:40:04 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:40:04 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:40:04 user nova-compute[73010]:   </cpu>
Aug 15 00:40:04 user nova-compute[73010]:   <devices>
Aug 15 00:40:04 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 00:40:04 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:40:04 user nova-compute[73010]:       <source dev="/dev/sde"/>
Aug 15 00:40:04 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:40:04 user nova-compute[73010]:       <serial>72f87474-057f-402d-883f-be3d848431a6</serial>
Aug 15 00:40:04 user nova-compute[73010]:     </disk>
Aug 15 00:40:04 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:40:04 user nova-compute[73010]:       <mac address="fa:16:3e:d4:06:17"/>
Aug 15 00:40:04 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:40:04 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:40:04 user nova-compute[73010]:       <target dev="tap96dadd50-12"/>
Aug 15 00:40:04 user nova-compute[73010]:     </interface>
Aug 15 00:40:04 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:40:04 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/009d9050-1720-45de-8bc9-16f404e65911/console.log" append="off"/>
Aug 15 00:40:04 user nova-compute[73010]:     </serial>
Aug 15 00:40:04 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:40:04 user nova-compute[73010]:     <video>
Aug 15 00:40:04 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:40:04 user nova-compute[73010]:     </video>
Aug 15 00:40:04 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:40:04 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:40:04 user nova-compute[73010]:     </rng>
Aug 15 00:40:04 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:40:04 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:40:04 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:40:04 user nova-compute[73010]:     </memballoon>
Aug 15 00:40:04 user nova-compute[73010]:   </devices>
Aug 15 00:40:04 user nova-compute[73010]: </domain>
Aug 15 00:40:04 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1795734941',display_name='tempest-TestShelveInstance-server-1795734941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1795734941',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcvum5u9XWkffPgr3kUCPUYgZKMK4EupdMldEf//XaPrSY8IDVMu6jeGwbDvE83LEBISDSMbAk9hvyN1POk9rP39devk3OdD2ie6iQLoFJW3VpXHZj4RZst+OeJaRlMbw==',key_name='tempest-TestShelveInstance-1964489724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c735a6d80a64492baf3346d0c96a872b',ramdisk_id='',reservation_id='r-ganojssg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1217563266',owner_user_name='tempest-TestShelveInstance-1217563266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:39:53Z,user_data=None,user_id='9c8c404d2a364ce6be183c14da241836',uuid=009d9050-1720-45de-8bc9-16f404e65911,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96dadd50-12c8-430b-82ab-f113031f02d8", "address": "fa:16:3e:d4:06:17", "network": {"id": "935a0b3b-6f36-45b2-a8d0-4d4541cce103", "bridge": "br-int", "label": "tempest-TestShelveInstance-1947454102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c735a6d80a64492baf3346d0c96a872b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dadd50-12", "ovs_interfaceid": "96dadd50-12c8-430b-82ab-f113031f02d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Converting VIF {"id": "96dadd50-12c8-430b-82ab-f113031f02d8", "address": "fa:16:3e:d4:06:17", "network": {"id": "935a0b3b-6f36-45b2-a8d0-4d4541cce103", "bridge": "br-int", "label": "tempest-TestShelveInstance-1947454102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c735a6d80a64492baf3346d0c96a872b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dadd50-12", "ovs_interfaceid": "96dadd50-12c8-430b-82ab-f113031f02d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:06:17,bridge_name='br-int',has_traffic_filtering=True,id=96dadd50-12c8-430b-82ab-f113031f02d8,network=Network(935a0b3b-6f36-45b2-a8d0-4d4541cce103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96dadd50-12') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG os_vif [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:06:17,bridge_name='br-int',has_traffic_filtering=True,id=96dadd50-12c8-430b-82ab-f113031f02d8,network=Network(935a0b3b-6f36-45b2-a8d0-4d4541cce103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96dadd50-12') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96dadd50-12, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96dadd50-12, col_values=(('external_ids', {'iface-id': '96dadd50-12c8-430b-82ab-f113031f02d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:06:17', 'vm-uuid': '009d9050-1720-45de-8bc9-16f404e65911'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:04 user nova-compute[73010]: INFO os_vif [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:06:17,bridge_name='br-int',has_traffic_filtering=True,id=96dadd50-12c8-430b-82ab-f113031f02d8,network=Network(935a0b3b-6f36-45b2-a8d0-4d4541cce103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96dadd50-12')
Aug 15 00:40:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] No VIF found with MAC fa:16:3e:d4:06:17, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:40:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:06 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:40:06 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Took 2.60 seconds to deallocate network for instance.
Aug 15 00:40:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-8b7ac327-6a3f-4cd7-886a-8be6b27ee146 req-12dc6bfe-a888-4f86-a179-95aab9e212dd service nova] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Received event network-vif-deleted-d2a83a47-48c9-4483-ab88-c719b6b9c268 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1af25016-a804-4b47-907f-d5dd63e831bd tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1af25016-a804-4b47-907f-d5dd63e831bd tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-538162fc-3f59-40f6-8e81-e4c40fea651e req-f9938295-5076-45b0-99fa-433190c120d2 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Received event network-vif-plugged-96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-538162fc-3f59-40f6-8e81-e4c40fea651e req-f9938295-5076-45b0-99fa-433190c120d2 service nova] Acquiring lock "009d9050-1720-45de-8bc9-16f404e65911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-538162fc-3f59-40f6-8e81-e4c40fea651e req-f9938295-5076-45b0-99fa-433190c120d2 service nova] Lock "009d9050-1720-45de-8bc9-16f404e65911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-538162fc-3f59-40f6-8e81-e4c40fea651e req-f9938295-5076-45b0-99fa-433190c120d2 service nova] Lock "009d9050-1720-45de-8bc9-16f404e65911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-538162fc-3f59-40f6-8e81-e4c40fea651e req-f9938295-5076-45b0-99fa-433190c120d2 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] No waiting events found dispatching network-vif-plugged-96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:40:06 user nova-compute[73010]: WARNING nova.compute.manager [req-538162fc-3f59-40f6-8e81-e4c40fea651e req-f9938295-5076-45b0-99fa-433190c120d2 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Received unexpected event network-vif-plugged-96dadd50-12c8-430b-82ab-f113031f02d8 for instance with vm_state building and task_state spawning.
Aug 15 00:40:06 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-1af25016-a804-4b47-907f-d5dd63e831bd tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:40:06 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-1af25016-a804-4b47-907f-d5dd63e831bd tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:40:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1af25016-a804-4b47-907f-d5dd63e831bd tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.668s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:07 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-1af25016-a804-4b47-907f-d5dd63e831bd tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Deleted allocations for instance 362829aa-9659-4ced-9537-d11de1b6b2d7
Aug 15 00:40:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1af25016-a804-4b47-907f-d5dd63e831bd tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "362829aa-9659-4ced-9537-d11de1b6b2d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.703s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:08 user nova-compute[73010]: DEBUG nova.compute.manager [req-ede2de07-a5ce-4267-8ccd-3c748befc9b1 req-491979c9-b643-4d1b-bd26-fd4c6c305dd6 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Received event network-vif-plugged-96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ede2de07-a5ce-4267-8ccd-3c748befc9b1 req-491979c9-b643-4d1b-bd26-fd4c6c305dd6 service nova] Acquiring lock "009d9050-1720-45de-8bc9-16f404e65911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ede2de07-a5ce-4267-8ccd-3c748befc9b1 req-491979c9-b643-4d1b-bd26-fd4c6c305dd6 service nova] Lock "009d9050-1720-45de-8bc9-16f404e65911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ede2de07-a5ce-4267-8ccd-3c748befc9b1 req-491979c9-b643-4d1b-bd26-fd4c6c305dd6 service nova] Lock "009d9050-1720-45de-8bc9-16f404e65911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:08 user nova-compute[73010]: DEBUG nova.compute.manager [req-ede2de07-a5ce-4267-8ccd-3c748befc9b1 req-491979c9-b643-4d1b-bd26-fd4c6c305dd6 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] No waiting events found dispatching network-vif-plugged-96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:40:08 user nova-compute[73010]: WARNING nova.compute.manager [req-ede2de07-a5ce-4267-8ccd-3c748befc9b1 req-491979c9-b643-4d1b-bd26-fd4c6c305dd6 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Received unexpected event network-vif-plugged-96dadd50-12c8-430b-82ab-f113031f02d8 for instance with vm_state building and task_state spawning.
Aug 15 00:40:08 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060008.9127672, 009d9050-1720-45de-8bc9-16f404e65911 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:40:08 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 009d9050-1720-45de-8bc9-16f404e65911] VM Resumed (Lifecycle Event)
Aug 15 00:40:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:40:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:40:08 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Instance spawned successfully.
Aug 15 00:40:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:40:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:40:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:40:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:08 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 009d9050-1720-45de-8bc9-16f404e65911] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:40:08 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060008.9136412, 009d9050-1720-45de-8bc9-16f404e65911 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:40:08 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 009d9050-1720-45de-8bc9-16f404e65911] VM Started (Lifecycle Event)
Aug 15 00:40:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:40:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:40:09 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 009d9050-1720-45de-8bc9-16f404e65911] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:40:09 user nova-compute[73010]: INFO nova.compute.manager [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Took 5.94 seconds to spawn the instance on the hypervisor.
Aug 15 00:40:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:40:09 user nova-compute[73010]: INFO nova.compute.manager [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Took 17.71 seconds to build instance.
Aug 15 00:40:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5311a751-bbec-4291-a842-9a6b2a35bd30 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "009d9050-1720-45de-8bc9-16f404e65911" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.186s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "eec545e8-eeda-443c-9892-980e19e7267a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "eec545e8-eeda-443c-9892-980e19e7267a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:40:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:09 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:40:09 user nova-compute[73010]: INFO nova.compute.claims [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Claim successful on node user
Aug 15 00:40:10 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:40:10 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:40:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:40:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:40:10 user nova-compute[73010]: DEBUG nova.network.neutron [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:40:10 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:40:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:40:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:40:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:40:10 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Creating image(s)
Aug 15 00:40:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "/opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "/opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "/opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:10 user nova-compute[73010]: DEBUG nova.policy [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b85ef05658d64f1fbd78e509e2a606d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a564ea15194c4e059746d2fc6e7e1a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:40:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.191s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.219s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk 1073741824" returned: 0 in 0.062s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "4b489f97-c8d4-4a6a-8404-e1a05a990261" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "4b489f97-c8d4-4a6a-8404-e1a05a990261" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG nova.compute.manager [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.204s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:40:11 user nova-compute[73010]: INFO nova.compute.claims [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Claim successful on node user
Aug 15 00:40:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Cannot resize image /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG nova.objects.instance [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'migration_context' on Instance uuid eec545e8-eeda-443c-9892-980e19e7267a {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Ensure instance console log exists: /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG nova.network.neutron [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Successfully created port: 65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:11 user nova-compute[73010]: DEBUG nova.compute.manager [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG nova.compute.manager [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG nova.network.neutron [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:40:12 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:40:12 user nova-compute[73010]: DEBUG nova.compute.manager [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG nova.compute.manager [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:40:12 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Creating image(s)
Aug 15 00:40:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "/opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "/opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.208s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG nova.policy [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b85ef05658d64f1fbd78e509e2a606d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a564ea15194c4e059746d2fc6e7e1a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG nova.network.neutron [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Successfully updated port: 65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "refresh_cache-eec545e8-eeda-443c-9892-980e19e7267a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquired lock "refresh_cache-eec545e8-eeda-443c-9892-980e19e7267a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG nova.network.neutron [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-ba08b4ef-b603-41f9-bd2e-6693f6fa45e6 req-85328920-dbfe-4c46-8c76-221396c630b0 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received event network-changed-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-ba08b4ef-b603-41f9-bd2e-6693f6fa45e6 req-85328920-dbfe-4c46-8c76-221396c630b0 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Refreshing instance network info cache due to event network-changed-65b5e7b6-01af-4239-9386-e7b14c83e766. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ba08b4ef-b603-41f9-bd2e-6693f6fa45e6 req-85328920-dbfe-4c46-8c76-221396c630b0 service nova] Acquiring lock "refresh_cache-eec545e8-eeda-443c-9892-980e19e7267a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG nova.network.neutron [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.222s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk 1073741824" returned: 0 in 0.075s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.193s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.network.neutron [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Updating instance_info_cache with network_info: [{"id": "65b5e7b6-01af-4239-9386-e7b14c83e766", "address": "fa:16:3e:88:de:ee", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b5e7b6-01", "ovs_interfaceid": "65b5e7b6-01af-4239-9386-e7b14c83e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Releasing lock "refresh_cache-eec545e8-eeda-443c-9892-980e19e7267a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.compute.manager [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Instance network_info: |[{"id": "65b5e7b6-01af-4239-9386-e7b14c83e766", "address": "fa:16:3e:88:de:ee", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b5e7b6-01", "ovs_interfaceid": "65b5e7b6-01af-4239-9386-e7b14c83e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ba08b4ef-b603-41f9-bd2e-6693f6fa45e6 req-85328920-dbfe-4c46-8c76-221396c630b0 service nova] Acquired lock "refresh_cache-eec545e8-eeda-443c-9892-980e19e7267a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.network.neutron [req-ba08b4ef-b603-41f9-bd2e-6693f6fa45e6 req-85328920-dbfe-4c46-8c76-221396c630b0 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Refreshing network info cache for port 65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Start _get_guest_xml network_info=[{"id": "65b5e7b6-01af-4239-9386-e7b14c83e766", "address": "fa:16:3e:88:de:ee", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b5e7b6-01", "ovs_interfaceid": "65b5e7b6-01af-4239-9386-e7b14c83e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:40:13 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:40:13 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Cannot resize image /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.objects.instance [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'migration_context' on Instance uuid 4b489f97-c8d4-4a6a-8404-e1a05a990261 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:40:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1221562093',display_name='tempest-ServerRescueNegativeTestJSON-server-1221562093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1221562093',id=23,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a564ea15194c4e059746d2fc6e7e1a07',ramdisk_id='',reservation_id='r-dhvz0v5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-203744558',owner_user_name='tempest-ServerRescueNegativeTestJSON-203744558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:40:10Z,user_data=None,user_id='b85ef05658d64f1fbd78e509e2a606d8',uuid=eec545e8-eeda-443c-9892-980e19e7267a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65b5e7b6-01af-4239-9386-e7b14c83e766", "address": "fa:16:3e:88:de:ee", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b5e7b6-01", "ovs_interfaceid": "65b5e7b6-01af-4239-9386-e7b14c83e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Converting VIF {"id": "65b5e7b6-01af-4239-9386-e7b14c83e766", "address": "fa:16:3e:88:de:ee", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b5e7b6-01", "ovs_interfaceid": "65b5e7b6-01af-4239-9386-e7b14c83e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:de:ee,bridge_name='br-int',has_traffic_filtering=True,id=65b5e7b6-01af-4239-9386-e7b14c83e766,network=Network(f4772ea6-9cb0-4ca8-b327-34f8dd08808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65b5e7b6-01') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.objects.instance [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'pci_devices' on Instance uuid eec545e8-eeda-443c-9892-980e19e7267a {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Ensure instance console log exists: /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:40:13 user nova-compute[73010]:   <uuid>eec545e8-eeda-443c-9892-980e19e7267a</uuid>
Aug 15 00:40:13 user nova-compute[73010]:   <name>instance-00000017</name>
Aug 15 00:40:13 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:40:13 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:40:13 user nova-compute[73010]:   <metadata>
Aug 15 00:40:13 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:40:13 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:40:13 user nova-compute[73010]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1221562093</nova:name>
Aug 15 00:40:13 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:40:13</nova:creationTime>
Aug 15 00:40:13 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:40:13 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:40:13 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:40:13 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:40:13 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:40:13 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:40:13 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:40:13 user nova-compute[73010]:       <nova:owner>
Aug 15 00:40:13 user nova-compute[73010]:         <nova:user uuid="b85ef05658d64f1fbd78e509e2a606d8">tempest-ServerRescueNegativeTestJSON-203744558-project-member</nova:user>
Aug 15 00:40:13 user nova-compute[73010]:         <nova:project uuid="a564ea15194c4e059746d2fc6e7e1a07">tempest-ServerRescueNegativeTestJSON-203744558</nova:project>
Aug 15 00:40:13 user nova-compute[73010]:       </nova:owner>
Aug 15 00:40:13 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:40:13 user nova-compute[73010]:       <nova:ports>
Aug 15 00:40:13 user nova-compute[73010]:         <nova:port uuid="65b5e7b6-01af-4239-9386-e7b14c83e766">
Aug 15 00:40:13 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 00:40:13 user nova-compute[73010]:         </nova:port>
Aug 15 00:40:13 user nova-compute[73010]:       </nova:ports>
Aug 15 00:40:13 user nova-compute[73010]:     </nova:instance>
Aug 15 00:40:13 user nova-compute[73010]:   </metadata>
Aug 15 00:40:13 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:40:13 user nova-compute[73010]:     <system>
Aug 15 00:40:13 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:40:13 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:40:13 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:40:13 user nova-compute[73010]:       <entry name="serial">eec545e8-eeda-443c-9892-980e19e7267a</entry>
Aug 15 00:40:13 user nova-compute[73010]:       <entry name="uuid">eec545e8-eeda-443c-9892-980e19e7267a</entry>
Aug 15 00:40:13 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:40:13 user nova-compute[73010]:     </system>
Aug 15 00:40:13 user nova-compute[73010]:   </sysinfo>
Aug 15 00:40:13 user nova-compute[73010]:   <os>
Aug 15 00:40:13 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:40:13 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:40:13 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:40:13 user nova-compute[73010]:   </os>
Aug 15 00:40:13 user nova-compute[73010]:   <features>
Aug 15 00:40:13 user nova-compute[73010]:     <acpi/>
Aug 15 00:40:13 user nova-compute[73010]:     <apic/>
Aug 15 00:40:13 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:40:13 user nova-compute[73010]:   </features>
Aug 15 00:40:13 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:40:13 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:40:13 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:40:13 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:40:13 user nova-compute[73010]:   </clock>
Aug 15 00:40:13 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:40:13 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:40:13 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:40:13 user nova-compute[73010]:   </cpu>
Aug 15 00:40:13 user nova-compute[73010]:   <devices>
Aug 15 00:40:13 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:40:13 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:40:13 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk"/>
Aug 15 00:40:13 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:40:13 user nova-compute[73010]:     </disk>
Aug 15 00:40:13 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:40:13 user nova-compute[73010]:       <mac address="fa:16:3e:88:de:ee"/>
Aug 15 00:40:13 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:40:13 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:40:13 user nova-compute[73010]:       <target dev="tap65b5e7b6-01"/>
Aug 15 00:40:13 user nova-compute[73010]:     </interface>
Aug 15 00:40:13 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:40:13 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/console.log" append="off"/>
Aug 15 00:40:13 user nova-compute[73010]:     </serial>
Aug 15 00:40:13 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:40:13 user nova-compute[73010]:     <video>
Aug 15 00:40:13 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:40:13 user nova-compute[73010]:     </video>
Aug 15 00:40:13 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:40:13 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:40:13 user nova-compute[73010]:     </rng>
Aug 15 00:40:13 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:40:13 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:40:13 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:40:13 user nova-compute[73010]:     </memballoon>
Aug 15 00:40:13 user nova-compute[73010]:   </devices>
Aug 15 00:40:13 user nova-compute[73010]: </domain>
Aug 15 00:40:13 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:40:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1221562093',display_name='tempest-ServerRescueNegativeTestJSON-server-1221562093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1221562093',id=23,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a564ea15194c4e059746d2fc6e7e1a07',ramdisk_id='',reservation_id='r-dhvz0v5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-203744558',owner_user_name='tempest-ServerRescueNegativeTestJSON-203744558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:40:10Z,user_data=None,user_id='b85ef05658d64f1fbd78e509e2a606d8',uuid=eec545e8-eeda-443c-9892-980e19e7267a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65b5e7b6-01af-4239-9386-e7b14c83e766", "address": "fa:16:3e:88:de:ee", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b5e7b6-01", "ovs_interfaceid": "65b5e7b6-01af-4239-9386-e7b14c83e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Converting VIF {"id": "65b5e7b6-01af-4239-9386-e7b14c83e766", "address": "fa:16:3e:88:de:ee", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b5e7b6-01", "ovs_interfaceid": "65b5e7b6-01af-4239-9386-e7b14c83e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:de:ee,bridge_name='br-int',has_traffic_filtering=True,id=65b5e7b6-01af-4239-9386-e7b14c83e766,network=Network(f4772ea6-9cb0-4ca8-b327-34f8dd08808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65b5e7b6-01') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG os_vif [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:de:ee,bridge_name='br-int',has_traffic_filtering=True,id=65b5e7b6-01af-4239-9386-e7b14c83e766,network=Network(f4772ea6-9cb0-4ca8-b327-34f8dd08808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65b5e7b6-01') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65b5e7b6-01, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap65b5e7b6-01, col_values=(('external_ids', {'iface-id': '65b5e7b6-01af-4239-9386-e7b14c83e766', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:de:ee', 'vm-uuid': 'eec545e8-eeda-443c-9892-980e19e7267a'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:13 user nova-compute[73010]: INFO os_vif [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:de:ee,bridge_name='br-int',has_traffic_filtering=True,id=65b5e7b6-01af-4239-9386-e7b14c83e766,network=Network(f4772ea6-9cb0-4ca8-b327-34f8dd08808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65b5e7b6-01')
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.network.neutron [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Successfully created port: 6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] No VIF found with MAC fa:16:3e:88:de:ee, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.network.neutron [req-ba08b4ef-b603-41f9-bd2e-6693f6fa45e6 req-85328920-dbfe-4c46-8c76-221396c630b0 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Updated VIF entry in instance network info cache for port 65b5e7b6-01af-4239-9386-e7b14c83e766. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.network.neutron [req-ba08b4ef-b603-41f9-bd2e-6693f6fa45e6 req-85328920-dbfe-4c46-8c76-221396c630b0 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Updating instance_info_cache with network_info: [{"id": "65b5e7b6-01af-4239-9386-e7b14c83e766", "address": "fa:16:3e:88:de:ee", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b5e7b6-01", "ovs_interfaceid": "65b5e7b6-01af-4239-9386-e7b14c83e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ba08b4ef-b603-41f9-bd2e-6693f6fa45e6 req-85328920-dbfe-4c46-8c76-221396c630b0 service nova] Releasing lock "refresh_cache-eec545e8-eeda-443c-9892-980e19e7267a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692059998.914251, 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:40:13 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] VM Stopped (Lifecycle Event)
Aug 15 00:40:13 user nova-compute[73010]: DEBUG nova.compute.manager [None req-18113520-5e2e-4f57-acf9-4b952ec34bbf None None] [instance: 3c4015b5-3ae9-4486-878c-e7a2b01ff5c9] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.network.neutron [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Successfully updated port: 6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "refresh_cache-4b489f97-c8d4-4a6a-8404-e1a05a990261" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquired lock "refresh_cache-4b489f97-c8d4-4a6a-8404-e1a05a990261" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.network.neutron [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.compute.manager [req-b34c8d13-0464-4551-af40-44a663523a66 req-8bd3131d-3443-461e-880d-1d67912871ec service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Received event network-changed-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.compute.manager [req-b34c8d13-0464-4551-af40-44a663523a66 req-8bd3131d-3443-461e-880d-1d67912871ec service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Refreshing instance network info cache due to event network-changed-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b34c8d13-0464-4551-af40-44a663523a66 req-8bd3131d-3443-461e-880d-1d67912871ec service nova] Acquiring lock "refresh_cache-4b489f97-c8d4-4a6a-8404-e1a05a990261" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.network.neutron [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.network.neutron [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Updating instance_info_cache with network_info: [{"id": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "address": "fa:16:3e:31:6a:22", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da1cffd-22", "ovs_interfaceid": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Releasing lock "refresh_cache-4b489f97-c8d4-4a6a-8404-e1a05a990261" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.compute.manager [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Instance network_info: |[{"id": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "address": "fa:16:3e:31:6a:22", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da1cffd-22", "ovs_interfaceid": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b34c8d13-0464-4551-af40-44a663523a66 req-8bd3131d-3443-461e-880d-1d67912871ec service nova] Acquired lock "refresh_cache-4b489f97-c8d4-4a6a-8404-e1a05a990261" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.network.neutron [req-b34c8d13-0464-4551-af40-44a663523a66 req-8bd3131d-3443-461e-880d-1d67912871ec service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Refreshing network info cache for port 6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Start _get_guest_xml network_info=[{"id": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "address": "fa:16:3e:31:6a:22", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da1cffd-22", "ovs_interfaceid": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:40:14 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:40:14 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:40:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-871958020',display_name='tempest-ServerRescueNegativeTestJSON-server-871958020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-871958020',id=24,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a564ea15194c4e059746d2fc6e7e1a07',ramdisk_id='',reservation_id='r-7qe9mv1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-203744558',owner_user_name='tempest-ServerRescueNegativeTestJSON-203744558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:40:12Z,user_data=None,user_id='b85ef05658d64f1fbd78e509e2a606d8',uuid=4b489f97-c8d4-4a6a-8404-e1a05a990261,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "address": "fa:16:3e:31:6a:22", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da1cffd-22", "ovs_interfaceid": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Converting VIF {"id": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "address": "fa:16:3e:31:6a:22", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da1cffd-22", "ovs_interfaceid": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:6a:22,bridge_name='br-int',has_traffic_filtering=True,id=6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa,network=Network(f4772ea6-9cb0-4ca8-b327-34f8dd08808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6da1cffd-22') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.objects.instance [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b489f97-c8d4-4a6a-8404-e1a05a990261 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:40:14 user nova-compute[73010]:   <uuid>4b489f97-c8d4-4a6a-8404-e1a05a990261</uuid>
Aug 15 00:40:14 user nova-compute[73010]:   <name>instance-00000018</name>
Aug 15 00:40:14 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:40:14 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:40:14 user nova-compute[73010]:   <metadata>
Aug 15 00:40:14 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:40:14 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:40:14 user nova-compute[73010]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-871958020</nova:name>
Aug 15 00:40:14 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:40:14</nova:creationTime>
Aug 15 00:40:14 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:40:14 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:40:14 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:40:14 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:40:14 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:40:14 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:40:14 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:40:14 user nova-compute[73010]:       <nova:owner>
Aug 15 00:40:14 user nova-compute[73010]:         <nova:user uuid="b85ef05658d64f1fbd78e509e2a606d8">tempest-ServerRescueNegativeTestJSON-203744558-project-member</nova:user>
Aug 15 00:40:14 user nova-compute[73010]:         <nova:project uuid="a564ea15194c4e059746d2fc6e7e1a07">tempest-ServerRescueNegativeTestJSON-203744558</nova:project>
Aug 15 00:40:14 user nova-compute[73010]:       </nova:owner>
Aug 15 00:40:14 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:40:14 user nova-compute[73010]:       <nova:ports>
Aug 15 00:40:14 user nova-compute[73010]:         <nova:port uuid="6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa">
Aug 15 00:40:14 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 00:40:14 user nova-compute[73010]:         </nova:port>
Aug 15 00:40:14 user nova-compute[73010]:       </nova:ports>
Aug 15 00:40:14 user nova-compute[73010]:     </nova:instance>
Aug 15 00:40:14 user nova-compute[73010]:   </metadata>
Aug 15 00:40:14 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:40:14 user nova-compute[73010]:     <system>
Aug 15 00:40:14 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:40:14 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:40:14 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:40:14 user nova-compute[73010]:       <entry name="serial">4b489f97-c8d4-4a6a-8404-e1a05a990261</entry>
Aug 15 00:40:14 user nova-compute[73010]:       <entry name="uuid">4b489f97-c8d4-4a6a-8404-e1a05a990261</entry>
Aug 15 00:40:14 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:40:14 user nova-compute[73010]:     </system>
Aug 15 00:40:14 user nova-compute[73010]:   </sysinfo>
Aug 15 00:40:14 user nova-compute[73010]:   <os>
Aug 15 00:40:14 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:40:14 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:40:14 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:40:14 user nova-compute[73010]:   </os>
Aug 15 00:40:14 user nova-compute[73010]:   <features>
Aug 15 00:40:14 user nova-compute[73010]:     <acpi/>
Aug 15 00:40:14 user nova-compute[73010]:     <apic/>
Aug 15 00:40:14 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:40:14 user nova-compute[73010]:   </features>
Aug 15 00:40:14 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:40:14 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:40:14 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:40:14 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:40:14 user nova-compute[73010]:   </clock>
Aug 15 00:40:14 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:40:14 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:40:14 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:40:14 user nova-compute[73010]:   </cpu>
Aug 15 00:40:14 user nova-compute[73010]:   <devices>
Aug 15 00:40:14 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:40:14 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:40:14 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk"/>
Aug 15 00:40:14 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:40:14 user nova-compute[73010]:     </disk>
Aug 15 00:40:14 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:40:14 user nova-compute[73010]:       <mac address="fa:16:3e:31:6a:22"/>
Aug 15 00:40:14 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:40:14 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:40:14 user nova-compute[73010]:       <target dev="tap6da1cffd-22"/>
Aug 15 00:40:14 user nova-compute[73010]:     </interface>
Aug 15 00:40:14 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:40:14 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/console.log" append="off"/>
Aug 15 00:40:14 user nova-compute[73010]:     </serial>
Aug 15 00:40:14 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:40:14 user nova-compute[73010]:     <video>
Aug 15 00:40:14 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:40:14 user nova-compute[73010]:     </video>
Aug 15 00:40:14 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:40:14 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:40:14 user nova-compute[73010]:     </rng>
Aug 15 00:40:14 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:40:14 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:40:14 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:40:14 user nova-compute[73010]:     </memballoon>
Aug 15 00:40:14 user nova-compute[73010]:   </devices>
Aug 15 00:40:14 user nova-compute[73010]: </domain>
Aug 15 00:40:14 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:40:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-871958020',display_name='tempest-ServerRescueNegativeTestJSON-server-871958020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-871958020',id=24,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a564ea15194c4e059746d2fc6e7e1a07',ramdisk_id='',reservation_id='r-7qe9mv1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-203744558',owner_user_name='tempest-ServerRescueNegativeTestJSON-203744558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:40:12Z,user_data=None,user_id='b85ef05658d64f1fbd78e509e2a606d8',uuid=4b489f97-c8d4-4a6a-8404-e1a05a990261,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "address": "fa:16:3e:31:6a:22", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da1cffd-22", "ovs_interfaceid": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Converting VIF {"id": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "address": "fa:16:3e:31:6a:22", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da1cffd-22", "ovs_interfaceid": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:6a:22,bridge_name='br-int',has_traffic_filtering=True,id=6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa,network=Network(f4772ea6-9cb0-4ca8-b327-34f8dd08808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6da1cffd-22') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG os_vif [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:6a:22,bridge_name='br-int',has_traffic_filtering=True,id=6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa,network=Network(f4772ea6-9cb0-4ca8-b327-34f8dd08808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6da1cffd-22') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6da1cffd-22, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6da1cffd-22, col_values=(('external_ids', {'iface-id': '6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:6a:22', 'vm-uuid': '4b489f97-c8d4-4a6a-8404-e1a05a990261'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:14 user nova-compute[73010]: INFO os_vif [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:6a:22,bridge_name='br-int',has_traffic_filtering=True,id=6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa,network=Network(f4772ea6-9cb0-4ca8-b327-34f8dd08808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6da1cffd-22')
Aug 15 00:40:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:40:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] No VIF found with MAC fa:16:3e:31:6a:22, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:40:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-797639e4-3e6b-4439-8c9c-d45263c3a207 req-9ab2607c-15b8-41e1-bee7-50ccba25f74a service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received event network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-797639e4-3e6b-4439-8c9c-d45263c3a207 req-9ab2607c-15b8-41e1-bee7-50ccba25f74a service nova] Acquiring lock "eec545e8-eeda-443c-9892-980e19e7267a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-797639e4-3e6b-4439-8c9c-d45263c3a207 req-9ab2607c-15b8-41e1-bee7-50ccba25f74a service nova] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-797639e4-3e6b-4439-8c9c-d45263c3a207 req-9ab2607c-15b8-41e1-bee7-50ccba25f74a service nova] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-797639e4-3e6b-4439-8c9c-d45263c3a207 req-9ab2607c-15b8-41e1-bee7-50ccba25f74a service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] No waiting events found dispatching network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:40:15 user nova-compute[73010]: WARNING nova.compute.manager [req-797639e4-3e6b-4439-8c9c-d45263c3a207 req-9ab2607c-15b8-41e1-bee7-50ccba25f74a service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received unexpected event network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 for instance with vm_state building and task_state spawning.
Aug 15 00:40:15 user nova-compute[73010]: DEBUG nova.network.neutron [req-b34c8d13-0464-4551-af40-44a663523a66 req-8bd3131d-3443-461e-880d-1d67912871ec service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Updated VIF entry in instance network info cache for port 6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:40:15 user nova-compute[73010]: DEBUG nova.network.neutron [req-b34c8d13-0464-4551-af40-44a663523a66 req-8bd3131d-3443-461e-880d-1d67912871ec service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Updating instance_info_cache with network_info: [{"id": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "address": "fa:16:3e:31:6a:22", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da1cffd-22", "ovs_interfaceid": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:40:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b34c8d13-0464-4551-af40-44a663523a66 req-8bd3131d-3443-461e-880d-1d67912871ec service nova] Releasing lock "refresh_cache-4b489f97-c8d4-4a6a-8404-e1a05a990261" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:40:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:17 user nova-compute[73010]: DEBUG nova.compute.manager [req-b4387839-a9b5-4a40-81a2-9bf44c64e654 req-375f5d2a-5384-4443-a33b-8ecd14326e2e service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received event network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b4387839-a9b5-4a40-81a2-9bf44c64e654 req-375f5d2a-5384-4443-a33b-8ecd14326e2e service nova] Acquiring lock "eec545e8-eeda-443c-9892-980e19e7267a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b4387839-a9b5-4a40-81a2-9bf44c64e654 req-375f5d2a-5384-4443-a33b-8ecd14326e2e service nova] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b4387839-a9b5-4a40-81a2-9bf44c64e654 req-375f5d2a-5384-4443-a33b-8ecd14326e2e service nova] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:17 user nova-compute[73010]: DEBUG nova.compute.manager [req-b4387839-a9b5-4a40-81a2-9bf44c64e654 req-375f5d2a-5384-4443-a33b-8ecd14326e2e service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] No waiting events found dispatching network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:40:17 user nova-compute[73010]: WARNING nova.compute.manager [req-b4387839-a9b5-4a40-81a2-9bf44c64e654 req-375f5d2a-5384-4443-a33b-8ecd14326e2e service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received unexpected event network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 for instance with vm_state building and task_state spawning.
Aug 15 00:40:17 user nova-compute[73010]: DEBUG nova.compute.manager [req-b4387839-a9b5-4a40-81a2-9bf44c64e654 req-375f5d2a-5384-4443-a33b-8ecd14326e2e service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Received event network-vif-plugged-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b4387839-a9b5-4a40-81a2-9bf44c64e654 req-375f5d2a-5384-4443-a33b-8ecd14326e2e service nova] Acquiring lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b4387839-a9b5-4a40-81a2-9bf44c64e654 req-375f5d2a-5384-4443-a33b-8ecd14326e2e service nova] Lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b4387839-a9b5-4a40-81a2-9bf44c64e654 req-375f5d2a-5384-4443-a33b-8ecd14326e2e service nova] Lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:17 user nova-compute[73010]: DEBUG nova.compute.manager [req-b4387839-a9b5-4a40-81a2-9bf44c64e654 req-375f5d2a-5384-4443-a33b-8ecd14326e2e service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] No waiting events found dispatching network-vif-plugged-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:40:17 user nova-compute[73010]: WARNING nova.compute.manager [req-b4387839-a9b5-4a40-81a2-9bf44c64e654 req-375f5d2a-5384-4443-a33b-8ecd14326e2e service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Received unexpected event network-vif-plugged-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa for instance with vm_state building and task_state spawning.
Aug 15 00:40:17 user nova-compute[73010]: DEBUG nova.compute.manager [req-b4387839-a9b5-4a40-81a2-9bf44c64e654 req-375f5d2a-5384-4443-a33b-8ecd14326e2e service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Received event network-vif-plugged-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b4387839-a9b5-4a40-81a2-9bf44c64e654 req-375f5d2a-5384-4443-a33b-8ecd14326e2e service nova] Acquiring lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b4387839-a9b5-4a40-81a2-9bf44c64e654 req-375f5d2a-5384-4443-a33b-8ecd14326e2e service nova] Lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b4387839-a9b5-4a40-81a2-9bf44c64e654 req-375f5d2a-5384-4443-a33b-8ecd14326e2e service nova] Lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:17 user nova-compute[73010]: DEBUG nova.compute.manager [req-b4387839-a9b5-4a40-81a2-9bf44c64e654 req-375f5d2a-5384-4443-a33b-8ecd14326e2e service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] No waiting events found dispatching network-vif-plugged-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:40:17 user nova-compute[73010]: WARNING nova.compute.manager [req-b4387839-a9b5-4a40-81a2-9bf44c64e654 req-375f5d2a-5384-4443-a33b-8ecd14326e2e service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Received unexpected event network-vif-plugged-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa for instance with vm_state building and task_state spawning.
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060018.2653325, eec545e8-eeda-443c-9892-980e19e7267a => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:40:18 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] VM Resumed (Lifecycle Event)
Aug 15 00:40:18 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Instance spawned successfully.
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:18 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060018.2676177, eec545e8-eeda-443c-9892-980e19e7267a => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:40:18 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] VM Started (Lifecycle Event)
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:40:18 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:40:18 user nova-compute[73010]: INFO nova.compute.manager [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Took 7.82 seconds to spawn the instance on the hypervisor.
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060003.4205446, 362829aa-9659-4ced-9537-d11de1b6b2d7 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:40:18 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] VM Stopped (Lifecycle Event)
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-d2bfd490-e688-4f5a-8c70-24f1dd9ffba0 None None] [instance: 362829aa-9659-4ced-9537-d11de1b6b2d7] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:40:18 user nova-compute[73010]: INFO nova.compute.manager [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Took 8.79 seconds to build instance.
Aug 15 00:40:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d60a0416-0808-4dea-8d86-892b2c3ef324 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "eec545e8-eeda-443c-9892-980e19e7267a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.899s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060018.7921336, 4b489f97-c8d4-4a6a-8404-e1a05a990261 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:40:18 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] VM Resumed (Lifecycle Event)
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:40:18 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Instance spawned successfully.
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:18 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060018.792224, 4b489f97-c8d4-4a6a-8404-e1a05a990261 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:40:18 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] VM Started (Lifecycle Event)
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:40:18 user nova-compute[73010]: INFO nova.compute.manager [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Took 6.63 seconds to spawn the instance on the hypervisor.
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:40:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:40:18 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:40:19 user nova-compute[73010]: INFO nova.compute.manager [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Took 7.66 seconds to build instance.
Aug 15 00:40:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6fc21420-6215-4c1d-8e19-4569a87a5c48 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "4b489f97-c8d4-4a6a-8404-e1a05a990261" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.917s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "98fa0e64-cf36-4991-924d-ba4b713239d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:23 user nova-compute[73010]: DEBUG nova.compute.manager [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:40:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:40:23 user nova-compute[73010]: INFO nova.compute.claims [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Claim successful on node user
Aug 15 00:40:23 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:40:23 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:40:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:23 user nova-compute[73010]: DEBUG nova.compute.manager [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:40:23 user nova-compute[73010]: DEBUG nova.compute.manager [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:40:23 user nova-compute[73010]: DEBUG nova.network.neutron [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:40:24 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:40:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:40:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:40:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:40:24 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Creating image(s)
Aug 15 00:40:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "/opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "/opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "/opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:24 user nova-compute[73010]: DEBUG nova.policy [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61790feda8a743949f630b35d9a48935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5a9782c512458e971f2bdf28a579c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:40:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.186s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.198s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk 1073741824" returned: 0 in 0.150s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.371s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.196s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:24 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:40:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:25 user nova-compute[73010]: DEBUG nova.network.neutron [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Successfully created port: db655edd-5181-47db-ba3c-4a79af26528e {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:40:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:25 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Cannot resize image /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:40:25 user nova-compute[73010]: DEBUG nova.objects.instance [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lazy-loading 'migration_context' on Instance uuid 98fa0e64-cf36-4991-924d-ba4b713239d0 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:40:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:40:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Ensure instance console log exists: /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:40:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:25 user nova-compute[73010]: DEBUG nova.network.neutron [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Successfully updated port: db655edd-5181-47db-ba3c-4a79af26528e {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:40:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "refresh_cache-98fa0e64-cf36-4991-924d-ba4b713239d0" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:40:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquired lock "refresh_cache-98fa0e64-cf36-4991-924d-ba4b713239d0" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:40:25 user nova-compute[73010]: DEBUG nova.network.neutron [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:40:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-73ef8263-f3d1-4aeb-bb89-749ff8d21df0 req-f5ba1bd1-b0e6-4b83-950c-3d44d9215a88 service nova] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Received event network-changed-db655edd-5181-47db-ba3c-4a79af26528e {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-73ef8263-f3d1-4aeb-bb89-749ff8d21df0 req-f5ba1bd1-b0e6-4b83-950c-3d44d9215a88 service nova] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Refreshing instance network info cache due to event network-changed-db655edd-5181-47db-ba3c-4a79af26528e. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:40:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-73ef8263-f3d1-4aeb-bb89-749ff8d21df0 req-f5ba1bd1-b0e6-4b83-950c-3d44d9215a88 service nova] Acquiring lock "refresh_cache-98fa0e64-cf36-4991-924d-ba4b713239d0" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:40:25 user nova-compute[73010]: DEBUG nova.network.neutron [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.network.neutron [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Updating instance_info_cache with network_info: [{"id": "db655edd-5181-47db-ba3c-4a79af26528e", "address": "fa:16:3e:1d:6a:3d", "network": {"id": "536a7c12-166a-4d44-b705-ea1ac348601d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-841639308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5a9782c512458e971f2bdf28a579c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb655edd-51", "ovs_interfaceid": "db655edd-5181-47db-ba3c-4a79af26528e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Releasing lock "refresh_cache-98fa0e64-cf36-4991-924d-ba4b713239d0" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.compute.manager [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Instance network_info: |[{"id": "db655edd-5181-47db-ba3c-4a79af26528e", "address": "fa:16:3e:1d:6a:3d", "network": {"id": "536a7c12-166a-4d44-b705-ea1ac348601d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-841639308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5a9782c512458e971f2bdf28a579c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb655edd-51", "ovs_interfaceid": "db655edd-5181-47db-ba3c-4a79af26528e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-73ef8263-f3d1-4aeb-bb89-749ff8d21df0 req-f5ba1bd1-b0e6-4b83-950c-3d44d9215a88 service nova] Acquired lock "refresh_cache-98fa0e64-cf36-4991-924d-ba4b713239d0" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.network.neutron [req-73ef8263-f3d1-4aeb-bb89-749ff8d21df0 req-f5ba1bd1-b0e6-4b83-950c-3d44d9215a88 service nova] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Refreshing network info cache for port db655edd-5181-47db-ba3c-4a79af26528e {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Start _get_guest_xml network_info=[{"id": "db655edd-5181-47db-ba3c-4a79af26528e", "address": "fa:16:3e:1d:6a:3d", "network": {"id": "536a7c12-166a-4d44-b705-ea1ac348601d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-841639308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5a9782c512458e971f2bdf28a579c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb655edd-51", "ovs_interfaceid": "db655edd-5181-47db-ba3c-4a79af26528e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:40:26 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:40:26 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:40:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-304817032',display_name='tempest-SnapshotDataIntegrityTests-server-304817032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-304817032',id=25,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY54/EgYt4W0qvyeF/aN/F8rqDS+ylE79NBq8EcYzK6Hmlas8ouy0yhXyZDr8lRactFtWwAxEA3NTeLXfjOKaJtoZGFr7rbjM8SotRYfIl14kMUCRYhVgskN7H5bNugkA==',key_name='tempest-keypair-556569916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a5a9782c512458e971f2bdf28a579c1',ramdisk_id='',reservation_id='r-jnh6gc0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-293008731',owner_user_name='tempest-SnapshotDataIntegrityTests-293008731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:40:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61790feda8a743949f630b35d9a48935',uuid=98fa0e64-cf36-4991-924d-ba4b713239d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db655edd-5181-47db-ba3c-4a79af26528e", "address": "fa:16:3e:1d:6a:3d", "network": {"id": "536a7c12-166a-4d44-b705-ea1ac348601d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-841639308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5a9782c512458e971f2bdf28a579c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb655edd-51", "ovs_interfaceid": "db655edd-5181-47db-ba3c-4a79af26528e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Converting VIF {"id": "db655edd-5181-47db-ba3c-4a79af26528e", "address": "fa:16:3e:1d:6a:3d", "network": {"id": "536a7c12-166a-4d44-b705-ea1ac348601d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-841639308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5a9782c512458e971f2bdf28a579c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb655edd-51", "ovs_interfaceid": "db655edd-5181-47db-ba3c-4a79af26528e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:6a:3d,bridge_name='br-int',has_traffic_filtering=True,id=db655edd-5181-47db-ba3c-4a79af26528e,network=Network(536a7c12-166a-4d44-b705-ea1ac348601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb655edd-51') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.objects.instance [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lazy-loading 'pci_devices' on Instance uuid 98fa0e64-cf36-4991-924d-ba4b713239d0 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:40:26 user nova-compute[73010]:   <uuid>98fa0e64-cf36-4991-924d-ba4b713239d0</uuid>
Aug 15 00:40:26 user nova-compute[73010]:   <name>instance-00000019</name>
Aug 15 00:40:26 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:40:26 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:40:26 user nova-compute[73010]:   <metadata>
Aug 15 00:40:26 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:40:26 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:40:26 user nova-compute[73010]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-304817032</nova:name>
Aug 15 00:40:26 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:40:26</nova:creationTime>
Aug 15 00:40:26 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:40:26 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:40:26 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:40:26 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:40:26 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:40:26 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:40:26 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:40:26 user nova-compute[73010]:       <nova:owner>
Aug 15 00:40:26 user nova-compute[73010]:         <nova:user uuid="61790feda8a743949f630b35d9a48935">tempest-SnapshotDataIntegrityTests-293008731-project-member</nova:user>
Aug 15 00:40:26 user nova-compute[73010]:         <nova:project uuid="8a5a9782c512458e971f2bdf28a579c1">tempest-SnapshotDataIntegrityTests-293008731</nova:project>
Aug 15 00:40:26 user nova-compute[73010]:       </nova:owner>
Aug 15 00:40:26 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:40:26 user nova-compute[73010]:       <nova:ports>
Aug 15 00:40:26 user nova-compute[73010]:         <nova:port uuid="db655edd-5181-47db-ba3c-4a79af26528e">
Aug 15 00:40:26 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 00:40:26 user nova-compute[73010]:         </nova:port>
Aug 15 00:40:26 user nova-compute[73010]:       </nova:ports>
Aug 15 00:40:26 user nova-compute[73010]:     </nova:instance>
Aug 15 00:40:26 user nova-compute[73010]:   </metadata>
Aug 15 00:40:26 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:40:26 user nova-compute[73010]:     <system>
Aug 15 00:40:26 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:40:26 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:40:26 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:40:26 user nova-compute[73010]:       <entry name="serial">98fa0e64-cf36-4991-924d-ba4b713239d0</entry>
Aug 15 00:40:26 user nova-compute[73010]:       <entry name="uuid">98fa0e64-cf36-4991-924d-ba4b713239d0</entry>
Aug 15 00:40:26 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:40:26 user nova-compute[73010]:     </system>
Aug 15 00:40:26 user nova-compute[73010]:   </sysinfo>
Aug 15 00:40:26 user nova-compute[73010]:   <os>
Aug 15 00:40:26 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:40:26 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:40:26 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:40:26 user nova-compute[73010]:   </os>
Aug 15 00:40:26 user nova-compute[73010]:   <features>
Aug 15 00:40:26 user nova-compute[73010]:     <acpi/>
Aug 15 00:40:26 user nova-compute[73010]:     <apic/>
Aug 15 00:40:26 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:40:26 user nova-compute[73010]:   </features>
Aug 15 00:40:26 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:40:26 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:40:26 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:40:26 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:40:26 user nova-compute[73010]:   </clock>
Aug 15 00:40:26 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:40:26 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:40:26 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:40:26 user nova-compute[73010]:   </cpu>
Aug 15 00:40:26 user nova-compute[73010]:   <devices>
Aug 15 00:40:26 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:40:26 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:40:26 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk"/>
Aug 15 00:40:26 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:40:26 user nova-compute[73010]:     </disk>
Aug 15 00:40:26 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:40:26 user nova-compute[73010]:       <mac address="fa:16:3e:1d:6a:3d"/>
Aug 15 00:40:26 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:40:26 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:40:26 user nova-compute[73010]:       <target dev="tapdb655edd-51"/>
Aug 15 00:40:26 user nova-compute[73010]:     </interface>
Aug 15 00:40:26 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:40:26 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/console.log" append="off"/>
Aug 15 00:40:26 user nova-compute[73010]:     </serial>
Aug 15 00:40:26 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:40:26 user nova-compute[73010]:     <video>
Aug 15 00:40:26 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:40:26 user nova-compute[73010]:     </video>
Aug 15 00:40:26 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:40:26 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:40:26 user nova-compute[73010]:     </rng>
Aug 15 00:40:26 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:40:26 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:40:26 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:40:26 user nova-compute[73010]:     </memballoon>
Aug 15 00:40:26 user nova-compute[73010]:   </devices>
Aug 15 00:40:26 user nova-compute[73010]: </domain>
Aug 15 00:40:26 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:40:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-304817032',display_name='tempest-SnapshotDataIntegrityTests-server-304817032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-304817032',id=25,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY54/EgYt4W0qvyeF/aN/F8rqDS+ylE79NBq8EcYzK6Hmlas8ouy0yhXyZDr8lRactFtWwAxEA3NTeLXfjOKaJtoZGFr7rbjM8SotRYfIl14kMUCRYhVgskN7H5bNugkA==',key_name='tempest-keypair-556569916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a5a9782c512458e971f2bdf28a579c1',ramdisk_id='',reservation_id='r-jnh6gc0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-293008731',owner_user_name='tempest-SnapshotDataIntegrityTests-293008731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:40:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61790feda8a743949f630b35d9a48935',uuid=98fa0e64-cf36-4991-924d-ba4b713239d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db655edd-5181-47db-ba3c-4a79af26528e", "address": "fa:16:3e:1d:6a:3d", "network": {"id": "536a7c12-166a-4d44-b705-ea1ac348601d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-841639308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5a9782c512458e971f2bdf28a579c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb655edd-51", "ovs_interfaceid": "db655edd-5181-47db-ba3c-4a79af26528e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Converting VIF {"id": "db655edd-5181-47db-ba3c-4a79af26528e", "address": "fa:16:3e:1d:6a:3d", "network": {"id": "536a7c12-166a-4d44-b705-ea1ac348601d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-841639308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5a9782c512458e971f2bdf28a579c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb655edd-51", "ovs_interfaceid": "db655edd-5181-47db-ba3c-4a79af26528e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:6a:3d,bridge_name='br-int',has_traffic_filtering=True,id=db655edd-5181-47db-ba3c-4a79af26528e,network=Network(536a7c12-166a-4d44-b705-ea1ac348601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb655edd-51') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG os_vif [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:6a:3d,bridge_name='br-int',has_traffic_filtering=True,id=db655edd-5181-47db-ba3c-4a79af26528e,network=Network(536a7c12-166a-4d44-b705-ea1ac348601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb655edd-51') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb655edd-51, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdb655edd-51, col_values=(('external_ids', {'iface-id': 'db655edd-5181-47db-ba3c-4a79af26528e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:6a:3d', 'vm-uuid': '98fa0e64-cf36-4991-924d-ba4b713239d0'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:26 user nova-compute[73010]: INFO os_vif [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:6a:3d,bridge_name='br-int',has_traffic_filtering=True,id=db655edd-5181-47db-ba3c-4a79af26528e,network=Network(536a7c12-166a-4d44-b705-ea1ac348601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb655edd-51')
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:40:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] No VIF found with MAC fa:16:3e:1d:6a:3d, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:40:27 user nova-compute[73010]: DEBUG nova.network.neutron [req-73ef8263-f3d1-4aeb-bb89-749ff8d21df0 req-f5ba1bd1-b0e6-4b83-950c-3d44d9215a88 service nova] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Updated VIF entry in instance network info cache for port db655edd-5181-47db-ba3c-4a79af26528e. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:40:27 user nova-compute[73010]: DEBUG nova.network.neutron [req-73ef8263-f3d1-4aeb-bb89-749ff8d21df0 req-f5ba1bd1-b0e6-4b83-950c-3d44d9215a88 service nova] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Updating instance_info_cache with network_info: [{"id": "db655edd-5181-47db-ba3c-4a79af26528e", "address": "fa:16:3e:1d:6a:3d", "network": {"id": "536a7c12-166a-4d44-b705-ea1ac348601d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-841639308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5a9782c512458e971f2bdf28a579c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb655edd-51", "ovs_interfaceid": "db655edd-5181-47db-ba3c-4a79af26528e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:40:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-73ef8263-f3d1-4aeb-bb89-749ff8d21df0 req-f5ba1bd1-b0e6-4b83-950c-3d44d9215a88 service nova] Releasing lock "refresh_cache-98fa0e64-cf36-4991-924d-ba4b713239d0" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:40:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-5974656f-2cf2-4cf4-b947-ff85ebc53300 req-b0a70eca-672b-4819-826f-57082a1fb833 service nova] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Received event network-vif-plugged-db655edd-5181-47db-ba3c-4a79af26528e {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5974656f-2cf2-4cf4-b947-ff85ebc53300 req-b0a70eca-672b-4819-826f-57082a1fb833 service nova] Acquiring lock "98fa0e64-cf36-4991-924d-ba4b713239d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5974656f-2cf2-4cf4-b947-ff85ebc53300 req-b0a70eca-672b-4819-826f-57082a1fb833 service nova] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5974656f-2cf2-4cf4-b947-ff85ebc53300 req-b0a70eca-672b-4819-826f-57082a1fb833 service nova] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-5974656f-2cf2-4cf4-b947-ff85ebc53300 req-b0a70eca-672b-4819-826f-57082a1fb833 service nova] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] No waiting events found dispatching network-vif-plugged-db655edd-5181-47db-ba3c-4a79af26528e {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:40:28 user nova-compute[73010]: WARNING nova.compute.manager [req-5974656f-2cf2-4cf4-b947-ff85ebc53300 req-b0a70eca-672b-4819-826f-57082a1fb833 service nova] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Received unexpected event network-vif-plugged-db655edd-5181-47db-ba3c-4a79af26528e for instance with vm_state building and task_state spawning.
Aug 15 00:40:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:30 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060030.0295312, 98fa0e64-cf36-4991-924d-ba4b713239d0 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:40:30 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] VM Resumed (Lifecycle Event)
Aug 15 00:40:30 user nova-compute[73010]: DEBUG nova.compute.manager [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:40:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:40:30 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Instance spawned successfully.
Aug 15 00:40:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:40:30 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:40:30 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:40:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-14d57fd7-40a0-4ad1-a275-b2cd71592a7f req-1eda2855-c250-4982-86bf-ae2cd2ea99a4 service nova] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Received event network-vif-plugged-db655edd-5181-47db-ba3c-4a79af26528e {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-14d57fd7-40a0-4ad1-a275-b2cd71592a7f req-1eda2855-c250-4982-86bf-ae2cd2ea99a4 service nova] Acquiring lock "98fa0e64-cf36-4991-924d-ba4b713239d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-14d57fd7-40a0-4ad1-a275-b2cd71592a7f req-1eda2855-c250-4982-86bf-ae2cd2ea99a4 service nova] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-14d57fd7-40a0-4ad1-a275-b2cd71592a7f req-1eda2855-c250-4982-86bf-ae2cd2ea99a4 service nova] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-14d57fd7-40a0-4ad1-a275-b2cd71592a7f req-1eda2855-c250-4982-86bf-ae2cd2ea99a4 service nova] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] No waiting events found dispatching network-vif-plugged-db655edd-5181-47db-ba3c-4a79af26528e {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:40:30 user nova-compute[73010]: WARNING nova.compute.manager [req-14d57fd7-40a0-4ad1-a275-b2cd71592a7f req-1eda2855-c250-4982-86bf-ae2cd2ea99a4 service nova] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Received unexpected event network-vif-plugged-db655edd-5181-47db-ba3c-4a79af26528e for instance with vm_state building and task_state spawning.
Aug 15 00:40:30 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:40:30 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060030.0313869, 98fa0e64-cf36-4991-924d-ba4b713239d0 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:40:30 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] VM Started (Lifecycle Event)
Aug 15 00:40:30 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:40:30 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:40:30 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:40:30 user nova-compute[73010]: INFO nova.compute.manager [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Took 6.06 seconds to spawn the instance on the hypervisor.
Aug 15 00:40:30 user nova-compute[73010]: DEBUG nova.compute.manager [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:40:30 user nova-compute[73010]: INFO nova.compute.manager [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Took 6.94 seconds to build instance.
Aug 15 00:40:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-160f9b81-d168-44db-84d7-2a969fb8a863 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.068s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Acquiring lock "84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:32 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:40:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:32 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:40:32 user nova-compute[73010]: INFO nova.compute.claims [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Claim successful on node user
Aug 15 00:40:33 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:40:33 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:40:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.654s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:40:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:40:33 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:40:33 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:40:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:40:33 user nova-compute[73010]: DEBUG nova.policy [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '40b76f3f670f4808817395410be6d6bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3735c817d3d2455ca95902bd1eaea878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:40:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:40:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:40:33 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Creating image(s)
Aug 15 00:40:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Acquiring lock "/opt/stack/data/nova/instances/84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "/opt/stack/data/nova/instances/84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "/opt/stack/data/nova/instances/84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.225s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a/disk 1073741824" returned: 0 in 0.050s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:34 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Successfully created port: 00049ba1-5997-43d4-a713-839f076f490c {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:40:34 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.181s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:34 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:40:34 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:34 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:34 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Cannot resize image /opt/stack/data/nova/instances/84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:40:34 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lazy-loading 'migration_context' on Instance uuid 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:40:34 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:40:34 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Ensure instance console log exists: /opt/stack/data/nova/instances/84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:40:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:34 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Successfully updated port: 00049ba1-5997-43d4-a713-839f076f490c {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Acquiring lock "refresh_cache-84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Acquired lock "refresh_cache-84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.compute.manager [req-3aa29fb1-b023-49d3-b801-88cb061650b9 req-c0e4ddcf-6d56-4eb7-b0dc-77e0feb30fc5 service nova] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Received event network-changed-00049ba1-5997-43d4-a713-839f076f490c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.compute.manager [req-3aa29fb1-b023-49d3-b801-88cb061650b9 req-c0e4ddcf-6d56-4eb7-b0dc-77e0feb30fc5 service nova] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Refreshing instance network info cache due to event network-changed-00049ba1-5997-43d4-a713-839f076f490c. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3aa29fb1-b023-49d3-b801-88cb061650b9 req-c0e4ddcf-6d56-4eb7-b0dc-77e0feb30fc5 service nova] Acquiring lock "refresh_cache-84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Updating instance_info_cache with network_info: [{"id": "00049ba1-5997-43d4-a713-839f076f490c", "address": "fa:16:3e:ac:26:7d", "network": {"id": "258ca453-3ceb-467a-8fc8-f5d5041c510c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1411807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c817d3d2455ca95902bd1eaea878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00049ba1-59", "ovs_interfaceid": "00049ba1-5997-43d4-a713-839f076f490c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Releasing lock "refresh_cache-84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Instance network_info: |[{"id": "00049ba1-5997-43d4-a713-839f076f490c", "address": "fa:16:3e:ac:26:7d", "network": {"id": "258ca453-3ceb-467a-8fc8-f5d5041c510c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1411807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c817d3d2455ca95902bd1eaea878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00049ba1-59", "ovs_interfaceid": "00049ba1-5997-43d4-a713-839f076f490c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3aa29fb1-b023-49d3-b801-88cb061650b9 req-c0e4ddcf-6d56-4eb7-b0dc-77e0feb30fc5 service nova] Acquired lock "refresh_cache-84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.network.neutron [req-3aa29fb1-b023-49d3-b801-88cb061650b9 req-c0e4ddcf-6d56-4eb7-b0dc-77e0feb30fc5 service nova] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Refreshing network info cache for port 00049ba1-5997-43d4-a713-839f076f490c {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Start _get_guest_xml network_info=[{"id": "00049ba1-5997-43d4-a713-839f076f490c", "address": "fa:16:3e:ac:26:7d", "network": {"id": "258ca453-3ceb-467a-8fc8-f5d5041c510c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1411807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c817d3d2455ca95902bd1eaea878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00049ba1-59", "ovs_interfaceid": "00049ba1-5997-43d4-a713-839f076f490c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:40:35 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:40:35 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:40:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-406316629',display_name='tempest-VolumesActionsTest-instance-406316629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-406316629',id=26,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3735c817d3d2455ca95902bd1eaea878',ramdisk_id='',reservation_id='r-cijvrhw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1275308888',owner_user_name='tempest-VolumesActionsTest-1275308888-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:40:33Z,user_data=None,user_id='40b76f3f670f4808817395410be6d6bf',uuid=84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00049ba1-5997-43d4-a713-839f076f490c", "address": "fa:16:3e:ac:26:7d", "network": {"id": "258ca453-3ceb-467a-8fc8-f5d5041c510c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1411807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c817d3d2455ca95902bd1eaea878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00049ba1-59", "ovs_interfaceid": "00049ba1-5997-43d4-a713-839f076f490c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Converting VIF {"id": "00049ba1-5997-43d4-a713-839f076f490c", "address": "fa:16:3e:ac:26:7d", "network": {"id": "258ca453-3ceb-467a-8fc8-f5d5041c510c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1411807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c817d3d2455ca95902bd1eaea878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00049ba1-59", "ovs_interfaceid": "00049ba1-5997-43d4-a713-839f076f490c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:26:7d,bridge_name='br-int',has_traffic_filtering=True,id=00049ba1-5997-43d4-a713-839f076f490c,network=Network(258ca453-3ceb-467a-8fc8-f5d5041c510c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00049ba1-59') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lazy-loading 'pci_devices' on Instance uuid 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:40:35 user nova-compute[73010]:   <uuid>84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a</uuid>
Aug 15 00:40:35 user nova-compute[73010]:   <name>instance-0000001a</name>
Aug 15 00:40:35 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:40:35 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:40:35 user nova-compute[73010]:   <metadata>
Aug 15 00:40:35 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:40:35 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:40:35 user nova-compute[73010]:       <nova:name>tempest-VolumesActionsTest-instance-406316629</nova:name>
Aug 15 00:40:35 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:40:35</nova:creationTime>
Aug 15 00:40:35 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:40:35 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:40:35 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:40:35 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:40:35 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:40:35 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:40:35 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:40:35 user nova-compute[73010]:       <nova:owner>
Aug 15 00:40:35 user nova-compute[73010]:         <nova:user uuid="40b76f3f670f4808817395410be6d6bf">tempest-VolumesActionsTest-1275308888-project-member</nova:user>
Aug 15 00:40:35 user nova-compute[73010]:         <nova:project uuid="3735c817d3d2455ca95902bd1eaea878">tempest-VolumesActionsTest-1275308888</nova:project>
Aug 15 00:40:35 user nova-compute[73010]:       </nova:owner>
Aug 15 00:40:35 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:40:35 user nova-compute[73010]:       <nova:ports>
Aug 15 00:40:35 user nova-compute[73010]:         <nova:port uuid="00049ba1-5997-43d4-a713-839f076f490c">
Aug 15 00:40:35 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 00:40:35 user nova-compute[73010]:         </nova:port>
Aug 15 00:40:35 user nova-compute[73010]:       </nova:ports>
Aug 15 00:40:35 user nova-compute[73010]:     </nova:instance>
Aug 15 00:40:35 user nova-compute[73010]:   </metadata>
Aug 15 00:40:35 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:40:35 user nova-compute[73010]:     <system>
Aug 15 00:40:35 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:40:35 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:40:35 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:40:35 user nova-compute[73010]:       <entry name="serial">84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a</entry>
Aug 15 00:40:35 user nova-compute[73010]:       <entry name="uuid">84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a</entry>
Aug 15 00:40:35 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:40:35 user nova-compute[73010]:     </system>
Aug 15 00:40:35 user nova-compute[73010]:   </sysinfo>
Aug 15 00:40:35 user nova-compute[73010]:   <os>
Aug 15 00:40:35 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:40:35 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:40:35 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:40:35 user nova-compute[73010]:   </os>
Aug 15 00:40:35 user nova-compute[73010]:   <features>
Aug 15 00:40:35 user nova-compute[73010]:     <acpi/>
Aug 15 00:40:35 user nova-compute[73010]:     <apic/>
Aug 15 00:40:35 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:40:35 user nova-compute[73010]:   </features>
Aug 15 00:40:35 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:40:35 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:40:35 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:40:35 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:40:35 user nova-compute[73010]:   </clock>
Aug 15 00:40:35 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:40:35 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:40:35 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:40:35 user nova-compute[73010]:   </cpu>
Aug 15 00:40:35 user nova-compute[73010]:   <devices>
Aug 15 00:40:35 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:40:35 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:40:35 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a/disk"/>
Aug 15 00:40:35 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:40:35 user nova-compute[73010]:     </disk>
Aug 15 00:40:35 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:40:35 user nova-compute[73010]:       <mac address="fa:16:3e:ac:26:7d"/>
Aug 15 00:40:35 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:40:35 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:40:35 user nova-compute[73010]:       <target dev="tap00049ba1-59"/>
Aug 15 00:40:35 user nova-compute[73010]:     </interface>
Aug 15 00:40:35 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:40:35 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a/console.log" append="off"/>
Aug 15 00:40:35 user nova-compute[73010]:     </serial>
Aug 15 00:40:35 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:40:35 user nova-compute[73010]:     <video>
Aug 15 00:40:35 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:40:35 user nova-compute[73010]:     </video>
Aug 15 00:40:35 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:40:35 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:40:35 user nova-compute[73010]:     </rng>
Aug 15 00:40:35 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:40:35 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:40:35 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:40:35 user nova-compute[73010]:     </memballoon>
Aug 15 00:40:35 user nova-compute[73010]:   </devices>
Aug 15 00:40:35 user nova-compute[73010]: </domain>
Aug 15 00:40:35 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:40:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-406316629',display_name='tempest-VolumesActionsTest-instance-406316629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-406316629',id=26,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3735c817d3d2455ca95902bd1eaea878',ramdisk_id='',reservation_id='r-cijvrhw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1275308888',owner_user_name='tempest-VolumesActionsTest-1275308888-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:40:33Z,user_data=None,user_id='40b76f3f670f4808817395410be6d6bf',uuid=84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00049ba1-5997-43d4-a713-839f076f490c", "address": "fa:16:3e:ac:26:7d", "network": {"id": "258ca453-3ceb-467a-8fc8-f5d5041c510c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1411807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c817d3d2455ca95902bd1eaea878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00049ba1-59", "ovs_interfaceid": "00049ba1-5997-43d4-a713-839f076f490c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Converting VIF {"id": "00049ba1-5997-43d4-a713-839f076f490c", "address": "fa:16:3e:ac:26:7d", "network": {"id": "258ca453-3ceb-467a-8fc8-f5d5041c510c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1411807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c817d3d2455ca95902bd1eaea878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00049ba1-59", "ovs_interfaceid": "00049ba1-5997-43d4-a713-839f076f490c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:26:7d,bridge_name='br-int',has_traffic_filtering=True,id=00049ba1-5997-43d4-a713-839f076f490c,network=Network(258ca453-3ceb-467a-8fc8-f5d5041c510c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00049ba1-59') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG os_vif [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:26:7d,bridge_name='br-int',has_traffic_filtering=True,id=00049ba1-5997-43d4-a713-839f076f490c,network=Network(258ca453-3ceb-467a-8fc8-f5d5041c510c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00049ba1-59') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00049ba1-59, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap00049ba1-59, col_values=(('external_ids', {'iface-id': '00049ba1-5997-43d4-a713-839f076f490c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:26:7d', 'vm-uuid': '84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:35 user nova-compute[73010]: INFO os_vif [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:26:7d,bridge_name='br-int',has_traffic_filtering=True,id=00049ba1-5997-43d4-a713-839f076f490c,network=Network(258ca453-3ceb-467a-8fc8-f5d5041c510c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00049ba1-59')
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] No VIF found with MAC fa:16:3e:ac:26:7d, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.network.neutron [req-3aa29fb1-b023-49d3-b801-88cb061650b9 req-c0e4ddcf-6d56-4eb7-b0dc-77e0feb30fc5 service nova] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Updated VIF entry in instance network info cache for port 00049ba1-5997-43d4-a713-839f076f490c. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG nova.network.neutron [req-3aa29fb1-b023-49d3-b801-88cb061650b9 req-c0e4ddcf-6d56-4eb7-b0dc-77e0feb30fc5 service nova] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Updating instance_info_cache with network_info: [{"id": "00049ba1-5997-43d4-a713-839f076f490c", "address": "fa:16:3e:ac:26:7d", "network": {"id": "258ca453-3ceb-467a-8fc8-f5d5041c510c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1411807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c817d3d2455ca95902bd1eaea878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00049ba1-59", "ovs_interfaceid": "00049ba1-5997-43d4-a713-839f076f490c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:40:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3aa29fb1-b023-49d3-b801-88cb061650b9 req-c0e4ddcf-6d56-4eb7-b0dc-77e0feb30fc5 service nova] Releasing lock "refresh_cache-84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:40:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:37 user nova-compute[73010]: DEBUG nova.compute.manager [req-8b0fb98b-ef99-41ba-8c9c-52c8dce9515e req-c2eb8692-10f7-4d55-9e82-80c79c2c12c5 service nova] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Received event network-vif-plugged-00049ba1-5997-43d4-a713-839f076f490c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-8b0fb98b-ef99-41ba-8c9c-52c8dce9515e req-c2eb8692-10f7-4d55-9e82-80c79c2c12c5 service nova] Acquiring lock "84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-8b0fb98b-ef99-41ba-8c9c-52c8dce9515e req-c2eb8692-10f7-4d55-9e82-80c79c2c12c5 service nova] Lock "84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-8b0fb98b-ef99-41ba-8c9c-52c8dce9515e req-c2eb8692-10f7-4d55-9e82-80c79c2c12c5 service nova] Lock "84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:37 user nova-compute[73010]: DEBUG nova.compute.manager [req-8b0fb98b-ef99-41ba-8c9c-52c8dce9515e req-c2eb8692-10f7-4d55-9e82-80c79c2c12c5 service nova] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] No waiting events found dispatching network-vif-plugged-00049ba1-5997-43d4-a713-839f076f490c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:40:37 user nova-compute[73010]: WARNING nova.compute.manager [req-8b0fb98b-ef99-41ba-8c9c-52c8dce9515e req-c2eb8692-10f7-4d55-9e82-80c79c2c12c5 service nova] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Received unexpected event network-vif-plugged-00049ba1-5997-43d4-a713-839f076f490c for instance with vm_state building and task_state spawning.
Aug 15 00:40:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:39 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060039.2121618, 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:40:39 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] VM Resumed (Lifecycle Event)
Aug 15 00:40:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:40:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:40:39 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Instance spawned successfully.
Aug 15 00:40:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:40:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:40:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:40:39 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:40:39 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060039.2136333, 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:40:39 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] VM Started (Lifecycle Event)
Aug 15 00:40:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:40:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:40:39 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:40:39 user nova-compute[73010]: DEBUG nova.compute.manager [req-7fdb366d-fd3d-4a7b-ba90-9b4b30ef20e7 req-d2b928e5-5d4c-4111-b4c5-357e3999c814 service nova] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Received event network-vif-plugged-00049ba1-5997-43d4-a713-839f076f490c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7fdb366d-fd3d-4a7b-ba90-9b4b30ef20e7 req-d2b928e5-5d4c-4111-b4c5-357e3999c814 service nova] Acquiring lock "84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7fdb366d-fd3d-4a7b-ba90-9b4b30ef20e7 req-d2b928e5-5d4c-4111-b4c5-357e3999c814 service nova] Lock "84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7fdb366d-fd3d-4a7b-ba90-9b4b30ef20e7 req-d2b928e5-5d4c-4111-b4c5-357e3999c814 service nova] Lock "84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:39 user nova-compute[73010]: DEBUG nova.compute.manager [req-7fdb366d-fd3d-4a7b-ba90-9b4b30ef20e7 req-d2b928e5-5d4c-4111-b4c5-357e3999c814 service nova] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] No waiting events found dispatching network-vif-plugged-00049ba1-5997-43d4-a713-839f076f490c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:40:39 user nova-compute[73010]: WARNING nova.compute.manager [req-7fdb366d-fd3d-4a7b-ba90-9b4b30ef20e7 req-d2b928e5-5d4c-4111-b4c5-357e3999c814 service nova] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Received unexpected event network-vif-plugged-00049ba1-5997-43d4-a713-839f076f490c for instance with vm_state building and task_state spawning.
Aug 15 00:40:39 user nova-compute[73010]: INFO nova.compute.manager [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Took 5.88 seconds to spawn the instance on the hypervisor.
Aug 15 00:40:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:40:39 user nova-compute[73010]: INFO nova.compute.manager [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Took 6.91 seconds to build instance.
Aug 15 00:40:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f449defe-b24d-484b-b875-60193b87b5b1 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.063s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "4b5baaac-bb54-462c-b833-4f37de8f24dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:44 user nova-compute[73010]: DEBUG nova.compute.manager [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:40:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:44 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:40:44 user nova-compute[73010]: INFO nova.compute.claims [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Claim successful on node user
Aug 15 00:40:45 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:40:45 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:40:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:45 user nova-compute[73010]: DEBUG nova.compute.manager [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:40:45 user nova-compute[73010]: DEBUG nova.compute.manager [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:40:45 user nova-compute[73010]: DEBUG nova.network.neutron [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:40:45 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:40:45 user nova-compute[73010]: DEBUG nova.compute.manager [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:40:45 user nova-compute[73010]: DEBUG nova.compute.manager [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:40:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:40:45 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Creating image(s)
Aug 15 00:40:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "/opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "/opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:45 user nova-compute[73010]: DEBUG nova.policy [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0e48e71bb404f26926ac7a8176e04bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13115a64ccc24df68bdfda1fc72399c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:40:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.195s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.205s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk 1073741824" returned: 0 in 0.068s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "983577b5-4abb-4280-b8e8-a63f42d8f796" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:46 user nova-compute[73010]: INFO nova.compute.manager [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Terminating instance
Aug 15 00:40:46 user nova-compute[73010]: DEBUG nova.compute.manager [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.338s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Cannot resize image /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG nova.objects.instance [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lazy-loading 'migration_context' on Instance uuid 4b5baaac-bb54-462c-b833-4f37de8f24dc {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Ensure instance console log exists: /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG nova.network.neutron [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Successfully created port: bf9a1845-c225-4c08-bc5a-929ebdceda57 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG nova.compute.manager [req-2746fe22-54de-4463-b634-ed02f7e0af31 req-bcb3f7c0-3460-475d-b12c-c9d7c41f9e4a service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received event network-vif-unplugged-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2746fe22-54de-4463-b634-ed02f7e0af31 req-bcb3f7c0-3460-475d-b12c-c9d7c41f9e4a service nova] Acquiring lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2746fe22-54de-4463-b634-ed02f7e0af31 req-bcb3f7c0-3460-475d-b12c-c9d7c41f9e4a service nova] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2746fe22-54de-4463-b634-ed02f7e0af31 req-bcb3f7c0-3460-475d-b12c-c9d7c41f9e4a service nova] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG nova.compute.manager [req-2746fe22-54de-4463-b634-ed02f7e0af31 req-bcb3f7c0-3460-475d-b12c-c9d7c41f9e4a service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] No waiting events found dispatching network-vif-unplugged-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:40:46 user nova-compute[73010]: DEBUG nova.compute.manager [req-2746fe22-54de-4463-b634-ed02f7e0af31 req-bcb3f7c0-3460-475d-b12c-c9d7c41f9e4a service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received event network-vif-unplugged-ba4444c9-ca0d-4265-a567-f931f42b3115 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:40:47 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Instance destroyed successfully.
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.objects.instance [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lazy-loading 'resources' on Instance uuid 983577b5-4abb-4280-b8e8-a63f42d8f796 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1216295700',display_name='tempest-ServerActionsTestOtherB-server-1216295700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1216295700',id=2,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVoikkIiX9fqlWUgAuNi/64W1pPax2fim7TT4ZilB7kZJFBTddrjL8mZ+9EedRXSwMMm3xZIb3UP53hHNu173Z0/TxgKI44bIEdZkISEoJSalzaVJQjVXA5W+j4ISJAVA==',key_name='tempest-keypair-1664333158',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:38:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1588cfc0b04643a881de076bea2e23b5',ramdisk_id='',reservation_id='r-t3ok78f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-594907864',owner_user_name='tempest-ServerActionsTestOtherB-594907864-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:38:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5e4be2f71154849a225adb0628fa70e',uuid=983577b5-4abb-4280-b8e8-a63f42d8f796,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Converting VIF {"id": "ba4444c9-ca0d-4265-a567-f931f42b3115", "address": "fa:16:3e:b9:64:22", "network": {"id": "25ddd6d0-e3f6-4a35-b15f-a41da18091ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-176102819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1588cfc0b04643a881de076bea2e23b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4444c9-ca", "ovs_interfaceid": "ba4444c9-ca0d-4265-a567-f931f42b3115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:64:22,bridge_name='br-int',has_traffic_filtering=True,id=ba4444c9-ca0d-4265-a567-f931f42b3115,network=Network(25ddd6d0-e3f6-4a35-b15f-a41da18091ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4444c9-ca') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG os_vif [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:64:22,bridge_name='br-int',has_traffic_filtering=True,id=ba4444c9-ca0d-4265-a567-f931f42b3115,network=Network(25ddd6d0-e3f6-4a35-b15f-a41da18091ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4444c9-ca') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba4444c9-ca, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:40:47 user nova-compute[73010]: INFO os_vif [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:64:22,bridge_name='br-int',has_traffic_filtering=True,id=ba4444c9-ca0d-4265-a567-f931f42b3115,network=Network(25ddd6d0-e3f6-4a35-b15f-a41da18091ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4444c9-ca')
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AZTKRHrL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:40:47 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:40:47 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[671e131a-17ee-4976-bab9-469282423506]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e2c57b-5877-4c07-a1c4-5d5fda3881ce]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)
Aug 15 00:40:47 user nova-compute[73010]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:40:47 user nova-compute[73010]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:40:47 user nova-compute[73010]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:40:47 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)
Aug 15 00:40:47 user nova-compute[73010]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 (non-flash)
Aug 15 00:40:47 user nova-compute[73010]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:40:47 user nova-compute[73010]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:40:47 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec305c3910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4'): ({'sdc'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Removing single pathed devices sdc {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[51da64f2-0704-4aa7-a2f4-fba29de89dc1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e9ea07-02ef-45a6-ade1-3ad25fcbc9a1]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Flushing IO for device /dev/sdc {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5cd807-00bd-46cd-8512-5a4d4c456945]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c762e326-b674-47ce-83a1-d5b753abb221]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] SCSI volumes sdc have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e692736-b4df-443f-a18a-46a0be7a483b]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.network.neutron [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Successfully updated port: bf9a1845-c225-4c08-bc5a-929ebdceda57 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f485b817-1319-4f08-9a64-bf249ba1c81e]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4, portal: 172.16.0.220,3260]
Aug 15 00:40:47 user nova-compute[73010]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4, portal: 172.16.0.220,3260] successful.
Aug 15 00:40:47 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "refresh_cache-4b5baaac-bb54-462c-b833-4f37de8f24dc" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquired lock "refresh_cache-4b5baaac-bb54-462c-b833-4f37de8f24dc" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.network.neutron [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ddadda-c939-425a-bcb3-4e454e0db7f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27e6eec-b05c-4333-a378-85f0c96f9df3]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] <== disconnect_volume: return (307ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:40:47 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Deleting instance files /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796_del
Aug 15 00:40:47 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Deletion of /opt/stack/data/nova/instances/983577b5-4abb-4280-b8e8-a63f42d8f796_del complete
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.compute.manager [req-1373c049-4b9b-4395-82b0-f68a9fcce255 req-bf3f00e1-e8bf-480d-b54f-91f225a913a7 service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Received event network-changed-bf9a1845-c225-4c08-bc5a-929ebdceda57 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.compute.manager [req-1373c049-4b9b-4395-82b0-f68a9fcce255 req-bf3f00e1-e8bf-480d-b54f-91f225a913a7 service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Refreshing instance network info cache due to event network-changed-bf9a1845-c225-4c08-bc5a-929ebdceda57. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1373c049-4b9b-4395-82b0-f68a9fcce255 req-bf3f00e1-e8bf-480d-b54f-91f225a913a7 service nova] Acquiring lock "refresh_cache-4b5baaac-bb54-462c-b833-4f37de8f24dc" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.network.neutron [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:40:47 user nova-compute[73010]: INFO nova.compute.manager [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Took 1.51 seconds to destroy the instance on the hypervisor.
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.network.neutron [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Updating instance_info_cache with network_info: [{"id": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "address": "fa:16:3e:ec:63:2a", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9a1845-c2", "ovs_interfaceid": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Releasing lock "refresh_cache-4b5baaac-bb54-462c-b833-4f37de8f24dc" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Instance network_info: |[{"id": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "address": "fa:16:3e:ec:63:2a", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9a1845-c2", "ovs_interfaceid": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1373c049-4b9b-4395-82b0-f68a9fcce255 req-bf3f00e1-e8bf-480d-b54f-91f225a913a7 service nova] Acquired lock "refresh_cache-4b5baaac-bb54-462c-b833-4f37de8f24dc" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.network.neutron [req-1373c049-4b9b-4395-82b0-f68a9fcce255 req-bf3f00e1-e8bf-480d-b54f-91f225a913a7 service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Refreshing network info cache for port bf9a1845-c225-4c08-bc5a-929ebdceda57 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Start _get_guest_xml network_info=[{"id": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "address": "fa:16:3e:ec:63:2a", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9a1845-c2", "ovs_interfaceid": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:47 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:40:47 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:40:47 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-943819205',display_name='tempest-tempest.common.compute-instance-943819205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-943819205',id=27,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz9vv0hqGajePOZ+2oXviFPXzQK2KEcWfvP3fM07mI8g1goyyeZFkU5ISIVRZy9AWkrpm4V0CqGkVIurRbtfDkxSjm0VLFyN90TKUeEwHZdHfqNj3wkXYudQjaCa9ggDg==',key_name='tempest-keypair-1595777815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13115a64ccc24df68bdfda1fc72399c4',ramdisk_id='',reservation_id='r-2xbqlkxi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-671712537',owner_user_name='tempest-ServerActionsTestOtherA-671712537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0e48e71bb404f26926ac7a8176e04bb',uuid=4b5baaac-bb54-462c-b833-4f37de8f24dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "address": "fa:16:3e:ec:63:2a", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9a1845-c2", "ovs_interfaceid": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converting VIF {"id": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "address": "fa:16:3e:ec:63:2a", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9a1845-c2", "ovs_interfaceid": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:63:2a,bridge_name='br-int',has_traffic_filtering=True,id=bf9a1845-c225-4c08-bc5a-929ebdceda57,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9a1845-c2') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG nova.objects.instance [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b5baaac-bb54-462c-b833-4f37de8f24dc {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:40:48 user nova-compute[73010]:   <uuid>4b5baaac-bb54-462c-b833-4f37de8f24dc</uuid>
Aug 15 00:40:48 user nova-compute[73010]:   <name>instance-0000001b</name>
Aug 15 00:40:48 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:40:48 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:40:48 user nova-compute[73010]:   <metadata>
Aug 15 00:40:48 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:40:48 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:40:48 user nova-compute[73010]:       <nova:name>tempest-tempest.common.compute-instance-943819205</nova:name>
Aug 15 00:40:48 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:40:47</nova:creationTime>
Aug 15 00:40:48 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:40:48 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:40:48 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:40:48 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:40:48 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:40:48 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:40:48 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:40:48 user nova-compute[73010]:       <nova:owner>
Aug 15 00:40:48 user nova-compute[73010]:         <nova:user uuid="b0e48e71bb404f26926ac7a8176e04bb">tempest-ServerActionsTestOtherA-671712537-project-member</nova:user>
Aug 15 00:40:48 user nova-compute[73010]:         <nova:project uuid="13115a64ccc24df68bdfda1fc72399c4">tempest-ServerActionsTestOtherA-671712537</nova:project>
Aug 15 00:40:48 user nova-compute[73010]:       </nova:owner>
Aug 15 00:40:48 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:40:48 user nova-compute[73010]:       <nova:ports>
Aug 15 00:40:48 user nova-compute[73010]:         <nova:port uuid="bf9a1845-c225-4c08-bc5a-929ebdceda57">
Aug 15 00:40:48 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 00:40:48 user nova-compute[73010]:         </nova:port>
Aug 15 00:40:48 user nova-compute[73010]:       </nova:ports>
Aug 15 00:40:48 user nova-compute[73010]:     </nova:instance>
Aug 15 00:40:48 user nova-compute[73010]:   </metadata>
Aug 15 00:40:48 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:40:48 user nova-compute[73010]:     <system>
Aug 15 00:40:48 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:40:48 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:40:48 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:40:48 user nova-compute[73010]:       <entry name="serial">4b5baaac-bb54-462c-b833-4f37de8f24dc</entry>
Aug 15 00:40:48 user nova-compute[73010]:       <entry name="uuid">4b5baaac-bb54-462c-b833-4f37de8f24dc</entry>
Aug 15 00:40:48 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:40:48 user nova-compute[73010]:     </system>
Aug 15 00:40:48 user nova-compute[73010]:   </sysinfo>
Aug 15 00:40:48 user nova-compute[73010]:   <os>
Aug 15 00:40:48 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:40:48 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:40:48 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:40:48 user nova-compute[73010]:   </os>
Aug 15 00:40:48 user nova-compute[73010]:   <features>
Aug 15 00:40:48 user nova-compute[73010]:     <acpi/>
Aug 15 00:40:48 user nova-compute[73010]:     <apic/>
Aug 15 00:40:48 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:40:48 user nova-compute[73010]:   </features>
Aug 15 00:40:48 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:40:48 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:40:48 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:40:48 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:40:48 user nova-compute[73010]:   </clock>
Aug 15 00:40:48 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:40:48 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:40:48 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:40:48 user nova-compute[73010]:   </cpu>
Aug 15 00:40:48 user nova-compute[73010]:   <devices>
Aug 15 00:40:48 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:40:48 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:40:48 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk"/>
Aug 15 00:40:48 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:40:48 user nova-compute[73010]:     </disk>
Aug 15 00:40:48 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:40:48 user nova-compute[73010]:       <mac address="fa:16:3e:ec:63:2a"/>
Aug 15 00:40:48 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:40:48 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:40:48 user nova-compute[73010]:       <target dev="tapbf9a1845-c2"/>
Aug 15 00:40:48 user nova-compute[73010]:     </interface>
Aug 15 00:40:48 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:40:48 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/console.log" append="off"/>
Aug 15 00:40:48 user nova-compute[73010]:     </serial>
Aug 15 00:40:48 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:40:48 user nova-compute[73010]:     <video>
Aug 15 00:40:48 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:40:48 user nova-compute[73010]:     </video>
Aug 15 00:40:48 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:40:48 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:40:48 user nova-compute[73010]:     </rng>
Aug 15 00:40:48 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:40:48 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:40:48 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:40:48 user nova-compute[73010]:     </memballoon>
Aug 15 00:40:48 user nova-compute[73010]:   </devices>
Aug 15 00:40:48 user nova-compute[73010]: </domain>
Aug 15 00:40:48 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-943819205',display_name='tempest-tempest.common.compute-instance-943819205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-943819205',id=27,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz9vv0hqGajePOZ+2oXviFPXzQK2KEcWfvP3fM07mI8g1goyyeZFkU5ISIVRZy9AWkrpm4V0CqGkVIurRbtfDkxSjm0VLFyN90TKUeEwHZdHfqNj3wkXYudQjaCa9ggDg==',key_name='tempest-keypair-1595777815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13115a64ccc24df68bdfda1fc72399c4',ramdisk_id='',reservation_id='r-2xbqlkxi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-671712537',owner_user_name='tempest-ServerActionsTestOtherA-671712537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0e48e71bb404f26926ac7a8176e04bb',uuid=4b5baaac-bb54-462c-b833-4f37de8f24dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "address": "fa:16:3e:ec:63:2a", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9a1845-c2", "ovs_interfaceid": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converting VIF {"id": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "address": "fa:16:3e:ec:63:2a", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9a1845-c2", "ovs_interfaceid": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:63:2a,bridge_name='br-int',has_traffic_filtering=True,id=bf9a1845-c225-4c08-bc5a-929ebdceda57,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9a1845-c2') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG os_vif [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:63:2a,bridge_name='br-int',has_traffic_filtering=True,id=bf9a1845-c225-4c08-bc5a-929ebdceda57,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9a1845-c2') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf9a1845-c2, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf9a1845-c2, col_values=(('external_ids', {'iface-id': 'bf9a1845-c225-4c08-bc5a-929ebdceda57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:63:2a', 'vm-uuid': '4b5baaac-bb54-462c-b833-4f37de8f24dc'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:48 user nova-compute[73010]: INFO os_vif [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:63:2a,bridge_name='br-int',has_traffic_filtering=True,id=bf9a1845-c225-4c08-bc5a-929ebdceda57,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9a1845-c2')
Aug 15 00:40:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] No VIF found with MAC fa:16:3e:ec:63:2a, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG nova.network.neutron [req-1373c049-4b9b-4395-82b0-f68a9fcce255 req-bf3f00e1-e8bf-480d-b54f-91f225a913a7 service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Updated VIF entry in instance network info cache for port bf9a1845-c225-4c08-bc5a-929ebdceda57. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG nova.network.neutron [req-1373c049-4b9b-4395-82b0-f68a9fcce255 req-bf3f00e1-e8bf-480d-b54f-91f225a913a7 service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Updating instance_info_cache with network_info: [{"id": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "address": "fa:16:3e:ec:63:2a", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9a1845-c2", "ovs_interfaceid": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1373c049-4b9b-4395-82b0-f68a9fcce255 req-bf3f00e1-e8bf-480d-b54f-91f225a913a7 service nova] Releasing lock "refresh_cache-4b5baaac-bb54-462c-b833-4f37de8f24dc" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG nova.compute.manager [req-15d2aac3-391e-4f21-b73b-b35d042425b7 req-b4070907-24c1-415e-bece-80529963b033 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received event network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-15d2aac3-391e-4f21-b73b-b35d042425b7 req-b4070907-24c1-415e-bece-80529963b033 service nova] Acquiring lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-15d2aac3-391e-4f21-b73b-b35d042425b7 req-b4070907-24c1-415e-bece-80529963b033 service nova] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-15d2aac3-391e-4f21-b73b-b35d042425b7 req-b4070907-24c1-415e-bece-80529963b033 service nova] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG nova.compute.manager [req-15d2aac3-391e-4f21-b73b-b35d042425b7 req-b4070907-24c1-415e-bece-80529963b033 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] No waiting events found dispatching network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:40:48 user nova-compute[73010]: WARNING nova.compute.manager [req-15d2aac3-391e-4f21-b73b-b35d042425b7 req-b4070907-24c1-415e-bece-80529963b033 service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received unexpected event network-vif-plugged-ba4444c9-ca0d-4265-a567-f931f42b3115 for instance with vm_state active and task_state deleting.
Aug 15 00:40:48 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:40:48 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Took 1.06 seconds to deallocate network for instance.
Aug 15 00:40:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:40:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:49 user nova-compute[73010]: INFO nova.compute.manager [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Took 0.80 seconds to detach 1 volumes for instance.
Aug 15 00:40:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:50 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:40:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:50 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:40:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.664s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:50 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Deleted allocations for instance 983577b5-4abb-4280-b8e8-a63f42d8f796
Aug 15 00:40:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5671bc2e-cd3a-4997-ac02-fb1c9a392cd6 tempest-ServerActionsTestOtherB-594907864 tempest-ServerActionsTestOtherB-594907864-project-member] Lock "983577b5-4abb-4280-b8e8-a63f42d8f796" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.363s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:50 user nova-compute[73010]: DEBUG nova.compute.manager [req-c768561b-7957-4b20-a6c7-5ed28353c2d4 req-4ca297fb-1b35-4506-b34e-ccd309f44b7c service nova] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Received event network-vif-deleted-ba4444c9-ca0d-4265-a567-f931f42b3115 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:50 user nova-compute[73010]: DEBUG nova.compute.manager [req-c768561b-7957-4b20-a6c7-5ed28353c2d4 req-4ca297fb-1b35-4506-b34e-ccd309f44b7c service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Received event network-vif-plugged-bf9a1845-c225-4c08-bc5a-929ebdceda57 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c768561b-7957-4b20-a6c7-5ed28353c2d4 req-4ca297fb-1b35-4506-b34e-ccd309f44b7c service nova] Acquiring lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c768561b-7957-4b20-a6c7-5ed28353c2d4 req-4ca297fb-1b35-4506-b34e-ccd309f44b7c service nova] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c768561b-7957-4b20-a6c7-5ed28353c2d4 req-4ca297fb-1b35-4506-b34e-ccd309f44b7c service nova] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:50 user nova-compute[73010]: DEBUG nova.compute.manager [req-c768561b-7957-4b20-a6c7-5ed28353c2d4 req-4ca297fb-1b35-4506-b34e-ccd309f44b7c service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] No waiting events found dispatching network-vif-plugged-bf9a1845-c225-4c08-bc5a-929ebdceda57 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:40:50 user nova-compute[73010]: WARNING nova.compute.manager [req-c768561b-7957-4b20-a6c7-5ed28353c2d4 req-4ca297fb-1b35-4506-b34e-ccd309f44b7c service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Received unexpected event network-vif-plugged-bf9a1845-c225-4c08-bc5a-929ebdceda57 for instance with vm_state building and task_state spawning.
Aug 15 00:40:50 user nova-compute[73010]: DEBUG nova.compute.manager [req-c768561b-7957-4b20-a6c7-5ed28353c2d4 req-4ca297fb-1b35-4506-b34e-ccd309f44b7c service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Received event network-vif-plugged-bf9a1845-c225-4c08-bc5a-929ebdceda57 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:40:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c768561b-7957-4b20-a6c7-5ed28353c2d4 req-4ca297fb-1b35-4506-b34e-ccd309f44b7c service nova] Acquiring lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c768561b-7957-4b20-a6c7-5ed28353c2d4 req-4ca297fb-1b35-4506-b34e-ccd309f44b7c service nova] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c768561b-7957-4b20-a6c7-5ed28353c2d4 req-4ca297fb-1b35-4506-b34e-ccd309f44b7c service nova] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:50 user nova-compute[73010]: DEBUG nova.compute.manager [req-c768561b-7957-4b20-a6c7-5ed28353c2d4 req-4ca297fb-1b35-4506-b34e-ccd309f44b7c service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] No waiting events found dispatching network-vif-plugged-bf9a1845-c225-4c08-bc5a-929ebdceda57 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:40:50 user nova-compute[73010]: WARNING nova.compute.manager [req-c768561b-7957-4b20-a6c7-5ed28353c2d4 req-4ca297fb-1b35-4506-b34e-ccd309f44b7c service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Received unexpected event network-vif-plugged-bf9a1845-c225-4c08-bc5a-929ebdceda57 for instance with vm_state building and task_state spawning.
Aug 15 00:40:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.321s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060051.9010844, 4b5baaac-bb54-462c-b833-4f37de8f24dc => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:40:52 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] VM Resumed (Lifecycle Event)
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.compute.manager [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:40:52 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:40:52 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=6814MB free_disk=25.526756286621094GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:40:52 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Instance spawned successfully.
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:40:52 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060051.9019344, 4b5baaac-bb54-462c-b833-4f37de8f24dc => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:40:52 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] VM Started (Lifecycle Event)
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:40:52 user nova-compute[73010]: INFO nova.compute.manager [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Took 7.14 seconds to spawn the instance on the hypervisor.
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.compute.manager [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:40:52 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance afcd0a05-e035-492e-9fbe-cd63f4c3ea42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance e2410ee7-7351-460a-8d9c-47fe54e08c8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance dde74512-c8c3-436c-a6dc-a9327340229e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6dfc356b-953a-47b0-9da7-70cc59a80853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6bf89433-15f9-44fd-a4c1-00b72287f65f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 009d9050-1720-45de-8bc9-16f404e65911 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance eec545e8-eeda-443c-9892-980e19e7267a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4b489f97-c8d4-4a6a-8404-e1a05a990261 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 98fa0e64-cf36-4991-924d-ba4b713239d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4b5baaac-bb54-462c-b833-4f37de8f24dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:40:52 user nova-compute[73010]: INFO nova.compute.manager [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Took 8.03 seconds to build instance.
Aug 15 00:40:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62c3efea-0d81-4faf-acc4-7fefe7260ece tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.136s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:40:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.623s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "dde74512-c8c3-436c-a6dc-a9327340229e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "dde74512-c8c3-436c-a6dc-a9327340229e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:40:54 user nova-compute[73010]: INFO nova.compute.manager [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Detaching volume 37f5c72a-3808-437e-93b5-428de784e195
Aug 15 00:40:54 user nova-compute[73010]: INFO nova.virt.block_device [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Attempting to driver detach volume 37f5c72a-3808-437e-93b5-428de784e195 from mountpoint /dev/vdb
Aug 15 00:40:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Attempting to detach device vdb from instance dde74512-c8c3-436c-a6dc-a9327340229e from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:40:54 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:40:54 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:40:54 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:40:54 user nova-compute[73010]:   <serial>37f5c72a-3808-437e-93b5-428de784e195</serial>
Aug 15 00:40:54 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:40:54 user nova-compute[73010]: </disk>
Aug 15 00:40:54 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:40:54 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Successfully detached device vdb from instance dde74512-c8c3-436c-a6dc-a9327340229e from the persistent domain config.
Aug 15 00:40:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dde74512-c8c3-436c-a6dc-a9327340229e from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:40:54 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:40:54 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:40:54 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:40:54 user nova-compute[73010]:   <serial>37f5c72a-3808-437e-93b5-428de784e195</serial>
Aug 15 00:40:54 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:40:54 user nova-compute[73010]: </disk>
Aug 15 00:40:54 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692060054.8298216, dde74512-c8c3-436c-a6dc-a9327340229e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dde74512-c8c3-436c-a6dc-a9327340229e {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:40:54 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Successfully detached device vdb from instance dde74512-c8c3-436c-a6dc-a9327340229e from the live domain config.
Aug 15 00:40:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AZpjzPJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:40:54 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:40:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[451d1564-34fe-4720-9c9f-4e2bed0e0ec4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a45d84c-37e7-48f0-a5e5-c57d2c446eb0]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)
Aug 15 00:40:54 user nova-compute[73010]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:40:54 user nova-compute[73010]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:40:54 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 (non-flash)
Aug 15 00:40:54 user nova-compute[73010]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:40:54 user nova-compute[73010]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:40:54 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec503a7e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195'): ({'sdb'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Removing single pathed devices sdb {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[375026bd-dd70-4332-a803-d95f7a6a46a4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de5ca1d-b3f3-46e6-ba49-d767ccee0e10]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Flushing IO for device /dev/sdb {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b49b2d0-24d9-44fe-a83e-3d417a591d48]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:40:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3b9c58-d844-4a34-acf5-704bcf77f3f8]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d87725-31d0-4615-9dba-faa9f56b51c0]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e3cf5e-ffda-481f-a2de-f09d6c2fc13e]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195, portal: 172.16.0.220,3260]
Aug 15 00:40:55 user nova-compute[73010]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195, portal: 172.16.0.220,3260] successful.
Aug 15 00:40:55 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f5c72a-3808-437e-93b5-428de784e195 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b435fdf-1aab-4d8a-88f8-4398b540276c]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] <== disconnect_volume: return (338ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG nova.objects.instance [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lazy-loading 'flavor' on Instance uuid dde74512-c8c3-436c-a6dc-a9327340229e {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:40:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:40:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-906be569-9cb6-47ae-aa57-a91287f47db0 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "dde74512-c8c3-436c-a6dc-a9327340229e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.881s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:40:56 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:40:56 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:40:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-dde74512-c8c3-436c-a6dc-a9327340229e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:40:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-dde74512-c8c3-436c-a6dc-a9327340229e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:40:56 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 00:40:57 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Updating instance_info_cache with network_info: [{"id": "68f235d2-055a-40e8-a4ab-09e33974f4ac", "address": "fa:16:3e:8b:20:c2", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f235d2-05", "ovs_interfaceid": "68f235d2-055a-40e8-a4ab-09e33974f4ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:40:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-dde74512-c8c3-436c-a6dc-a9327340229e" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:40:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 00:40:57 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:40:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:40:58 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:41:00 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:41:01 user nova-compute[73010]: DEBUG nova.compute.manager [req-628a2c1c-df96-4e0f-933e-57620ce19c63 req-c36657b1-4af5-419a-8fda-4a80db9e84ab service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Received event network-changed-1ba74d11-2708-46c3-b73c-def3200202e4 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:41:01 user nova-compute[73010]: DEBUG nova.compute.manager [req-628a2c1c-df96-4e0f-933e-57620ce19c63 req-c36657b1-4af5-419a-8fda-4a80db9e84ab service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Refreshing instance network info cache due to event network-changed-1ba74d11-2708-46c3-b73c-def3200202e4. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:41:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-628a2c1c-df96-4e0f-933e-57620ce19c63 req-c36657b1-4af5-419a-8fda-4a80db9e84ab service nova] Acquiring lock "refresh_cache-e2410ee7-7351-460a-8d9c-47fe54e08c8b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:41:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-628a2c1c-df96-4e0f-933e-57620ce19c63 req-c36657b1-4af5-419a-8fda-4a80db9e84ab service nova] Acquired lock "refresh_cache-e2410ee7-7351-460a-8d9c-47fe54e08c8b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:41:01 user nova-compute[73010]: DEBUG nova.network.neutron [req-628a2c1c-df96-4e0f-933e-57620ce19c63 req-c36657b1-4af5-419a-8fda-4a80db9e84ab service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Refreshing network info cache for port 1ba74d11-2708-46c3-b73c-def3200202e4 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:41:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a09504c3-d8d3-4528-8b8d-2ef822bb9fce tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a09504c3-d8d3-4528-8b8d-2ef822bb9fce tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a09504c3-d8d3-4528-8b8d-2ef822bb9fce tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a09504c3-d8d3-4528-8b8d-2ef822bb9fce tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a09504c3-d8d3-4528-8b8d-2ef822bb9fce tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:01 user nova-compute[73010]: INFO nova.compute.manager [None req-a09504c3-d8d3-4528-8b8d-2ef822bb9fce tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Terminating instance
Aug 15 00:41:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-a09504c3-d8d3-4528-8b8d-2ef822bb9fce tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:41:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:02 user nova-compute[73010]: DEBUG nova.network.neutron [req-628a2c1c-df96-4e0f-933e-57620ce19c63 req-c36657b1-4af5-419a-8fda-4a80db9e84ab service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Updated VIF entry in instance network info cache for port 1ba74d11-2708-46c3-b73c-def3200202e4. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:41:02 user nova-compute[73010]: DEBUG nova.network.neutron [req-628a2c1c-df96-4e0f-933e-57620ce19c63 req-c36657b1-4af5-419a-8fda-4a80db9e84ab service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Updating instance_info_cache with network_info: [{"id": "1ba74d11-2708-46c3-b73c-def3200202e4", "address": "fa:16:3e:c5:b2:68", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba74d11-27", "ovs_interfaceid": "1ba74d11-2708-46c3-b73c-def3200202e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:41:02 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060047.1511154, 983577b5-4abb-4280-b8e8-a63f42d8f796 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:41:02 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] VM Stopped (Lifecycle Event)
Aug 15 00:41:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-628a2c1c-df96-4e0f-933e-57620ce19c63 req-c36657b1-4af5-419a-8fda-4a80db9e84ab service nova] Releasing lock "refresh_cache-e2410ee7-7351-460a-8d9c-47fe54e08c8b" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:41:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-96df3de4-b882-47e2-8249-e70190449d6b None None] [instance: 983577b5-4abb-4280-b8e8-a63f42d8f796] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:41:02 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Instance destroyed successfully.
Aug 15 00:41:02 user nova-compute[73010]: DEBUG nova.objects.instance [None req-a09504c3-d8d3-4528-8b8d-2ef822bb9fce tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lazy-loading 'resources' on Instance uuid e2410ee7-7351-460a-8d9c-47fe54e08c8b {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:41:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-a09504c3-d8d3-4528-8b8d-2ef822bb9fce tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-94659044',display_name='tempest-TestStampPattern-server-94659044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-94659044',id=11,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrgFYRcqv6WgRdkBOunRQ1m/LgpwWxam7rDA0+KqfC3W5QB65YWRrvkhgBL/Sf+IJhFzjvTZJIwpzP4EtbE6dhqqF6WJsQneEfsmdXlIDI2l5CiQq/L0gFEvj2zfmLvMA==',key_name='tempest-TestStampPattern-362830252',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:33:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d0f162c9493416db7cfab122c4050af',ramdisk_id='',reservation_id='r-clyy18qi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1617621274',owner_user_name='tempest-TestStampPattern-1617621274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:36:54Z,user_data=None,user_id='456d295a0dfd4e96848eb4e0ce9e5604',uuid=e2410ee7-7351-460a-8d9c-47fe54e08c8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ba74d11-2708-46c3-b73c-def3200202e4", "address": "fa:16:3e:c5:b2:68", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba74d11-27", "ovs_interfaceid": "1ba74d11-2708-46c3-b73c-def3200202e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:41:02 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-a09504c3-d8d3-4528-8b8d-2ef822bb9fce tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Converting VIF {"id": "1ba74d11-2708-46c3-b73c-def3200202e4", "address": "fa:16:3e:c5:b2:68", "network": {"id": "a0e0995e-1753-4a7a-825f-76c1938b2d94", "bridge": "br-int", "label": "tempest-TestStampPattern-1236984461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0f162c9493416db7cfab122c4050af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ba74d11-27", "ovs_interfaceid": "1ba74d11-2708-46c3-b73c-def3200202e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:41:02 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-a09504c3-d8d3-4528-8b8d-2ef822bb9fce tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:b2:68,bridge_name='br-int',has_traffic_filtering=True,id=1ba74d11-2708-46c3-b73c-def3200202e4,network=Network(a0e0995e-1753-4a7a-825f-76c1938b2d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ba74d11-27') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:41:02 user nova-compute[73010]: DEBUG os_vif [None req-a09504c3-d8d3-4528-8b8d-2ef822bb9fce tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:b2:68,bridge_name='br-int',has_traffic_filtering=True,id=1ba74d11-2708-46c3-b73c-def3200202e4,network=Network(a0e0995e-1753-4a7a-825f-76c1938b2d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ba74d11-27') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:41:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ba74d11-27, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:41:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:41:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:02 user nova-compute[73010]: INFO os_vif [None req-a09504c3-d8d3-4528-8b8d-2ef822bb9fce tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:b2:68,bridge_name='br-int',has_traffic_filtering=True,id=1ba74d11-2708-46c3-b73c-def3200202e4,network=Network(a0e0995e-1753-4a7a-825f-76c1938b2d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ba74d11-27')
Aug 15 00:41:02 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-a09504c3-d8d3-4528-8b8d-2ef822bb9fce tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Deleting instance files /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b_del
Aug 15 00:41:02 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-a09504c3-d8d3-4528-8b8d-2ef822bb9fce tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Deletion of /opt/stack/data/nova/instances/e2410ee7-7351-460a-8d9c-47fe54e08c8b_del complete
Aug 15 00:41:02 user nova-compute[73010]: INFO nova.compute.manager [None req-a09504c3-d8d3-4528-8b8d-2ef822bb9fce tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 15 00:41:02 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-a09504c3-d8d3-4528-8b8d-2ef822bb9fce tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:41:02 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:41:02 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:41:02 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:41:02 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Took 0.46 seconds to deallocate network for instance.
Aug 15 00:41:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-4b5e205f-6823-40ee-ac87-3470b4599013 req-03b9b729-60a2-466e-97d5-40b48bbfced6 service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Received event network-vif-deleted-1ba74d11-2708-46c3-b73c-def3200202e4 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:41:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a09504c3-d8d3-4528-8b8d-2ef822bb9fce tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a09504c3-d8d3-4528-8b8d-2ef822bb9fce tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:03 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-a09504c3-d8d3-4528-8b8d-2ef822bb9fce tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:41:03 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-a09504c3-d8d3-4528-8b8d-2ef822bb9fce tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:41:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a09504c3-d8d3-4528-8b8d-2ef822bb9fce tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:03 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-a09504c3-d8d3-4528-8b8d-2ef822bb9fce tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Deleted allocations for instance e2410ee7-7351-460a-8d9c-47fe54e08c8b
Aug 15 00:41:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a09504c3-d8d3-4528-8b8d-2ef822bb9fce tempest-TestStampPattern-1617621274 tempest-TestStampPattern-1617621274-project-member] Lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.952s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:03 user nova-compute[73010]: DEBUG nova.compute.manager [req-dca6c3ce-f557-42bc-8426-c6a27e8fba8f req-a9b92c31-4900-4736-bc3b-21318a6a55c8 service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Received event network-vif-unplugged-1ba74d11-2708-46c3-b73c-def3200202e4 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:41:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dca6c3ce-f557-42bc-8426-c6a27e8fba8f req-a9b92c31-4900-4736-bc3b-21318a6a55c8 service nova] Acquiring lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dca6c3ce-f557-42bc-8426-c6a27e8fba8f req-a9b92c31-4900-4736-bc3b-21318a6a55c8 service nova] Lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dca6c3ce-f557-42bc-8426-c6a27e8fba8f req-a9b92c31-4900-4736-bc3b-21318a6a55c8 service nova] Lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:03 user nova-compute[73010]: DEBUG nova.compute.manager [req-dca6c3ce-f557-42bc-8426-c6a27e8fba8f req-a9b92c31-4900-4736-bc3b-21318a6a55c8 service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] No waiting events found dispatching network-vif-unplugged-1ba74d11-2708-46c3-b73c-def3200202e4 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:41:03 user nova-compute[73010]: WARNING nova.compute.manager [req-dca6c3ce-f557-42bc-8426-c6a27e8fba8f req-a9b92c31-4900-4736-bc3b-21318a6a55c8 service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Received unexpected event network-vif-unplugged-1ba74d11-2708-46c3-b73c-def3200202e4 for instance with vm_state deleted and task_state None.
Aug 15 00:41:03 user nova-compute[73010]: DEBUG nova.compute.manager [req-dca6c3ce-f557-42bc-8426-c6a27e8fba8f req-a9b92c31-4900-4736-bc3b-21318a6a55c8 service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Received event network-vif-plugged-1ba74d11-2708-46c3-b73c-def3200202e4 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:41:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dca6c3ce-f557-42bc-8426-c6a27e8fba8f req-a9b92c31-4900-4736-bc3b-21318a6a55c8 service nova] Acquiring lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dca6c3ce-f557-42bc-8426-c6a27e8fba8f req-a9b92c31-4900-4736-bc3b-21318a6a55c8 service nova] Lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dca6c3ce-f557-42bc-8426-c6a27e8fba8f req-a9b92c31-4900-4736-bc3b-21318a6a55c8 service nova] Lock "e2410ee7-7351-460a-8d9c-47fe54e08c8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:03 user nova-compute[73010]: DEBUG nova.compute.manager [req-dca6c3ce-f557-42bc-8426-c6a27e8fba8f req-a9b92c31-4900-4736-bc3b-21318a6a55c8 service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] No waiting events found dispatching network-vif-plugged-1ba74d11-2708-46c3-b73c-def3200202e4 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:41:03 user nova-compute[73010]: WARNING nova.compute.manager [req-dca6c3ce-f557-42bc-8426-c6a27e8fba8f req-a9b92c31-4900-4736-bc3b-21318a6a55c8 service nova] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Received unexpected event network-vif-plugged-1ba74d11-2708-46c3-b73c-def3200202e4 for instance with vm_state deleted and task_state None.
Aug 15 00:41:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:17 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060062.2797153, e2410ee7-7351-460a-8d9c-47fe54e08c8b => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:41:17 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] VM Stopped (Lifecycle Event)
Aug 15 00:41:17 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86fcaf11-6b0f-45c4-98ae-30d64cca577e None None] [instance: e2410ee7-7351-460a-8d9c-47fe54e08c8b] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:41:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquiring lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:22 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lazy-loading 'flavor' on Instance uuid f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:41:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquiring lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:22 user nova-compute[73010]: INFO nova.compute.manager [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Attaching volume 8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 to /dev/vdb
Aug 15 00:41:22 user nova-compute[73010]: DEBUG os_brick.utils [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:41:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[95449ec0-a771-4064-b5e5-7cb03e207613]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacd1ed4-a457-4119-974c-fc6fa7c75373]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7af40ad-cfbe-4906-8720-56dc364705f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c430353-8345-48a4-a3c1-2e75e3ac48e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:41:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:41:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:41:23 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:41:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d84f59-1046-401e-ba70-699264018246]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:41:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:41:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:41:23 user nova-compute[73010]: DEBUG os_brick.utils [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:41:23 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Updating existing volume attachment record: f6c227b0-de15-4231-b0b0-11c2017dca3b {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:41:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AELlQJDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:41:31 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:41:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:41:31 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:41:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:41:31 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:41:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c215b0-c868-4215-ad7a-36ef24239640]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:41:31 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea7b900-774c-4ade-94b3-d58f546ae22a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132] added
Aug 15 00:41:31 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfd77c7-2437-40ae-9295-6c99e431a0a5]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[092e0707-feb2-4cc1-a3ab-fa9fa11fbe9f]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AELlQJDd {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AELlQJDd" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5fda04-eba0-4ea2-b7bc-eac63e32a577]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AELlQJDd'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe2b833-d819-49a5-a0a6-61a312a1e1fa]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d449c40b-37a6-46f4-80e2-e60253999a07]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:41:31 user nova-compute[73010]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:41:31 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:41:31 user nova-compute[73010]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:41:31 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:41:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5d10f3-449f-4953-9629-b979e90c9bf6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132, portal: 172.16.0.220,3260]
Aug 15 00:41:32 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132, portal: 172.16.0.220,3260] successful.
Aug 15 00:41:32 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:41:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7e843a-c4fe-459e-b00b-fc1b7744c9cb]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:41:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad1ed54-48a3-4052-8e2b-bd39accbaded]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:41:32 user nova-compute[73010]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:41:32 user nova-compute[73010]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:41:32 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:41:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:41:32 user nova-compute[73010]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:41:32 user nova-compute[73010]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:41:32 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:41:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:41:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:41:32 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:41:32 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:41:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[056c653c-e1e6-4905-82d4-130388db936b]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:32 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:41:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AELlQJDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:41:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:41:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:41:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23136326536326132', 'path': '/dev/sdb'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:41:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136326536326132', 'path': '/dev/sdb'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:41:33 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lazy-loading 'flavor' on Instance uuid f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:41:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:41:33 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:41:33 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:41:33 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:41:33 user nova-compute[73010]:   <serial>8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132</serial>
Aug 15 00:41:33 user nova-compute[73010]: </disk>
Aug 15 00:41:33 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:41:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:41:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:41:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] No VIF found with MAC fa:16:3e:71:55:dd, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:41:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f2027ee6-a082-42c3-846a-af346630a1af tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.828s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:34 user nova-compute[73010]: INFO nova.compute.manager [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Rescuing
Aug 15 00:41:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquiring lock "refresh_cache-f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:41:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquired lock "refresh_cache-f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:41:34 user nova-compute[73010]: DEBUG nova.network.neutron [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:41:35 user nova-compute[73010]: DEBUG nova.network.neutron [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Updating instance_info_cache with network_info: [{"id": "5db62e1b-e013-4958-8470-da256258503d", "address": "fa:16:3e:71:55:dd", "network": {"id": "22954f6c-78d2-40d7-91fc-1e8eb0881e40", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1057005040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadfec8dd5ed4c8b8c8730c98b2711ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db62e1b-e0", "ovs_interfaceid": "5db62e1b-e013-4958-8470-da256258503d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:41:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Releasing lock "refresh_cache-f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:41:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:35 user nova-compute[73010]: DEBUG nova.compute.manager [req-301b1b9a-9522-4b36-8326-60560efbda8c req-17bf75ca-2cdb-4dd4-98ea-e54682e26cb6 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Received event network-changed-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:41:35 user nova-compute[73010]: DEBUG nova.compute.manager [req-301b1b9a-9522-4b36-8326-60560efbda8c req-17bf75ca-2cdb-4dd4-98ea-e54682e26cb6 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Refreshing instance network info cache due to event network-changed-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:41:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-301b1b9a-9522-4b36-8326-60560efbda8c req-17bf75ca-2cdb-4dd4-98ea-e54682e26cb6 service nova] Acquiring lock "refresh_cache-6bf89433-15f9-44fd-a4c1-00b72287f65f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:41:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-301b1b9a-9522-4b36-8326-60560efbda8c req-17bf75ca-2cdb-4dd4-98ea-e54682e26cb6 service nova] Acquired lock "refresh_cache-6bf89433-15f9-44fd-a4c1-00b72287f65f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:41:35 user nova-compute[73010]: DEBUG nova.network.neutron [req-301b1b9a-9522-4b36-8326-60560efbda8c req-17bf75ca-2cdb-4dd4-98ea-e54682e26cb6 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Refreshing network info cache for port f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:41:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:36 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Instance destroyed successfully.
Aug 15 00:41:36 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Attempting a stable device rescue
Aug 15 00:41:36 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73010) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 00:41:36 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Instance directory exists: not creating {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 00:41:36 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Creating image(s)
Aug 15 00:41:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquiring lock "/opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "/opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "/opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:36 user nova-compute[73010]: DEBUG nova.objects.instance [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lazy-loading 'trusted_certs' on Instance uuid f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:41:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquiring lock "c8adac5dacf92c3c2d3b84c8bc78817a3a69b79b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "c8adac5dacf92c3c2d3b84c8bc78817a3a69b79b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8adac5dacf92c3c2d3b84c8bc78817a3a69b79b.part --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:37 user nova-compute[73010]: INFO nova.compute.manager [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Rebuilding instance
Aug 15 00:41:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8adac5dacf92c3c2d3b84c8bc78817a3a69b79b.part --force-share --output=json" returned: 0 in 0.359s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG nova.virt.images [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] da67c58a-4764-4ca4-9c8a-54c13d1f89c5 was qcow2, converting to raw {{(pid=73010) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG nova.privsep.utils [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73010) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c8adac5dacf92c3c2d3b84c8bc78817a3a69b79b.part /opt/stack/data/nova/instances/_base/c8adac5dacf92c3c2d3b84c8bc78817a3a69b79b.converted {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG nova.network.neutron [req-301b1b9a-9522-4b36-8326-60560efbda8c req-17bf75ca-2cdb-4dd4-98ea-e54682e26cb6 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Updated VIF entry in instance network info cache for port f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG nova.network.neutron [req-301b1b9a-9522-4b36-8326-60560efbda8c req-17bf75ca-2cdb-4dd4-98ea-e54682e26cb6 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Updating instance_info_cache with network_info: [{"id": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "address": "fa:16:3e:e1:57:94", "network": {"id": "df55f352-d3b0-4133-939b-74d35a420b49", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159866404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869253a2da7e4e95bb720ab7b203284c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c6a8bc-4f", "ovs_interfaceid": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-301b1b9a-9522-4b36-8326-60560efbda8c req-17bf75ca-2cdb-4dd4-98ea-e54682e26cb6 service nova] Releasing lock "refresh_cache-6bf89433-15f9-44fd-a4c1-00b72287f65f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6bf89433-15f9-44fd-a4c1-00b72287f65f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c8adac5dacf92c3c2d3b84c8bc78817a3a69b79b.part /opt/stack/data/nova/instances/_base/c8adac5dacf92c3c2d3b84c8bc78817a3a69b79b.converted" returned: 0 in 0.185s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8adac5dacf92c3c2d3b84c8bc78817a3a69b79b.converted --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lazy-loading 'pci_requests' on Instance uuid 6bf89433-15f9-44fd-a4c1-00b72287f65f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lazy-loading 'pci_devices' on Instance uuid 6bf89433-15f9-44fd-a4c1-00b72287f65f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lazy-loading 'resources' on Instance uuid 6bf89433-15f9-44fd-a4c1-00b72287f65f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lazy-loading 'migration_context' on Instance uuid 6bf89433-15f9-44fd-a4c1-00b72287f65f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG nova.compute.manager [req-e352c9b6-f8e6-4761-810f-fb3d17cd35b9 req-5d89d98e-46ec-4610-8c67-ef791a1782d0 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received event network-vif-unplugged-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e352c9b6-f8e6-4761-810f-fb3d17cd35b9 req-5d89d98e-46ec-4610-8c67-ef791a1782d0 service nova] Acquiring lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e352c9b6-f8e6-4761-810f-fb3d17cd35b9 req-5d89d98e-46ec-4610-8c67-ef791a1782d0 service nova] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e352c9b6-f8e6-4761-810f-fb3d17cd35b9 req-5d89d98e-46ec-4610-8c67-ef791a1782d0 service nova] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG nova.compute.manager [req-e352c9b6-f8e6-4761-810f-fb3d17cd35b9 req-5d89d98e-46ec-4610-8c67-ef791a1782d0 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] No waiting events found dispatching network-vif-unplugged-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:41:37 user nova-compute[73010]: WARNING nova.compute.manager [req-e352c9b6-f8e6-4761-810f-fb3d17cd35b9 req-5d89d98e-46ec-4610-8c67-ef791a1782d0 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received unexpected event network-vif-unplugged-5db62e1b-e013-4958-8470-da256258503d for instance with vm_state active and task_state rescuing.
Aug 15 00:41:37 user nova-compute[73010]: DEBUG nova.compute.manager [req-e352c9b6-f8e6-4761-810f-fb3d17cd35b9 req-5d89d98e-46ec-4610-8c67-ef791a1782d0 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received event network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e352c9b6-f8e6-4761-810f-fb3d17cd35b9 req-5d89d98e-46ec-4610-8c67-ef791a1782d0 service nova] Acquiring lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e352c9b6-f8e6-4761-810f-fb3d17cd35b9 req-5d89d98e-46ec-4610-8c67-ef791a1782d0 service nova] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e352c9b6-f8e6-4761-810f-fb3d17cd35b9 req-5d89d98e-46ec-4610-8c67-ef791a1782d0 service nova] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG nova.compute.manager [req-e352c9b6-f8e6-4761-810f-fb3d17cd35b9 req-5d89d98e-46ec-4610-8c67-ef791a1782d0 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] No waiting events found dispatching network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:41:37 user nova-compute[73010]: WARNING nova.compute.manager [req-e352c9b6-f8e6-4761-810f-fb3d17cd35b9 req-5d89d98e-46ec-4610-8c67-ef791a1782d0 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received unexpected event network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d for instance with vm_state active and task_state rescuing.
Aug 15 00:41:37 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73010) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8adac5dacf92c3c2d3b84c8bc78817a3a69b79b.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "c8adac5dacf92c3c2d3b84c8bc78817a3a69b79b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.611s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquiring lock "c8adac5dacf92c3c2d3b84c8bc78817a3a69b79b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "c8adac5dacf92c3c2d3b84c8bc78817a3a69b79b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8adac5dacf92c3c2d3b84c8bc78817a3a69b79b --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8adac5dacf92c3c2d3b84c8bc78817a3a69b79b --force-share --output=json" returned: 0 in 0.207s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8adac5dacf92c3c2d3b84c8bc78817a3a69b79b,backing_fmt=raw /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk.rescue {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.compute.manager [req-c598cc60-a33d-4457-a2c4-209042a27645 req-dcff2445-cb08-4c36-8fed-b3fe25404a1d service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Received event network-vif-unplugged-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c598cc60-a33d-4457-a2c4-209042a27645 req-dcff2445-cb08-4c36-8fed-b3fe25404a1d service nova] Acquiring lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c598cc60-a33d-4457-a2c4-209042a27645 req-dcff2445-cb08-4c36-8fed-b3fe25404a1d service nova] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c598cc60-a33d-4457-a2c4-209042a27645 req-dcff2445-cb08-4c36-8fed-b3fe25404a1d service nova] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.compute.manager [req-c598cc60-a33d-4457-a2c4-209042a27645 req-dcff2445-cb08-4c36-8fed-b3fe25404a1d service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] No waiting events found dispatching network-vif-unplugged-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:41:38 user nova-compute[73010]: WARNING nova.compute.manager [req-c598cc60-a33d-4457-a2c4-209042a27645 req-dcff2445-cb08-4c36-8fed-b3fe25404a1d service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Received unexpected event network-vif-unplugged-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 for instance with vm_state active and task_state rebuilding.
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8adac5dacf92c3c2d3b84c8bc78817a3a69b79b,backing_fmt=raw /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk.rescue" returned: 0 in 0.071s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "c8adac5dacf92c3c2d3b84c8bc78817a3a69b79b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.objects.instance [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lazy-loading 'migration_context' on Instance uuid f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Start _get_guest_xml network_info=[{"id": "5db62e1b-e013-4958-8470-da256258503d", "address": "fa:16:3e:71:55:dd", "network": {"id": "22954f6c-78d2-40d7-91fc-1e8eb0881e40", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1057005040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1057005040-network", "vif_mac": "fa:16:3e:71:55:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadfec8dd5ed4c8b8c8730c98b2711ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db62e1b-e0", "ovs_interfaceid": "5db62e1b-e013-4958-8470-da256258503d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'da67c58a-4764-4ca4-9c8a-54c13d1f89c5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AELlQJDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f22d29a4-26d1-4bfd-acf7-80dcdbc4d889', 'attached_at': '', 'detached_at': '', 'volume_id': '8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132', 'serial': '8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132'}, 'disk_bus': 'virtio', 'attachment_id': 'f6c227b0-de15-4231-b0b0-11c2017dca3b', 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.objects.instance [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lazy-loading 'resources' on Instance uuid f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.objects.instance [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lazy-loading 'numa_topology' on Instance uuid f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:41:38 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:41:38 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.objects.instance [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lazy-loading 'vcpu_model' on Instance uuid f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AELlQJDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:41:38 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:41:38 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:41:38 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc77433-3236-46c3-a285-f93c434d565c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = AELlQJDd\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 00:41:38 user nova-compute[73010]: node.name = iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132
Aug 15 00:41:38 user nova-compute[73010]: node.tpgt = -1
Aug 15 00:41:38 user nova-compute[73010]: node.startup = automatic
Aug 15 00:41:38 user nova-compute[73010]: node.leading_login = No
Aug 15 00:41:38 user nova-compute[73010]: iface.iscsi_ifacename = default
Aug 15 00:41:38 user nova-compute[73010]: iface.net_ifacename = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.ipaddress = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.prefix_len = 0
Aug 15 00:41:38 user nova-compute[73010]: iface.hwaddress = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.transport_name = tcp
Aug 15 00:41:38 user nova-compute[73010]: iface.initiatorname = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.state = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.vlan_id = 0
Aug 15 00:41:38 user nova-compute[73010]: iface.vlan_priority = 0
Aug 15 00:41:38 user nova-compute[73010]: iface.vlan_state = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.iface_num = 0
Aug 15 00:41:38 user nova-compute[73010]: iface.mtu = 0
Aug 15 00:41:38 user nova-compute[73010]: iface.port = 0
Aug 15 00:41:38 user nova-compute[73010]: iface.bootproto = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.subnet_mask = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.gateway = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.dhcp_alt_client_id = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.dhcp_dns = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.dhcp_learn_iqn = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.dhcp_vendor_id_state = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.dhcp_vendor_id = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.dhcp_slp_da = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.fragmentation = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.gratuitous_arp = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.incoming_forwarding = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.tos_state = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.tos = 0
Aug 15 00:41:38 user nova-compute[73010]: iface.ttl = 0
Aug 15 00:41:38 user nova-compute[73010]: iface.delayed_ack = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.tcp_nagle = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.tcp_wsf_state = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.tcp_wsf = 0
Aug 15 00:41:38 user nova-compute[73010]: iface.tcp_timer_scale = 0
Aug 15 00:41:38 user nova-compute[73010]: iface.tcp_timestamp = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.redirect = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.def_task_mgmt_timeout = 0
Aug 15 00:41:38 user nova-compute[73010]: iface.header_digest = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.data_digest = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.immediate_data = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.initial_r2t = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.data_seq_inorder = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.data_pdu_inorder = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.erl = 0
Aug 15 00:41:38 user nova-compute[73010]: iface.max_receive_data_len = 0
Aug 15 00:41:38 user nova-compute[73010]: iface.first_burst_len = 0
Aug 15 00:41:38 user nova-compute[73010]: iface.max_outstanding_r2t = 0
Aug 15 00:41:38 user nova-compute[73010]: iface.max_burst_len = 0
Aug 15 00:41:38 user nova-compute[73010]: iface.chap_auth = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.bidi_chap = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.strict_login_compliance = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.discovery_auth = <empty>
Aug 15 00:41:38 user nova-compute[73010]: iface.discovery_logout = <empty>
Aug 15 00:41:38 user nova-compute[73010]: node.discovery_address = <empty>
Aug 15 00:41:38 user nova-compute[73010]: node.discovery_port = 0
Aug 15 00:41:38 user nova-compute[73010]: node.discovery_type = static
Aug 15 00:41:38 user nova-compute[73010]: node.session.initial_cmdsn = 0
Aug 15 00:41:38 user nova-compute[73010]: node.session.initial_login_retry_max = 8
Aug 15 00:41:38 user nova-compute[73010]: node.session.xmit_thread_priority = -20
Aug 15 00:41:38 user nova-compute[73010]: node.session.cmds_max = 128
Aug 15 00:41:38 user nova-compute[73010]: node.session.queue_depth = 32
Aug 15 00:41:38 user nova-compute[73010]: node.session.nr_sessions = 1
Aug 15 00:41:38 user nova-compute[73010]: node.session.auth.authmethod = CHAP
Aug 15 00:41:38 user nova-compute[73010]: node.session.auth.username = AELlQJDd
Aug 15 00:41:38 user nova-compute[73010]: node.session.auth.password = ***
Aug 15 00:41:38 user nova-compute[73010]: node.session.auth.username_in = <empty>
Aug 15 00:41:38 user nova-compute[73010]: node.session.auth.password_in = <empty>
Aug 15 00:41:38 user nova-compute[73010]: node.session.auth.chap_algs = MD5
Aug 15 00:41:38 user nova-compute[73010]: node.session.timeo.replacement_timeout = 120
Aug 15 00:41:38 user nova-compute[73010]: node.session.err_timeo.abort_timeout = 15
Aug 15 00:41:38 user nova-compute[73010]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 00:41:38 user nova-compute[73010]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 00:41:38 user nova-compute[73010]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 00:41:38 user nova-compute[73010]: node.session.iscsi.FastAbort = Yes
Aug 15 00:41:38 user nova-compute[73010]: node.session.iscsi.InitialR2T = No
Aug 15 00:41:38 user nova-compute[73010]: node.session.iscsi.ImmediateData = Yes
Aug 15 00:41:38 user nova-compute[73010]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 00:41:38 user nova-compute[73010]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 00:41:38 user nova-compute[73010]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 00:41:38 user nova-compute[73010]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 00:41:38 user nova-compute[73010]: node.session.iscsi.MaxConnections = 1
Aug 15 00:41:38 user nova-compute[73010]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 00:41:38 user nova-compute[73010]: node.session.iscsi.ERL = 0
Aug 15 00:41:38 user nova-compute[73010]: node.session.scan = manual
Aug 15 00:41:38 user nova-compute[73010]: node.session.reopen_max = 0
Aug 15 00:41:38 user nova-compute[73010]: node.conn[0].address = 172.16.0.220
Aug 15 00:41:38 user nova-compute[73010]: node.conn[0].port = 3260
Aug 15 00:41:38 user nova-compute[73010]: node.conn[0].startup = manual
Aug 15 00:41:38 user nova-compute[73010]: node.conn[0].tcp.window_size = 524288
Aug 15 00:41:38 user nova-compute[73010]: node.conn[0].tcp.type_of_service = 0
Aug 15 00:41:38 user nova-compute[73010]: node.conn[0].timeo.logout_timeout = 15
Aug 15 00:41:38 user nova-compute[73010]: node.conn[0].timeo.login_timeout = 15
Aug 15 00:41:38 user nova-compute[73010]: node.conn[0].timeo.auth_timeout = 45
Aug 15 00:41:38 user nova-compute[73010]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 00:41:38 user nova-compute[73010]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 00:41:38 user nova-compute[73010]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 00:41:38 user nova-compute[73010]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 00:41:38 user nova-compute[73010]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 00:41:38 user nova-compute[73010]: node.conn[0].iscsi.DataDigest = None
Aug 15 00:41:38 user nova-compute[73010]: node.conn[0].iscsi.IFMarker = No
Aug 15 00:41:38 user nova-compute[73010]: node.conn[0].iscsi.OFMarker = No
Aug 15 00:41:38 user nova-compute[73010]: # END RECORD
Aug 15 00:41:38 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca76b75-d1bd-4ae5-93ff-e49534a32145]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c142113-54e9-4dc1-ab55-e09bc27ac512]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AELlQJDd {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AELlQJDd" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dd43d3-496c-45f1-a1b7-63dbae037cd0]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AELlQJDd'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[94312345-d48e-401b-b5b6-5719e63d12d2]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb1c645-0e28-4719-94b7-554acef85e20]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:41:38 user nova-compute[73010]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:41:38 user nova-compute[73010]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:41:38 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:41:38 user nova-compute[73010]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:41:38 user nova-compute[73010]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:41:38 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.150s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] HCTL ('33', '0', '0', 0) found on session 30 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6782da17-3407-40bb-847c-5cb386b4e2d6]: (4, ('0 0 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Searching for a device in session 30 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AELlQJDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.174s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] <== connect_volume: return (176ms) {'type': 'block', 'scsi_wwn': '23136326536326132', 'path': '/dev/sdb'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136326536326132', 'path': '/dev/sdb'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:37:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-187035777',display_name='tempest-ServerStableDeviceRescueTest-server-187035777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-187035777',id=18,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl48HAmcfFRrH0rUkUHs/8dSGQIF1uCxQEyzMtTaxr3R25Tjk85cbgCHshsmycnRK+vD67hffvzQCcRdwaXrKsXIdJGDiJmiNMcQzgqMkHe9ej/2bb6LdarHKVQSu8gAg==',key_name='tempest-keypair-1148060121',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:37:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aadfec8dd5ed4c8b8c8730c98b2711ff',ramdisk_id='',reservation_id='r-rd3n8zy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1325761686',owner_user_name='tempest-ServerStableDeviceRescueTest-1325761686-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:39:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0256395ac9eb4654932c0fe37dea75c1',uuid=f22d29a4-26d1-4bfd-acf7-80dcdbc4d889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5db62e1b-e013-4958-8470-da256258503d", "address": "fa:16:3e:71:55:dd", "network": {"id": "22954f6c-78d2-40d7-91fc-1e8eb0881e40", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1057005040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1057005040-network", "vif_mac": "fa:16:3e:71:55:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadfec8dd5ed4c8b8c8730c98b2711ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db62e1b-e0", "ovs_interfaceid": "5db62e1b-e013-4958-8470-da256258503d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Converting VIF {"id": "5db62e1b-e013-4958-8470-da256258503d", "address": "fa:16:3e:71:55:dd", "network": {"id": "22954f6c-78d2-40d7-91fc-1e8eb0881e40", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1057005040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1057005040-network", "vif_mac": "fa:16:3e:71:55:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadfec8dd5ed4c8b8c8730c98b2711ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db62e1b-e0", "ovs_interfaceid": "5db62e1b-e013-4958-8470-da256258503d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:55:dd,bridge_name='br-int',has_traffic_filtering=True,id=5db62e1b-e013-4958-8470-da256258503d,network=Network(22954f6c-78d2-40d7-91fc-1e8eb0881e40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db62e1b-e0') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.objects.instance [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lazy-loading 'pci_devices' on Instance uuid f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:41:38 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Instance destroyed successfully.
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:41:38 user nova-compute[73010]:   <uuid>f22d29a4-26d1-4bfd-acf7-80dcdbc4d889</uuid>
Aug 15 00:41:38 user nova-compute[73010]:   <name>instance-00000012</name>
Aug 15 00:41:38 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:41:38 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:41:38 user nova-compute[73010]:   <metadata>
Aug 15 00:41:38 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:41:38 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:41:38 user nova-compute[73010]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-187035777</nova:name>
Aug 15 00:41:38 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:41:38</nova:creationTime>
Aug 15 00:41:38 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:41:38 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:41:38 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:41:38 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:41:38 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:41:38 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:41:38 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:41:38 user nova-compute[73010]:       <nova:owner>
Aug 15 00:41:38 user nova-compute[73010]:         <nova:user uuid="0256395ac9eb4654932c0fe37dea75c1">tempest-ServerStableDeviceRescueTest-1325761686-project-member</nova:user>
Aug 15 00:41:38 user nova-compute[73010]:         <nova:project uuid="aadfec8dd5ed4c8b8c8730c98b2711ff">tempest-ServerStableDeviceRescueTest-1325761686</nova:project>
Aug 15 00:41:38 user nova-compute[73010]:       </nova:owner>
Aug 15 00:41:38 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:41:38 user nova-compute[73010]:       <nova:ports>
Aug 15 00:41:38 user nova-compute[73010]:         <nova:port uuid="5db62e1b-e013-4958-8470-da256258503d">
Aug 15 00:41:38 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 00:41:38 user nova-compute[73010]:         </nova:port>
Aug 15 00:41:38 user nova-compute[73010]:       </nova:ports>
Aug 15 00:41:38 user nova-compute[73010]:     </nova:instance>
Aug 15 00:41:38 user nova-compute[73010]:   </metadata>
Aug 15 00:41:38 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:41:38 user nova-compute[73010]:     <system>
Aug 15 00:41:38 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:41:38 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:41:38 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:41:38 user nova-compute[73010]:       <entry name="serial">f22d29a4-26d1-4bfd-acf7-80dcdbc4d889</entry>
Aug 15 00:41:38 user nova-compute[73010]:       <entry name="uuid">f22d29a4-26d1-4bfd-acf7-80dcdbc4d889</entry>
Aug 15 00:41:38 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:41:38 user nova-compute[73010]:     </system>
Aug 15 00:41:38 user nova-compute[73010]:   </sysinfo>
Aug 15 00:41:38 user nova-compute[73010]:   <os>
Aug 15 00:41:38 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:41:38 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:41:38 user nova-compute[73010]:   </os>
Aug 15 00:41:38 user nova-compute[73010]:   <features>
Aug 15 00:41:38 user nova-compute[73010]:     <acpi/>
Aug 15 00:41:38 user nova-compute[73010]:     <apic/>
Aug 15 00:41:38 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:41:38 user nova-compute[73010]:   </features>
Aug 15 00:41:38 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:41:38 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:41:38 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:41:38 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:41:38 user nova-compute[73010]:   </clock>
Aug 15 00:41:38 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:41:38 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:41:38 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:41:38 user nova-compute[73010]:   </cpu>
Aug 15 00:41:38 user nova-compute[73010]:   <devices>
Aug 15 00:41:38 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:41:38 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:41:38 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk"/>
Aug 15 00:41:38 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:41:38 user nova-compute[73010]:     </disk>
Aug 15 00:41:38 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 00:41:38 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:41:38 user nova-compute[73010]:       <source dev="/dev/sdb"/>
Aug 15 00:41:38 user nova-compute[73010]:       <target dev="vdb" bus="virtio"/>
Aug 15 00:41:38 user nova-compute[73010]:       <serial>8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132</serial>
Aug 15 00:41:38 user nova-compute[73010]:     </disk>
Aug 15 00:41:38 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:41:38 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:41:38 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk.rescue"/>
Aug 15 00:41:38 user nova-compute[73010]:       <target dev="vdc" bus="virtio"/>
Aug 15 00:41:38 user nova-compute[73010]:       <boot order="1"/>
Aug 15 00:41:38 user nova-compute[73010]:     </disk>
Aug 15 00:41:38 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:41:38 user nova-compute[73010]:       <mac address="fa:16:3e:71:55:dd"/>
Aug 15 00:41:38 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:41:38 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:41:38 user nova-compute[73010]:       <target dev="tap5db62e1b-e0"/>
Aug 15 00:41:38 user nova-compute[73010]:     </interface>
Aug 15 00:41:38 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:41:38 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/console.log" append="off"/>
Aug 15 00:41:38 user nova-compute[73010]:     </serial>
Aug 15 00:41:38 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:41:38 user nova-compute[73010]:     <video>
Aug 15 00:41:38 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:41:38 user nova-compute[73010]:     </video>
Aug 15 00:41:38 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:41:38 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:41:38 user nova-compute[73010]:     </rng>
Aug 15 00:41:38 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:41:38 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:41:38 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:41:38 user nova-compute[73010]:     </memballoon>
Aug 15 00:41:38 user nova-compute[73010]:   </devices>
Aug 15 00:41:38 user nova-compute[73010]: </domain>
Aug 15 00:41:38 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:41:38 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Instance destroyed successfully.
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:39:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1847309333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-100459501',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMvoU/VZ3MSVvKPEfl46VySM54g5gxjuVwvlv2ViBOX1qb9sxUhG896E4HXK1GlhKtb8cZiIme4xtoJu/nd/1zEHxtFmbxdZPCP6Pee/6tKM6u6rfoWMfAG7Psx72fYJg==',key_name='tempest-keypair-848269880',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:40:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='869253a2da7e4e95bb720ab7b203284c',ramdisk_id='',reservation_id='r-xs10r9gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-710111316',owner_user_name='tempest-ServerActionsV293TestJSON-710111316-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:41:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19782b910361424ba7740c41f9331814',uuid=6bf89433-15f9-44fd-a4c1-00b72287f65f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "address": "fa:16:3e:e1:57:94", "network": {"id": "df55f352-d3b0-4133-939b-74d35a420b49", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159866404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869253a2da7e4e95bb720ab7b203284c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c6a8bc-4f", "ovs_interfaceid": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Converting VIF {"id": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "address": "fa:16:3e:e1:57:94", "network": {"id": "df55f352-d3b0-4133-939b-74d35a420b49", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159866404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869253a2da7e4e95bb720ab7b203284c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c6a8bc-4f", "ovs_interfaceid": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:57:94,bridge_name='br-int',has_traffic_filtering=True,id=f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8,network=Network(df55f352-d3b0-4133-939b-74d35a420b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c6a8bc-4f') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_vif [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:57:94,bridge_name='br-int',has_traffic_filtering=True,id=f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8,network=Network(df55f352-d3b0-4133-939b-74d35a420b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c6a8bc-4f') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5c6a8bc-4f, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:41:38 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Instance destroyed successfully.
Aug 15 00:41:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:38 user nova-compute[73010]: INFO os_vif [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:57:94,bridge_name='br-int',has_traffic_filtering=True,id=f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8,network=Network(df55f352-d3b0-4133-939b-74d35a420b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c6a8bc-4f')
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpZGkKBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:41:38 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6058323-2614-4e7e-a7de-98717867df87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] No VIF found with MAC fa:16:3e:71:55:dd, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3aa4cd8-ecb8-43e6-8af2-905ecf29c86c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:41:38 user nova-compute[73010]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:41:38 user nova-compute[73010]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:41:38 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:41:38 user nova-compute[73010]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:41:38 user nova-compute[73010]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:41:38 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec304ae7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c'): ({'sdd'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Removing single pathed devices sdd {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97835b8-4a51-4c3b-91ef-1f926c7d204b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[40387a12-ebe3-4f5e-98c9-8e9179f9a236]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Flushing IO for device /dev/sdd {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b34e5b6-37b1-4bd8-88ff-e043f8c2a166]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8c9824-ff0a-4c6e-80d6-a266b424d8c3]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] SCSI volumes sdd have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[21065403-3075-464f-88b4-399ffbc8f485]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8236ac6a-606a-4510-ab3f-0fe7eeab0e65]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c, portal: 172.16.0.220,3260]
Aug 15 00:41:38 user nova-compute[73010]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c, portal: 172.16.0.220,3260] successful.
Aug 15 00:41:38 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:41:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:39 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd55bc64-6d0b-414f-b7fb-9107041d3f2d]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:41:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:41:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] <== disconnect_volume: return (302ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:41:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:41:39 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Deleting instance files /opt/stack/data/nova/instances/6bf89433-15f9-44fd-a4c1-00b72287f65f_del
Aug 15 00:41:39 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Deletion of /opt/stack/data/nova/instances/6bf89433-15f9-44fd-a4c1-00b72287f65f_del complete
Aug 15 00:41:39 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 6bf89433-15f9-44fd-a4c1-00b72287f65f could not be found.
Aug 15 00:41:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:41:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpZGkKBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:41:39 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 00:41:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:41:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:41:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:41:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:39 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7172ce66-8436-46c3-a5d2-324c8c0f4408]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:39 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[262f34b0-97f3-40c7-b458-395d1576ea2b]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:41:39 user nova-compute[73010]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:41:39 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:41:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:41:39 user nova-compute[73010]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:41:39 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:41:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec30553760>, {}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:41:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Disconnecting from: [] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:41:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.046s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:41:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] <== disconnect_volume: return (47ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:41:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:41:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:40 user nova-compute[73010]: DEBUG nova.compute.manager [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Preparing to wait for external event volume-reimaged-83bdf3fa-8592-419d-90c9-a3d7a56f1a2c {{(pid=73010) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 15 00:41:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Acquiring lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:40 user nova-compute[73010]: DEBUG nova.compute.manager [req-644b7f29-4248-40e7-8d77-bbae52a08109 req-b711f7e8-bcef-4bb1-8d05-b5a27a96edca service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received event network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:41:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-644b7f29-4248-40e7-8d77-bbae52a08109 req-b711f7e8-bcef-4bb1-8d05-b5a27a96edca service nova] Acquiring lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-644b7f29-4248-40e7-8d77-bbae52a08109 req-b711f7e8-bcef-4bb1-8d05-b5a27a96edca service nova] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-644b7f29-4248-40e7-8d77-bbae52a08109 req-b711f7e8-bcef-4bb1-8d05-b5a27a96edca service nova] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:40 user nova-compute[73010]: DEBUG nova.compute.manager [req-644b7f29-4248-40e7-8d77-bbae52a08109 req-b711f7e8-bcef-4bb1-8d05-b5a27a96edca service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] No waiting events found dispatching network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:41:40 user nova-compute[73010]: WARNING nova.compute.manager [req-644b7f29-4248-40e7-8d77-bbae52a08109 req-b711f7e8-bcef-4bb1-8d05-b5a27a96edca service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received unexpected event network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d for instance with vm_state active and task_state rescuing.
Aug 15 00:41:40 user nova-compute[73010]: DEBUG nova.compute.manager [req-566ab96a-d08a-44e3-ba5c-a3494c116795 req-98171efc-e518-4902-a42c-3d5d386734e9 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Received event network-vif-plugged-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:41:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-566ab96a-d08a-44e3-ba5c-a3494c116795 req-98171efc-e518-4902-a42c-3d5d386734e9 service nova] Acquiring lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-566ab96a-d08a-44e3-ba5c-a3494c116795 req-98171efc-e518-4902-a42c-3d5d386734e9 service nova] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-566ab96a-d08a-44e3-ba5c-a3494c116795 req-98171efc-e518-4902-a42c-3d5d386734e9 service nova] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:40 user nova-compute[73010]: DEBUG nova.compute.manager [req-566ab96a-d08a-44e3-ba5c-a3494c116795 req-98171efc-e518-4902-a42c-3d5d386734e9 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] No event matching network-vif-plugged-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 in dict_keys([('volume-reimaged', '83bdf3fa-8592-419d-90c9-a3d7a56f1a2c')]) {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 15 00:41:40 user nova-compute[73010]: WARNING nova.compute.manager [req-566ab96a-d08a-44e3-ba5c-a3494c116795 req-98171efc-e518-4902-a42c-3d5d386734e9 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Received unexpected event network-vif-plugged-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 for instance with vm_state active and task_state rebuilding.
Aug 15 00:41:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:42 user nova-compute[73010]: DEBUG nova.compute.manager [req-16cd47fd-14f8-41e7-81d4-5feeeab34822 req-5f08a10d-0078-4a13-b977-0dc460d6c22c service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received event network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:41:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-16cd47fd-14f8-41e7-81d4-5feeeab34822 req-5f08a10d-0078-4a13-b977-0dc460d6c22c service nova] Acquiring lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-16cd47fd-14f8-41e7-81d4-5feeeab34822 req-5f08a10d-0078-4a13-b977-0dc460d6c22c service nova] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-16cd47fd-14f8-41e7-81d4-5feeeab34822 req-5f08a10d-0078-4a13-b977-0dc460d6c22c service nova] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:42 user nova-compute[73010]: DEBUG nova.compute.manager [req-16cd47fd-14f8-41e7-81d4-5feeeab34822 req-5f08a10d-0078-4a13-b977-0dc460d6c22c service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] No waiting events found dispatching network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:41:42 user nova-compute[73010]: WARNING nova.compute.manager [req-16cd47fd-14f8-41e7-81d4-5feeeab34822 req-5f08a10d-0078-4a13-b977-0dc460d6c22c service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received unexpected event network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d for instance with vm_state active and task_state rescuing.
Aug 15 00:41:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Removed pending event for f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 due to event {{(pid=73010) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 00:41:42 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060102.3350685, f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:41:42 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] VM Resumed (Lifecycle Event)
Aug 15 00:41:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-843868aa-f395-4619-83b6-3798e9a392ed tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:41:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:41:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:41:42 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 00:41:42 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060102.338764, f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:41:42 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] VM Started (Lifecycle Event)
Aug 15 00:41:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:41:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:41:43 user nova-compute[73010]: DEBUG nova.compute.manager [req-6331165e-5847-4606-b728-106a8a912e92 req-d0322d1e-131e-438d-a271-200bdda56e93 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Received event network-changed-96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:41:43 user nova-compute[73010]: DEBUG nova.compute.manager [req-6331165e-5847-4606-b728-106a8a912e92 req-d0322d1e-131e-438d-a271-200bdda56e93 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Refreshing instance network info cache due to event network-changed-96dadd50-12c8-430b-82ab-f113031f02d8. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:41:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6331165e-5847-4606-b728-106a8a912e92 req-d0322d1e-131e-438d-a271-200bdda56e93 service nova] Acquiring lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:41:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6331165e-5847-4606-b728-106a8a912e92 req-d0322d1e-131e-438d-a271-200bdda56e93 service nova] Acquired lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:41:43 user nova-compute[73010]: DEBUG nova.network.neutron [req-6331165e-5847-4606-b728-106a8a912e92 req-d0322d1e-131e-438d-a271-200bdda56e93 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Refreshing network info cache for port 96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:41:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-27f7b402-5fc8-4d5e-a33e-1d648c78beca tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-27f7b402-5fc8-4d5e-a33e-1d648c78beca tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-27f7b402-5fc8-4d5e-a33e-1d648c78beca tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-27f7b402-5fc8-4d5e-a33e-1d648c78beca tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-27f7b402-5fc8-4d5e-a33e-1d648c78beca tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:43 user nova-compute[73010]: INFO nova.compute.manager [None req-27f7b402-5fc8-4d5e-a33e-1d648c78beca tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Terminating instance
Aug 15 00:41:43 user nova-compute[73010]: DEBUG nova.compute.manager [None req-27f7b402-5fc8-4d5e-a33e-1d648c78beca tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:41:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Acquiring lock "009d9050-1720-45de-8bc9-16f404e65911" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "009d9050-1720-45de-8bc9-16f404e65911" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:43 user nova-compute[73010]: INFO nova.compute.manager [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Shelve offloading
Aug 15 00:41:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG nova.network.neutron [req-6331165e-5847-4606-b728-106a8a912e92 req-d0322d1e-131e-438d-a271-200bdda56e93 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Updated VIF entry in instance network info cache for port 96dadd50-12c8-430b-82ab-f113031f02d8. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG nova.network.neutron [req-6331165e-5847-4606-b728-106a8a912e92 req-d0322d1e-131e-438d-a271-200bdda56e93 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Updating instance_info_cache with network_info: [{"id": "96dadd50-12c8-430b-82ab-f113031f02d8", "address": "fa:16:3e:d4:06:17", "network": {"id": "935a0b3b-6f36-45b2-a8d0-4d4541cce103", "bridge": "br-int", "label": "tempest-TestShelveInstance-1947454102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c735a6d80a64492baf3346d0c96a872b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dadd50-12", "ovs_interfaceid": "96dadd50-12c8-430b-82ab-f113031f02d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6331165e-5847-4606-b728-106a8a912e92 req-d0322d1e-131e-438d-a271-200bdda56e93 service nova] Releasing lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG nova.compute.manager [req-38c5f449-c7d9-4935-af76-08e981bb5e49 req-ff7389b3-317b-45bb-9efe-f18b473b6a3a service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received event network-vif-unplugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-38c5f449-c7d9-4935-af76-08e981bb5e49 req-ff7389b3-317b-45bb-9efe-f18b473b6a3a service nova] Acquiring lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-38c5f449-c7d9-4935-af76-08e981bb5e49 req-ff7389b3-317b-45bb-9efe-f18b473b6a3a service nova] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-38c5f449-c7d9-4935-af76-08e981bb5e49 req-ff7389b3-317b-45bb-9efe-f18b473b6a3a service nova] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG nova.compute.manager [req-38c5f449-c7d9-4935-af76-08e981bb5e49 req-ff7389b3-317b-45bb-9efe-f18b473b6a3a service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] No waiting events found dispatching network-vif-unplugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG nova.compute.manager [req-38c5f449-c7d9-4935-af76-08e981bb5e49 req-ff7389b3-317b-45bb-9efe-f18b473b6a3a service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received event network-vif-unplugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG nova.compute.manager [req-b080fcc0-42a5-4a0a-9ca9-6d6bd8bb2df8 req-12f848c7-74aa-4c22-8013-24e419393c4f service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Received event network-vif-unplugged-96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b080fcc0-42a5-4a0a-9ca9-6d6bd8bb2df8 req-12f848c7-74aa-4c22-8013-24e419393c4f service nova] Acquiring lock "009d9050-1720-45de-8bc9-16f404e65911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b080fcc0-42a5-4a0a-9ca9-6d6bd8bb2df8 req-12f848c7-74aa-4c22-8013-24e419393c4f service nova] Lock "009d9050-1720-45de-8bc9-16f404e65911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b080fcc0-42a5-4a0a-9ca9-6d6bd8bb2df8 req-12f848c7-74aa-4c22-8013-24e419393c4f service nova] Lock "009d9050-1720-45de-8bc9-16f404e65911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG nova.compute.manager [req-b080fcc0-42a5-4a0a-9ca9-6d6bd8bb2df8 req-12f848c7-74aa-4c22-8013-24e419393c4f service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] No waiting events found dispatching network-vif-unplugged-96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:41:44 user nova-compute[73010]: WARNING nova.compute.manager [req-b080fcc0-42a5-4a0a-9ca9-6d6bd8bb2df8 req-12f848c7-74aa-4c22-8013-24e419393c4f service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Received unexpected event network-vif-unplugged-96dadd50-12c8-430b-82ab-f113031f02d8 for instance with vm_state active and task_state shelving.
Aug 15 00:41:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f4a23d36-4dd9-4f00-aa45-472cc0c65a9d tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "dde74512-c8c3-436c-a6dc-a9327340229e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f4a23d36-4dd9-4f00-aa45-472cc0c65a9d tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "dde74512-c8c3-436c-a6dc-a9327340229e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f4a23d36-4dd9-4f00-aa45-472cc0c65a9d tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "dde74512-c8c3-436c-a6dc-a9327340229e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f4a23d36-4dd9-4f00-aa45-472cc0c65a9d tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "dde74512-c8c3-436c-a6dc-a9327340229e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f4a23d36-4dd9-4f00-aa45-472cc0c65a9d tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "dde74512-c8c3-436c-a6dc-a9327340229e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:44 user nova-compute[73010]: INFO nova.compute.manager [None req-f4a23d36-4dd9-4f00-aa45-472cc0c65a9d tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Terminating instance
Aug 15 00:41:44 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f4a23d36-4dd9-4f00-aa45-472cc0c65a9d tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:44 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Instance destroyed successfully.
Aug 15 00:41:44 user nova-compute[73010]: DEBUG nova.objects.instance [None req-27f7b402-5fc8-4d5e-a33e-1d648c78beca tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'resources' on Instance uuid afcd0a05-e035-492e-9fbe-cd63f4c3ea42 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-27f7b402-5fc8-4d5e-a33e-1d648c78beca tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1899570606',display_name='tempest-AttachVolumeTestJSON-server-1899570606',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1899570606',id=3,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMV9Ia1g6S1Dqv5u52uv7YpM19NUmr26Hj+tCSO6tG0aZL4zk5VCqdKIe6IWKX3KiHIXyqR1c1NApawOfSvd8OOhU+aA7fYaPBkxC185NYPaDo0+I9Vsdwf99lfNe8lrhw==',key_name='tempest-keypair-1489578241',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:32:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e50aaf528c8c4d4ba8d39b3b203b5a52',ramdisk_id='',reservation_id='r-abzuan7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-338922600',owner_user_name='tempest-AttachVolumeTestJSON-338922600-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:39:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53c8150819854d29b1d8c865da2642ca',uuid=afcd0a05-e035-492e-9fbe-cd63f4c3ea42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-27f7b402-5fc8-4d5e-a33e-1d648c78beca tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Converting VIF {"id": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "address": "fa:16:3e:7b:68:0b", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b345b-67", "ovs_interfaceid": "2f2b345b-67b5-4d95-bbd3-3fe48aafaee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-27f7b402-5fc8-4d5e-a33e-1d648c78beca tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:68:0b,bridge_name='br-int',has_traffic_filtering=True,id=2f2b345b-67b5-4d95-bbd3-3fe48aafaee5,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b345b-67') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG os_vif [None req-27f7b402-5fc8-4d5e-a33e-1d648c78beca tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:68:0b,bridge_name='br-int',has_traffic_filtering=True,id=2f2b345b-67b5-4d95-bbd3-3fe48aafaee5,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b345b-67') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f2b345b-67, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:41:44 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Instance destroyed successfully.
Aug 15 00:41:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG nova.compute.manager [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:41:44 user nova-compute[73010]: INFO os_vif [None req-27f7b402-5fc8-4d5e-a33e-1d648c78beca tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:68:0b,bridge_name='br-int',has_traffic_filtering=True,id=2f2b345b-67b5-4d95-bbd3-3fe48aafaee5,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b345b-67')
Aug 15 00:41:44 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-27f7b402-5fc8-4d5e-a33e-1d648c78beca tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Deleting instance files /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42_del
Aug 15 00:41:44 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-27f7b402-5fc8-4d5e-a33e-1d648c78beca tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Deletion of /opt/stack/data/nova/instances/afcd0a05-e035-492e-9fbe-cd63f4c3ea42_del complete
Aug 15 00:41:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Acquiring lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Acquired lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:41:44 user nova-compute[73010]: DEBUG nova.network.neutron [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:41:45 user nova-compute[73010]: INFO nova.compute.manager [None req-27f7b402-5fc8-4d5e-a33e-1d648c78beca tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Took 1.33 seconds to destroy the instance on the hypervisor.
Aug 15 00:41:45 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-27f7b402-5fc8-4d5e-a33e-1d648c78beca tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:41:45 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:41:45 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:41:45 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Instance destroyed successfully.
Aug 15 00:41:45 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f4a23d36-4dd9-4f00-aa45-472cc0c65a9d tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lazy-loading 'resources' on Instance uuid dde74512-c8c3-436c-a6dc-a9327340229e {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:41:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f4a23d36-4dd9-4f00-aa45-472cc0c65a9d tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:35:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1404970930',display_name='tempest-AttachVolumeNegativeTest-server-1404970930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1404970930',id=15,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo9q3vez3IawJePyv8/WuxnQFlvrHxSFHQXJZrX+oikydz8qetTyB6DUZqr/hRlckAl++ufoDtS7flou8Bh3JIwtLolXM5jKh7j2Wt0OLlK+oHeS31AJ1A0+b4nKeCaBQ==',key_name='tempest-keypair-2086446881',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:36:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e962745e3a554f2b8f42d97434173a7a',ramdisk_id='',reservation_id='r-m86v4sf4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-865469153',owner_user_name='tempest-AttachVolumeNegativeTest-865469153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928ab235d55d4bfc86de82f2387c9d06',uuid=dde74512-c8c3-436c-a6dc-a9327340229e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68f235d2-055a-40e8-a4ab-09e33974f4ac", "address": "fa:16:3e:8b:20:c2", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f235d2-05", "ovs_interfaceid": "68f235d2-055a-40e8-a4ab-09e33974f4ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:41:45 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f4a23d36-4dd9-4f00-aa45-472cc0c65a9d tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Converting VIF {"id": "68f235d2-055a-40e8-a4ab-09e33974f4ac", "address": "fa:16:3e:8b:20:c2", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f235d2-05", "ovs_interfaceid": "68f235d2-055a-40e8-a4ab-09e33974f4ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:41:45 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f4a23d36-4dd9-4f00-aa45-472cc0c65a9d tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:20:c2,bridge_name='br-int',has_traffic_filtering=True,id=68f235d2-055a-40e8-a4ab-09e33974f4ac,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68f235d2-05') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:41:45 user nova-compute[73010]: DEBUG os_vif [None req-f4a23d36-4dd9-4f00-aa45-472cc0c65a9d tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:20:c2,bridge_name='br-int',has_traffic_filtering=True,id=68f235d2-055a-40e8-a4ab-09e33974f4ac,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68f235d2-05') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:41:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68f235d2-05, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:41:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:41:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:45 user nova-compute[73010]: INFO os_vif [None req-f4a23d36-4dd9-4f00-aa45-472cc0c65a9d tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:20:c2,bridge_name='br-int',has_traffic_filtering=True,id=68f235d2-055a-40e8-a4ab-09e33974f4ac,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68f235d2-05')
Aug 15 00:41:45 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-f4a23d36-4dd9-4f00-aa45-472cc0c65a9d tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Deleting instance files /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e_del
Aug 15 00:41:45 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-f4a23d36-4dd9-4f00-aa45-472cc0c65a9d tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Deletion of /opt/stack/data/nova/instances/dde74512-c8c3-436c-a6dc-a9327340229e_del complete
Aug 15 00:41:45 user nova-compute[73010]: INFO nova.compute.manager [None req-f4a23d36-4dd9-4f00-aa45-472cc0c65a9d tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 15 00:41:45 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-f4a23d36-4dd9-4f00-aa45-472cc0c65a9d tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:41:45 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:41:45 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:41:45 user nova-compute[73010]: DEBUG nova.network.neutron [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Updating instance_info_cache with network_info: [{"id": "96dadd50-12c8-430b-82ab-f113031f02d8", "address": "fa:16:3e:d4:06:17", "network": {"id": "935a0b3b-6f36-45b2-a8d0-4d4541cce103", "bridge": "br-int", "label": "tempest-TestShelveInstance-1947454102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c735a6d80a64492baf3346d0c96a872b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dadd50-12", "ovs_interfaceid": "96dadd50-12c8-430b-82ab-f113031f02d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:41:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Releasing lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:41:46 user nova-compute[73010]: DEBUG nova.compute.manager [req-fb3321cc-e580-450f-8de7-17305eda98aa req-536d8805-4acb-4271-8605-dbbfcd85b077 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Received event network-vif-plugged-96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:41:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-fb3321cc-e580-450f-8de7-17305eda98aa req-536d8805-4acb-4271-8605-dbbfcd85b077 service nova] Acquiring lock "009d9050-1720-45de-8bc9-16f404e65911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-fb3321cc-e580-450f-8de7-17305eda98aa req-536d8805-4acb-4271-8605-dbbfcd85b077 service nova] Lock "009d9050-1720-45de-8bc9-16f404e65911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-fb3321cc-e580-450f-8de7-17305eda98aa req-536d8805-4acb-4271-8605-dbbfcd85b077 service nova] Lock "009d9050-1720-45de-8bc9-16f404e65911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:46 user nova-compute[73010]: DEBUG nova.compute.manager [req-fb3321cc-e580-450f-8de7-17305eda98aa req-536d8805-4acb-4271-8605-dbbfcd85b077 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] No waiting events found dispatching network-vif-plugged-96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:41:46 user nova-compute[73010]: WARNING nova.compute.manager [req-fb3321cc-e580-450f-8de7-17305eda98aa req-536d8805-4acb-4271-8605-dbbfcd85b077 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Received unexpected event network-vif-plugged-96dadd50-12c8-430b-82ab-f113031f02d8 for instance with vm_state active and task_state shelving.
Aug 15 00:41:46 user nova-compute[73010]: DEBUG nova.compute.manager [req-f1ecdd3c-dcfd-4aed-82b0-0a8a86bb2f91 req-1fe3cc35-4162-4adf-b0a3-0a87e24da49d service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received event network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:41:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f1ecdd3c-dcfd-4aed-82b0-0a8a86bb2f91 req-1fe3cc35-4162-4adf-b0a3-0a87e24da49d service nova] Acquiring lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f1ecdd3c-dcfd-4aed-82b0-0a8a86bb2f91 req-1fe3cc35-4162-4adf-b0a3-0a87e24da49d service nova] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f1ecdd3c-dcfd-4aed-82b0-0a8a86bb2f91 req-1fe3cc35-4162-4adf-b0a3-0a87e24da49d service nova] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:46 user nova-compute[73010]: DEBUG nova.compute.manager [req-f1ecdd3c-dcfd-4aed-82b0-0a8a86bb2f91 req-1fe3cc35-4162-4adf-b0a3-0a87e24da49d service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] No waiting events found dispatching network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:41:46 user nova-compute[73010]: WARNING nova.compute.manager [req-f1ecdd3c-dcfd-4aed-82b0-0a8a86bb2f91 req-1fe3cc35-4162-4adf-b0a3-0a87e24da49d service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received unexpected event network-vif-plugged-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 for instance with vm_state active and task_state deleting.
Aug 15 00:41:46 user nova-compute[73010]: DEBUG nova.compute.manager [req-f1ecdd3c-dcfd-4aed-82b0-0a8a86bb2f91 req-1fe3cc35-4162-4adf-b0a3-0a87e24da49d service nova] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Received event network-vif-unplugged-68f235d2-055a-40e8-a4ab-09e33974f4ac {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:41:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f1ecdd3c-dcfd-4aed-82b0-0a8a86bb2f91 req-1fe3cc35-4162-4adf-b0a3-0a87e24da49d service nova] Acquiring lock "dde74512-c8c3-436c-a6dc-a9327340229e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f1ecdd3c-dcfd-4aed-82b0-0a8a86bb2f91 req-1fe3cc35-4162-4adf-b0a3-0a87e24da49d service nova] Lock "dde74512-c8c3-436c-a6dc-a9327340229e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f1ecdd3c-dcfd-4aed-82b0-0a8a86bb2f91 req-1fe3cc35-4162-4adf-b0a3-0a87e24da49d service nova] Lock "dde74512-c8c3-436c-a6dc-a9327340229e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:46 user nova-compute[73010]: DEBUG nova.compute.manager [req-f1ecdd3c-dcfd-4aed-82b0-0a8a86bb2f91 req-1fe3cc35-4162-4adf-b0a3-0a87e24da49d service nova] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] No waiting events found dispatching network-vif-unplugged-68f235d2-055a-40e8-a4ab-09e33974f4ac {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:41:46 user nova-compute[73010]: DEBUG nova.compute.manager [req-f1ecdd3c-dcfd-4aed-82b0-0a8a86bb2f91 req-1fe3cc35-4162-4adf-b0a3-0a87e24da49d service nova] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Received event network-vif-unplugged-68f235d2-055a-40e8-a4ab-09e33974f4ac for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:41:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:41:47 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Took 2.55 seconds to deallocate network for instance.
Aug 15 00:41:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-27f7b402-5fc8-4d5e-a33e-1d648c78beca tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-27f7b402-5fc8-4d5e-a33e-1d648c78beca tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:41:47 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Took 2.20 seconds to deallocate network for instance.
Aug 15 00:41:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f4a23d36-4dd9-4f00-aa45-472cc0c65a9d tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG nova.compute.manager [req-2e3c5620-5e74-465f-bc20-9b263b1c630d req-6ecb8349-f74b-450b-8e41-d11329ab85be service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Received event network-changed-96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG nova.compute.manager [req-2e3c5620-5e74-465f-bc20-9b263b1c630d req-6ecb8349-f74b-450b-8e41-d11329ab85be service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Refreshing instance network info cache due to event network-changed-96dadd50-12c8-430b-82ab-f113031f02d8. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2e3c5620-5e74-465f-bc20-9b263b1c630d req-6ecb8349-f74b-450b-8e41-d11329ab85be service nova] Acquiring lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2e3c5620-5e74-465f-bc20-9b263b1c630d req-6ecb8349-f74b-450b-8e41-d11329ab85be service nova] Acquired lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG nova.network.neutron [req-2e3c5620-5e74-465f-bc20-9b263b1c630d req-6ecb8349-f74b-450b-8e41-d11329ab85be service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Refreshing network info cache for port 96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:41:47 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Instance destroyed successfully.
Aug 15 00:41:47 user nova-compute[73010]: DEBUG nova.objects.instance [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lazy-loading 'resources' on Instance uuid 009d9050-1720-45de-8bc9-16f404e65911 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1795734941',display_name='tempest-TestShelveInstance-server-1795734941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1795734941',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcvum5u9XWkffPgr3kUCPUYgZKMK4EupdMldEf//XaPrSY8IDVMu6jeGwbDvE83LEBISDSMbAk9hvyN1POk9rP39devk3OdD2ie6iQLoFJW3VpXHZj4RZst+OeJaRlMbw==',key_name='tempest-TestShelveInstance-1964489724',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:40:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c735a6d80a64492baf3346d0c96a872b',ramdisk_id='',reservation_id='r-ganojssg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1217563266',owner_user_name='tempest-TestShelveInstance-1217563266-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:40:09Z,user_data=None,user_id='9c8c404d2a364ce6be183c14da241836',uuid=009d9050-1720-45de-8bc9-16f404e65911,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96dadd50-12c8-430b-82ab-f113031f02d8", "address": "fa:16:3e:d4:06:17", "network": {"id": "935a0b3b-6f36-45b2-a8d0-4d4541cce103", "bridge": "br-int", "label": "tempest-TestShelveInstance-1947454102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c735a6d80a64492baf3346d0c96a872b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dadd50-12", "ovs_interfaceid": "96dadd50-12c8-430b-82ab-f113031f02d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Converting VIF {"id": "96dadd50-12c8-430b-82ab-f113031f02d8", "address": "fa:16:3e:d4:06:17", "network": {"id": "935a0b3b-6f36-45b2-a8d0-4d4541cce103", "bridge": "br-int", "label": "tempest-TestShelveInstance-1947454102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c735a6d80a64492baf3346d0c96a872b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dadd50-12", "ovs_interfaceid": "96dadd50-12c8-430b-82ab-f113031f02d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:06:17,bridge_name='br-int',has_traffic_filtering=True,id=96dadd50-12c8-430b-82ab-f113031f02d8,network=Network(935a0b3b-6f36-45b2-a8d0-4d4541cce103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96dadd50-12') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG os_vif [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:06:17,bridge_name='br-int',has_traffic_filtering=True,id=96dadd50-12c8-430b-82ab-f113031f02d8,network=Network(935a0b3b-6f36-45b2-a8d0-4d4541cce103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96dadd50-12') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96dadd50-12, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:41:47 user nova-compute[73010]: INFO os_vif [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:06:17,bridge_name='br-int',has_traffic_filtering=True,id=96dadd50-12c8-430b-82ab-f113031f02d8,network=Network(935a0b3b-6f36-45b2-a8d0-4d4541cce103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96dadd50-12')
Aug 15 00:41:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfoiFbEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:41:47 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:41:47 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da9c967-63ce-478e-b7b6-9627e8392414]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e8166f-9a06-49a7-ad0c-55aa36b3c46d]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:41:48 user nova-compute[73010]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:41:48 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:41:48 user nova-compute[73010]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:41:48 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec30648af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6'): ({'sde'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Removing single pathed devices sde {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[070ccbab-65b7-4190-a15e-cefbe0a0ceae]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb514b64-3e21-40f3-b225-ca304140e7cc]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Flushing IO for device /dev/sde {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b08bc1-c418-4cd6-93d2-bc214a0283d9]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3898aa-361b-46fe-bad3-570d40377054]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] SCSI volumes sde have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-27f7b402-5fc8-4d5e-a33e-1d648c78beca tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4b9f76-3561-4ab5-b463-5b9bd9b34e1b]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-27f7b402-5fc8-4d5e-a33e-1d648c78beca tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd43fbb-fb6b-4a39-bb5d-5166e9adc785]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6, portal: 172.16.0.220,3260]
Aug 15 00:41:48 user nova-compute[73010]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6, portal: 172.16.0.220,3260] successful.
Aug 15 00:41:48 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-27f7b402-5fc8-4d5e-a33e-1d648c78beca tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.632s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f4a23d36-4dd9-4f00-aa45-472cc0c65a9d tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.507s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b4a221-2e85-4ef3-bdc9-c33c69931ea1]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] <== disconnect_volume: return (424ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:41:48 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Deleting instance files /opt/stack/data/nova/instances/009d9050-1720-45de-8bc9-16f404e65911_del
Aug 15 00:41:48 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Deletion of /opt/stack/data/nova/instances/009d9050-1720-45de-8bc9-16f404e65911_del complete
Aug 15 00:41:48 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-27f7b402-5fc8-4d5e-a33e-1d648c78beca tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Deleted allocations for instance afcd0a05-e035-492e-9fbe-cd63f4c3ea42
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-27f7b402-5fc8-4d5e-a33e-1d648c78beca tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "afcd0a05-e035-492e-9fbe-cd63f4c3ea42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.765s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG nova.compute.manager [req-1d035cef-a601-4329-a656-da0b415cd460 req-af687627-8e40-47bd-a8c2-37228dca6429 service nova] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Received event network-vif-plugged-68f235d2-055a-40e8-a4ab-09e33974f4ac {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1d035cef-a601-4329-a656-da0b415cd460 req-af687627-8e40-47bd-a8c2-37228dca6429 service nova] Acquiring lock "dde74512-c8c3-436c-a6dc-a9327340229e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1d035cef-a601-4329-a656-da0b415cd460 req-af687627-8e40-47bd-a8c2-37228dca6429 service nova] Lock "dde74512-c8c3-436c-a6dc-a9327340229e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1d035cef-a601-4329-a656-da0b415cd460 req-af687627-8e40-47bd-a8c2-37228dca6429 service nova] Lock "dde74512-c8c3-436c-a6dc-a9327340229e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG nova.compute.manager [req-1d035cef-a601-4329-a656-da0b415cd460 req-af687627-8e40-47bd-a8c2-37228dca6429 service nova] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] No waiting events found dispatching network-vif-plugged-68f235d2-055a-40e8-a4ab-09e33974f4ac {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:41:48 user nova-compute[73010]: WARNING nova.compute.manager [req-1d035cef-a601-4329-a656-da0b415cd460 req-af687627-8e40-47bd-a8c2-37228dca6429 service nova] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Received unexpected event network-vif-plugged-68f235d2-055a-40e8-a4ab-09e33974f4ac for instance with vm_state deleted and task_state None.
Aug 15 00:41:48 user nova-compute[73010]: DEBUG nova.compute.manager [req-1d035cef-a601-4329-a656-da0b415cd460 req-af687627-8e40-47bd-a8c2-37228dca6429 service nova] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Received event network-vif-deleted-2f2b345b-67b5-4d95-bbd3-3fe48aafaee5 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG nova.compute.manager [req-1d035cef-a601-4329-a656-da0b415cd460 req-af687627-8e40-47bd-a8c2-37228dca6429 service nova] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Received event network-vif-deleted-68f235d2-055a-40e8-a4ab-09e33974f4ac {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f4a23d36-4dd9-4f00-aa45-472cc0c65a9d tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:48 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Error from libvirt while getting description of instance-00000016: [Error Code 42] Domain not found: no domain with matching uuid '009d9050-1720-45de-8bc9-16f404e65911' (instance-00000016): libvirt.libvirtError: Domain not found: no domain with matching uuid '009d9050-1720-45de-8bc9-16f404e65911' (instance-00000016)
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f4a23d36-4dd9-4f00-aa45-472cc0c65a9d tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f4a23d36-4dd9-4f00-aa45-472cc0c65a9d tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.531s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:48 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-f4a23d36-4dd9-4f00-aa45-472cc0c65a9d tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Deleted allocations for instance dde74512-c8c3-436c-a6dc-a9327340229e
Aug 15 00:41:48 user nova-compute[73010]: DEBUG nova.network.neutron [req-2e3c5620-5e74-465f-bc20-9b263b1c630d req-6ecb8349-f74b-450b-8e41-d11329ab85be service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Updated VIF entry in instance network info cache for port 96dadd50-12c8-430b-82ab-f113031f02d8. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG nova.network.neutron [req-2e3c5620-5e74-465f-bc20-9b263b1c630d req-6ecb8349-f74b-450b-8e41-d11329ab85be service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Updating instance_info_cache with network_info: [{"id": "96dadd50-12c8-430b-82ab-f113031f02d8", "address": "fa:16:3e:d4:06:17", "network": {"id": "935a0b3b-6f36-45b2-a8d0-4d4541cce103", "bridge": null, "label": "tempest-TestShelveInstance-1947454102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c735a6d80a64492baf3346d0c96a872b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap96dadd50-12", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2e3c5620-5e74-465f-bc20-9b263b1c630d req-6ecb8349-f74b-450b-8e41-d11329ab85be service nova] Releasing lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:41:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f4a23d36-4dd9-4f00-aa45-472cc0c65a9d tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "dde74512-c8c3-436c-a6dc-a9327340229e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.459s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:49 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Deleted allocations for instance 009d9050-1720-45de-8bc9-16f404e65911
Aug 15 00:41:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:49 user nova-compute[73010]: DEBUG nova.objects.instance [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lazy-loading 'numa_topology' on Instance uuid 009d9050-1720-45de-8bc9-16f404e65911 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:41:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:49 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:41:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:50 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:41:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9785f9ae-c659-465b-bb81-658710505e85 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "009d9050-1720-45de-8bc9-16f404e65911" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 6.278s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:41:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:51 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:41:51 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:41:51 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=7378MB free_disk=25.572734832763672GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:41:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6dfc356b-953a-47b0-9da7-70cc59a80853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:41:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:41:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6bf89433-15f9-44fd-a4c1-00b72287f65f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:41:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance eec545e8-eeda-443c-9892-980e19e7267a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:41:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4b489f97-c8d4-4a6a-8404-e1a05a990261 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:41:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 98fa0e64-cf36-4991-924d-ba4b713239d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:41:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:41:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4b5baaac-bb54-462c-b833-4f37de8f24dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:41:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:41:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:41:52 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:41:52 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:41:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:41:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.763s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:53 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060098.643051, 6bf89433-15f9-44fd-a4c1-00b72287f65f => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:41:53 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] VM Stopped (Lifecycle Event)
Aug 15 00:41:53 user nova-compute[73010]: DEBUG nova.compute.manager [None req-0f2a2f24-8fb4-4e6e-8d08-a186fdb44548 None None] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:41:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:57 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:41:57 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:41:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:41:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-6dfc356b-953a-47b0-9da7-70cc59a80853" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:41:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-6dfc356b-953a-47b0-9da7-70cc59a80853" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:41:57 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 00:41:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:58 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Updating instance_info_cache with network_info: [{"id": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "address": "fa:16:3e:63:99:69", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff59e78-ba", "ovs_interfaceid": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:41:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-6dfc356b-953a-47b0-9da7-70cc59a80853" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:41:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 00:41:58 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:41:58 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:41:58 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:41:58 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:41:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-b2d43a67-8612-4a57-bb65-ee1de225a734 req-678b98e5-9450-48bf-b730-721da9dcfeae service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Received event volume-reimaged-83bdf3fa-8592-419d-90c9-a3d7a56f1a2c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b2d43a67-8612-4a57-bb65-ee1de225a734 req-678b98e5-9450-48bf-b730-721da9dcfeae service nova] Acquiring lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b2d43a67-8612-4a57-bb65-ee1de225a734 req-678b98e5-9450-48bf-b730-721da9dcfeae service nova] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b2d43a67-8612-4a57-bb65-ee1de225a734 req-678b98e5-9450-48bf-b730-721da9dcfeae service nova] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-b2d43a67-8612-4a57-bb65-ee1de225a734 req-678b98e5-9450-48bf-b730-721da9dcfeae service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Processing event volume-reimaged-83bdf3fa-8592-419d-90c9-a3d7a56f1a2c {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG nova.compute.manager [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Instance event wait completed in 19 seconds for volume-reimaged {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:41:59 user nova-compute[73010]: INFO nova.virt.block_device [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Booting with volume 83bdf3fa-8592-419d-90c9-a3d7a56f1a2c at /dev/vda
Aug 15 00:41:59 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG os_brick.utils [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b5a164-7db8-4041-aa7b-3a41e3631352]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fc6fa3-fdd0-4370-8160-e3ba40332fc4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a75d81-dac9-4c9f-9e08-36bbf13d2f44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b69959c-7b84-49ac-98ac-c8d6c1183618]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:41:59 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:41:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e765373-66e6-444f-9b97-c777d1920b52]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG os_brick.utils [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Updating existing volume attachment record: 8877fe3f-8499-444f-b41e-74833cf076b3 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060104.8585982, afcd0a05-e035-492e-9fbe-cd63f4c3ea42 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:41:59 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] VM Stopped (Lifecycle Event)
Aug 15 00:41:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG nova.compute.manager [None req-a90f7fd9-e648-41cb-b745-22b1ddcafe71 None None] [instance: afcd0a05-e035-492e-9fbe-cd63f4c3ea42] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:41:59 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060104.940925, 009d9050-1720-45de-8bc9-16f404e65911 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:41:59 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 009d9050-1720-45de-8bc9-16f404e65911] VM Stopped (Lifecycle Event)
Aug 15 00:41:59 user nova-compute[73010]: DEBUG nova.compute.manager [None req-62244e55-f2ea-4980-b65e-6882f1e51b83 None None] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:42:00 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060105.4250557, dde74512-c8c3-436c-a6dc-a9327340229e => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:42:00 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] VM Stopped (Lifecycle Event)
Aug 15 00:42:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-4be0523e-3e76-4447-bd8d-3357d65d641e None None] [instance: dde74512-c8c3-436c-a6dc-a9327340229e] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:42:01 user nova-compute[73010]: INFO nova.compute.manager [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Rescuing
Aug 15 00:42:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "refresh_cache-4b489f97-c8d4-4a6a-8404-e1a05a990261" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:42:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquired lock "refresh_cache-4b489f97-c8d4-4a6a-8404-e1a05a990261" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:42:01 user nova-compute[73010]: DEBUG nova.network.neutron [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:42:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Acquiring lock "8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:42:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:01 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:42:01 user nova-compute[73010]: INFO nova.compute.claims [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Claim successful on node user
Aug 15 00:42:01 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:42:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:01 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:42:01 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:42:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:42:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:42:01 user nova-compute[73010]: DEBUG nova.network.neutron [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:42:01 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:42:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG nova.policy [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9515da5654394bf7b5175d74e7350a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09136fc9ddd9408892ac461a306a1618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:42:02 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Creating image(s)
Aug 15 00:42:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Acquiring lock "/opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "/opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "/opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.174s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.217s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk 1073741824" returned: 0 in 0.058s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG nova.network.neutron [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Updating instance_info_cache with network_info: [{"id": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "address": "fa:16:3e:31:6a:22", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da1cffd-22", "ovs_interfaceid": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Releasing lock "refresh_cache-4b489f97-c8d4-4a6a-8404-e1a05a990261" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG nova.network.neutron [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Successfully created port: 80cc26e3-8a79-465a-9976-59be5d7eeb72 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.220s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Cannot resize image /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.objects.instance [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lazy-loading 'migration_context' on Instance uuid 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Ensure instance console log exists: /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.compute.manager [req-a20ff206-8ca1-4778-933a-5b63d7187786 req-b880db77-6346-4208-813b-e76462c8e400 service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Received event network-vif-unplugged-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a20ff206-8ca1-4778-933a-5b63d7187786 req-b880db77-6346-4208-813b-e76462c8e400 service nova] Acquiring lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a20ff206-8ca1-4778-933a-5b63d7187786 req-b880db77-6346-4208-813b-e76462c8e400 service nova] Lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a20ff206-8ca1-4778-933a-5b63d7187786 req-b880db77-6346-4208-813b-e76462c8e400 service nova] Lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.compute.manager [req-a20ff206-8ca1-4778-933a-5b63d7187786 req-b880db77-6346-4208-813b-e76462c8e400 service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] No waiting events found dispatching network-vif-unplugged-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:42:03 user nova-compute[73010]: WARNING nova.compute.manager [req-a20ff206-8ca1-4778-933a-5b63d7187786 req-b880db77-6346-4208-813b-e76462c8e400 service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Received unexpected event network-vif-unplugged-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa for instance with vm_state active and task_state rescuing.
Aug 15 00:42:03 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Instance destroyed successfully.
Aug 15 00:42:03 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Attempting rescue
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73010) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Instance directory exists: not creating {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 00:42:03 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Creating image(s)
Aug 15 00:42:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "/opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "/opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.objects.instance [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4b489f97-c8d4-4a6a-8404-e1a05a990261 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.186s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue" returned: 0 in 0.053s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.objects.instance [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'migration_context' on Instance uuid 4b489f97-c8d4-4a6a-8404-e1a05a990261 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Start _get_guest_xml network_info=[{"id": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "address": "fa:16:3e:31:6a:22", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "vif_mac": "fa:16:3e:31:6a:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da1cffd-22", "ovs_interfaceid": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.objects.instance [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'resources' on Instance uuid 4b489f97-c8d4-4a6a-8404-e1a05a990261 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.network.neutron [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Successfully updated port: 80cc26e3-8a79-465a-9976-59be5d7eeb72 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.objects.instance [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'numa_topology' on Instance uuid 4b489f97-c8d4-4a6a-8404-e1a05a990261 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Acquiring lock "refresh_cache-8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Acquired lock "refresh_cache-8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.network.neutron [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.compute.manager [req-d371e829-b316-4ac3-9126-63e8846a5212 req-30825b77-e800-46fd-8363-a11fbd962676 service nova] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Received event network-changed-80cc26e3-8a79-465a-9976-59be5d7eeb72 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.compute.manager [req-d371e829-b316-4ac3-9126-63e8846a5212 req-30825b77-e800-46fd-8363-a11fbd962676 service nova] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Refreshing instance network info cache due to event network-changed-80cc26e3-8a79-465a-9976-59be5d7eeb72. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d371e829-b316-4ac3-9126-63e8846a5212 req-30825b77-e800-46fd-8363-a11fbd962676 service nova] Acquiring lock "refresh_cache-8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:42:03 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:42:03 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.objects.instance [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4b489f97-c8d4-4a6a-8404-e1a05a990261 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:40:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-871958020',display_name='tempest-ServerRescueNegativeTestJSON-server-871958020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-871958020',id=24,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:40:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a564ea15194c4e059746d2fc6e7e1a07',ramdisk_id='',reservation_id='r-7qe9mv1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-203744558',owner_user_name='tempest-ServerRescueNegativeTestJSON-203744558-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:40:19Z,user_data=None,user_id='b85ef05658d64f1fbd78e509e2a606d8',uuid=4b489f97-c8d4-4a6a-8404-e1a05a990261,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "address": "fa:16:3e:31:6a:22", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "vif_mac": "fa:16:3e:31:6a:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da1cffd-22", "ovs_interfaceid": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Converting VIF {"id": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "address": "fa:16:3e:31:6a:22", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "vif_mac": "fa:16:3e:31:6a:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da1cffd-22", "ovs_interfaceid": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:6a:22,bridge_name='br-int',has_traffic_filtering=True,id=6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa,network=Network(f4772ea6-9cb0-4ca8-b327-34f8dd08808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6da1cffd-22') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.objects.instance [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b489f97-c8d4-4a6a-8404-e1a05a990261 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.network.neutron [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:42:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:42:03 user nova-compute[73010]:   <uuid>4b489f97-c8d4-4a6a-8404-e1a05a990261</uuid>
Aug 15 00:42:03 user nova-compute[73010]:   <name>instance-00000018</name>
Aug 15 00:42:03 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:42:03 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:42:03 user nova-compute[73010]:   <metadata>
Aug 15 00:42:03 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:42:03 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:42:03 user nova-compute[73010]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-871958020</nova:name>
Aug 15 00:42:03 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:42:03</nova:creationTime>
Aug 15 00:42:03 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:42:03 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:42:03 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:42:03 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:42:03 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:42:03 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:42:03 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:42:03 user nova-compute[73010]:       <nova:owner>
Aug 15 00:42:03 user nova-compute[73010]:         <nova:user uuid="b85ef05658d64f1fbd78e509e2a606d8">tempest-ServerRescueNegativeTestJSON-203744558-project-member</nova:user>
Aug 15 00:42:03 user nova-compute[73010]:         <nova:project uuid="a564ea15194c4e059746d2fc6e7e1a07">tempest-ServerRescueNegativeTestJSON-203744558</nova:project>
Aug 15 00:42:03 user nova-compute[73010]:       </nova:owner>
Aug 15 00:42:03 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:42:03 user nova-compute[73010]:       <nova:ports>
Aug 15 00:42:03 user nova-compute[73010]:         <nova:port uuid="6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa">
Aug 15 00:42:03 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 00:42:03 user nova-compute[73010]:         </nova:port>
Aug 15 00:42:03 user nova-compute[73010]:       </nova:ports>
Aug 15 00:42:03 user nova-compute[73010]:     </nova:instance>
Aug 15 00:42:03 user nova-compute[73010]:   </metadata>
Aug 15 00:42:03 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:42:03 user nova-compute[73010]:     <system>
Aug 15 00:42:03 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:42:03 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:42:03 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:42:03 user nova-compute[73010]:       <entry name="serial">4b489f97-c8d4-4a6a-8404-e1a05a990261</entry>
Aug 15 00:42:03 user nova-compute[73010]:       <entry name="uuid">4b489f97-c8d4-4a6a-8404-e1a05a990261</entry>
Aug 15 00:42:03 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:42:03 user nova-compute[73010]:     </system>
Aug 15 00:42:03 user nova-compute[73010]:   </sysinfo>
Aug 15 00:42:03 user nova-compute[73010]:   <os>
Aug 15 00:42:03 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:42:03 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:42:03 user nova-compute[73010]:   </os>
Aug 15 00:42:03 user nova-compute[73010]:   <features>
Aug 15 00:42:03 user nova-compute[73010]:     <acpi/>
Aug 15 00:42:03 user nova-compute[73010]:     <apic/>
Aug 15 00:42:03 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:42:03 user nova-compute[73010]:   </features>
Aug 15 00:42:03 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:42:03 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:42:03 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:42:03 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:42:03 user nova-compute[73010]:   </clock>
Aug 15 00:42:03 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:42:03 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:42:03 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:42:03 user nova-compute[73010]:   </cpu>
Aug 15 00:42:03 user nova-compute[73010]:   <devices>
Aug 15 00:42:03 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:42:03 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:42:03 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue"/>
Aug 15 00:42:03 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:42:03 user nova-compute[73010]:     </disk>
Aug 15 00:42:03 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:42:03 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:42:03 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk"/>
Aug 15 00:42:03 user nova-compute[73010]:       <target dev="vdb" bus="virtio"/>
Aug 15 00:42:03 user nova-compute[73010]:     </disk>
Aug 15 00:42:03 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:42:03 user nova-compute[73010]:       <mac address="fa:16:3e:31:6a:22"/>
Aug 15 00:42:03 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:42:03 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:42:03 user nova-compute[73010]:       <target dev="tap6da1cffd-22"/>
Aug 15 00:42:03 user nova-compute[73010]:     </interface>
Aug 15 00:42:03 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:42:03 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/console.log" append="off"/>
Aug 15 00:42:03 user nova-compute[73010]:     </serial>
Aug 15 00:42:03 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:42:03 user nova-compute[73010]:     <video>
Aug 15 00:42:03 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:42:03 user nova-compute[73010]:     </video>
Aug 15 00:42:03 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:42:03 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:42:03 user nova-compute[73010]:     </rng>
Aug 15 00:42:03 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:42:03 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:42:03 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:42:03 user nova-compute[73010]:     </memballoon>
Aug 15 00:42:03 user nova-compute[73010]:   </devices>
Aug 15 00:42:03 user nova-compute[73010]: </domain>
Aug 15 00:42:03 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:42:04 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Instance destroyed successfully.
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] No VIF found with MAC fa:16:3e:31:6a:22, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.network.neutron [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Updating instance_info_cache with network_info: [{"id": "80cc26e3-8a79-465a-9976-59be5d7eeb72", "address": "fa:16:3e:5d:1f:42", "network": {"id": "2f9cb7ad-5cb3-4458-993a-780ab047d4e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-145440789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09136fc9ddd9408892ac461a306a1618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cc26e3-8a", "ovs_interfaceid": "80cc26e3-8a79-465a-9976-59be5d7eeb72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Releasing lock "refresh_cache-8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.compute.manager [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Instance network_info: |[{"id": "80cc26e3-8a79-465a-9976-59be5d7eeb72", "address": "fa:16:3e:5d:1f:42", "network": {"id": "2f9cb7ad-5cb3-4458-993a-780ab047d4e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-145440789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09136fc9ddd9408892ac461a306a1618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cc26e3-8a", "ovs_interfaceid": "80cc26e3-8a79-465a-9976-59be5d7eeb72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d371e829-b316-4ac3-9126-63e8846a5212 req-30825b77-e800-46fd-8363-a11fbd962676 service nova] Acquired lock "refresh_cache-8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.network.neutron [req-d371e829-b316-4ac3-9126-63e8846a5212 req-30825b77-e800-46fd-8363-a11fbd962676 service nova] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Refreshing network info cache for port 80cc26e3-8a79-465a-9976-59be5d7eeb72 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Start _get_guest_xml network_info=[{"id": "80cc26e3-8a79-465a-9976-59be5d7eeb72", "address": "fa:16:3e:5d:1f:42", "network": {"id": "2f9cb7ad-5cb3-4458-993a-780ab047d4e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-145440789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09136fc9ddd9408892ac461a306a1618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cc26e3-8a", "ovs_interfaceid": "80cc26e3-8a79-465a-9976-59be5d7eeb72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:42:04 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:42:04 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:42:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-710548924',display_name='tempest-ServersNegativeTestJSON-server-710548924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-710548924',id=28,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09136fc9ddd9408892ac461a306a1618',ramdisk_id='',reservation_id='r-0ygzrpfr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-590131230',owner_user_name='tempest-ServersNegativeTestJSON-590131230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:42:02Z,user_data=None,user_id='9515da5654394bf7b5175d74e7350a42',uuid=8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80cc26e3-8a79-465a-9976-59be5d7eeb72", "address": "fa:16:3e:5d:1f:42", "network": {"id": "2f9cb7ad-5cb3-4458-993a-780ab047d4e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-145440789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09136fc9ddd9408892ac461a306a1618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cc26e3-8a", "ovs_interfaceid": "80cc26e3-8a79-465a-9976-59be5d7eeb72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Converting VIF {"id": "80cc26e3-8a79-465a-9976-59be5d7eeb72", "address": "fa:16:3e:5d:1f:42", "network": {"id": "2f9cb7ad-5cb3-4458-993a-780ab047d4e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-145440789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09136fc9ddd9408892ac461a306a1618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cc26e3-8a", "ovs_interfaceid": "80cc26e3-8a79-465a-9976-59be5d7eeb72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:1f:42,bridge_name='br-int',has_traffic_filtering=True,id=80cc26e3-8a79-465a-9976-59be5d7eeb72,network=Network(2f9cb7ad-5cb3-4458-993a-780ab047d4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80cc26e3-8a') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.objects.instance [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lazy-loading 'pci_devices' on Instance uuid 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:42:04 user nova-compute[73010]:   <uuid>8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09</uuid>
Aug 15 00:42:04 user nova-compute[73010]:   <name>instance-0000001c</name>
Aug 15 00:42:04 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:42:04 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:42:04 user nova-compute[73010]:   <metadata>
Aug 15 00:42:04 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:42:04 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:42:04 user nova-compute[73010]:       <nova:name>tempest-ServersNegativeTestJSON-server-710548924</nova:name>
Aug 15 00:42:04 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:42:04</nova:creationTime>
Aug 15 00:42:04 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:42:04 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:42:04 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:42:04 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:42:04 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:42:04 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:42:04 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:42:04 user nova-compute[73010]:       <nova:owner>
Aug 15 00:42:04 user nova-compute[73010]:         <nova:user uuid="9515da5654394bf7b5175d74e7350a42">tempest-ServersNegativeTestJSON-590131230-project-member</nova:user>
Aug 15 00:42:04 user nova-compute[73010]:         <nova:project uuid="09136fc9ddd9408892ac461a306a1618">tempest-ServersNegativeTestJSON-590131230</nova:project>
Aug 15 00:42:04 user nova-compute[73010]:       </nova:owner>
Aug 15 00:42:04 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:42:04 user nova-compute[73010]:       <nova:ports>
Aug 15 00:42:04 user nova-compute[73010]:         <nova:port uuid="80cc26e3-8a79-465a-9976-59be5d7eeb72">
Aug 15 00:42:04 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 00:42:04 user nova-compute[73010]:         </nova:port>
Aug 15 00:42:04 user nova-compute[73010]:       </nova:ports>
Aug 15 00:42:04 user nova-compute[73010]:     </nova:instance>
Aug 15 00:42:04 user nova-compute[73010]:   </metadata>
Aug 15 00:42:04 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:42:04 user nova-compute[73010]:     <system>
Aug 15 00:42:04 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:42:04 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:42:04 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:42:04 user nova-compute[73010]:       <entry name="serial">8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09</entry>
Aug 15 00:42:04 user nova-compute[73010]:       <entry name="uuid">8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09</entry>
Aug 15 00:42:04 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:42:04 user nova-compute[73010]:     </system>
Aug 15 00:42:04 user nova-compute[73010]:   </sysinfo>
Aug 15 00:42:04 user nova-compute[73010]:   <os>
Aug 15 00:42:04 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:42:04 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:42:04 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:42:04 user nova-compute[73010]:   </os>
Aug 15 00:42:04 user nova-compute[73010]:   <features>
Aug 15 00:42:04 user nova-compute[73010]:     <acpi/>
Aug 15 00:42:04 user nova-compute[73010]:     <apic/>
Aug 15 00:42:04 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:42:04 user nova-compute[73010]:   </features>
Aug 15 00:42:04 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:42:04 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:42:04 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:42:04 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:42:04 user nova-compute[73010]:   </clock>
Aug 15 00:42:04 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:42:04 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:42:04 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:42:04 user nova-compute[73010]:   </cpu>
Aug 15 00:42:04 user nova-compute[73010]:   <devices>
Aug 15 00:42:04 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:42:04 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:42:04 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk"/>
Aug 15 00:42:04 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:42:04 user nova-compute[73010]:     </disk>
Aug 15 00:42:04 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:42:04 user nova-compute[73010]:       <mac address="fa:16:3e:5d:1f:42"/>
Aug 15 00:42:04 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:42:04 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:42:04 user nova-compute[73010]:       <target dev="tap80cc26e3-8a"/>
Aug 15 00:42:04 user nova-compute[73010]:     </interface>
Aug 15 00:42:04 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:42:04 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/console.log" append="off"/>
Aug 15 00:42:04 user nova-compute[73010]:     </serial>
Aug 15 00:42:04 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:42:04 user nova-compute[73010]:     <video>
Aug 15 00:42:04 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:42:04 user nova-compute[73010]:     </video>
Aug 15 00:42:04 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:42:04 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:42:04 user nova-compute[73010]:     </rng>
Aug 15 00:42:04 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:42:04 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:42:04 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:42:04 user nova-compute[73010]:     </memballoon>
Aug 15 00:42:04 user nova-compute[73010]:   </devices>
Aug 15 00:42:04 user nova-compute[73010]: </domain>
Aug 15 00:42:04 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:42:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-710548924',display_name='tempest-ServersNegativeTestJSON-server-710548924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-710548924',id=28,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09136fc9ddd9408892ac461a306a1618',ramdisk_id='',reservation_id='r-0ygzrpfr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-590131230',owner_user_name='tempest-ServersNegativeTestJSON-590131230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:42:02Z,user_data=None,user_id='9515da5654394bf7b5175d74e7350a42',uuid=8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80cc26e3-8a79-465a-9976-59be5d7eeb72", "address": "fa:16:3e:5d:1f:42", "network": {"id": "2f9cb7ad-5cb3-4458-993a-780ab047d4e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-145440789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09136fc9ddd9408892ac461a306a1618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cc26e3-8a", "ovs_interfaceid": "80cc26e3-8a79-465a-9976-59be5d7eeb72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Converting VIF {"id": "80cc26e3-8a79-465a-9976-59be5d7eeb72", "address": "fa:16:3e:5d:1f:42", "network": {"id": "2f9cb7ad-5cb3-4458-993a-780ab047d4e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-145440789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09136fc9ddd9408892ac461a306a1618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cc26e3-8a", "ovs_interfaceid": "80cc26e3-8a79-465a-9976-59be5d7eeb72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:1f:42,bridge_name='br-int',has_traffic_filtering=True,id=80cc26e3-8a79-465a-9976-59be5d7eeb72,network=Network(2f9cb7ad-5cb3-4458-993a-780ab047d4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80cc26e3-8a') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG os_vif [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:1f:42,bridge_name='br-int',has_traffic_filtering=True,id=80cc26e3-8a79-465a-9976-59be5d7eeb72,network=Network(2f9cb7ad-5cb3-4458-993a-780ab047d4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80cc26e3-8a') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80cc26e3-8a, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap80cc26e3-8a, col_values=(('external_ids', {'iface-id': '80cc26e3-8a79-465a-9976-59be5d7eeb72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:1f:42', 'vm-uuid': '8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:04 user nova-compute[73010]: INFO os_vif [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:1f:42,bridge_name='br-int',has_traffic_filtering=True,id=80cc26e3-8a79-465a-9976-59be5d7eeb72,network=Network(2f9cb7ad-5cb3-4458-993a-780ab047d4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80cc26e3-8a')
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] No VIF found with MAC fa:16:3e:5d:1f:42, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.network.neutron [req-d371e829-b316-4ac3-9126-63e8846a5212 req-30825b77-e800-46fd-8363-a11fbd962676 service nova] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Updated VIF entry in instance network info cache for port 80cc26e3-8a79-465a-9976-59be5d7eeb72. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG nova.network.neutron [req-d371e829-b316-4ac3-9126-63e8846a5212 req-30825b77-e800-46fd-8363-a11fbd962676 service nova] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Updating instance_info_cache with network_info: [{"id": "80cc26e3-8a79-465a-9976-59be5d7eeb72", "address": "fa:16:3e:5d:1f:42", "network": {"id": "2f9cb7ad-5cb3-4458-993a-780ab047d4e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-145440789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09136fc9ddd9408892ac461a306a1618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cc26e3-8a", "ovs_interfaceid": "80cc26e3-8a79-465a-9976-59be5d7eeb72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:42:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d371e829-b316-4ac3-9126-63e8846a5212 req-30825b77-e800-46fd-8363-a11fbd962676 service nova] Releasing lock "refresh_cache-8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:42:05 user nova-compute[73010]: DEBUG nova.compute.manager [req-7666c868-82bd-4309-b1ad-9dce9fb53fb3 req-ecfa02a3-91dc-4d24-909d-6276cdbdac0a service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Received event network-vif-plugged-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:42:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7666c868-82bd-4309-b1ad-9dce9fb53fb3 req-ecfa02a3-91dc-4d24-909d-6276cdbdac0a service nova] Acquiring lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7666c868-82bd-4309-b1ad-9dce9fb53fb3 req-ecfa02a3-91dc-4d24-909d-6276cdbdac0a service nova] Lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7666c868-82bd-4309-b1ad-9dce9fb53fb3 req-ecfa02a3-91dc-4d24-909d-6276cdbdac0a service nova] Lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:05 user nova-compute[73010]: DEBUG nova.compute.manager [req-7666c868-82bd-4309-b1ad-9dce9fb53fb3 req-ecfa02a3-91dc-4d24-909d-6276cdbdac0a service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] No waiting events found dispatching network-vif-plugged-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:42:05 user nova-compute[73010]: WARNING nova.compute.manager [req-7666c868-82bd-4309-b1ad-9dce9fb53fb3 req-ecfa02a3-91dc-4d24-909d-6276cdbdac0a service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Received unexpected event network-vif-plugged-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa for instance with vm_state active and task_state rescuing.
Aug 15 00:42:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:07 user nova-compute[73010]: DEBUG nova.compute.manager [req-a4ab1981-7d12-441d-a388-169d5a2531ed req-baa897dd-a894-4254-a1d4-f8e73bb1e217 service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Received event network-vif-plugged-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:42:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a4ab1981-7d12-441d-a388-169d5a2531ed req-baa897dd-a894-4254-a1d4-f8e73bb1e217 service nova] Acquiring lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a4ab1981-7d12-441d-a388-169d5a2531ed req-baa897dd-a894-4254-a1d4-f8e73bb1e217 service nova] Lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a4ab1981-7d12-441d-a388-169d5a2531ed req-baa897dd-a894-4254-a1d4-f8e73bb1e217 service nova] Lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:07 user nova-compute[73010]: DEBUG nova.compute.manager [req-a4ab1981-7d12-441d-a388-169d5a2531ed req-baa897dd-a894-4254-a1d4-f8e73bb1e217 service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] No waiting events found dispatching network-vif-plugged-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:42:07 user nova-compute[73010]: WARNING nova.compute.manager [req-a4ab1981-7d12-441d-a388-169d5a2531ed req-baa897dd-a894-4254-a1d4-f8e73bb1e217 service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Received unexpected event network-vif-plugged-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa for instance with vm_state active and task_state rescuing.
Aug 15 00:42:07 user nova-compute[73010]: DEBUG nova.compute.manager [req-a4ab1981-7d12-441d-a388-169d5a2531ed req-baa897dd-a894-4254-a1d4-f8e73bb1e217 service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Received event network-vif-plugged-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:42:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a4ab1981-7d12-441d-a388-169d5a2531ed req-baa897dd-a894-4254-a1d4-f8e73bb1e217 service nova] Acquiring lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a4ab1981-7d12-441d-a388-169d5a2531ed req-baa897dd-a894-4254-a1d4-f8e73bb1e217 service nova] Lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a4ab1981-7d12-441d-a388-169d5a2531ed req-baa897dd-a894-4254-a1d4-f8e73bb1e217 service nova] Lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:07 user nova-compute[73010]: DEBUG nova.compute.manager [req-a4ab1981-7d12-441d-a388-169d5a2531ed req-baa897dd-a894-4254-a1d4-f8e73bb1e217 service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] No waiting events found dispatching network-vif-plugged-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:42:07 user nova-compute[73010]: WARNING nova.compute.manager [req-a4ab1981-7d12-441d-a388-169d5a2531ed req-baa897dd-a894-4254-a1d4-f8e73bb1e217 service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Received unexpected event network-vif-plugged-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa for instance with vm_state active and task_state rescuing.
Aug 15 00:42:07 user nova-compute[73010]: DEBUG nova.compute.manager [req-d0760cac-06c3-48d8-871c-a0da9e5156c7 req-c180c931-6c4b-4ba7-8806-9a54de1bd506 service nova] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Received event network-vif-plugged-80cc26e3-8a79-465a-9976-59be5d7eeb72 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:42:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d0760cac-06c3-48d8-871c-a0da9e5156c7 req-c180c931-6c4b-4ba7-8806-9a54de1bd506 service nova] Acquiring lock "8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d0760cac-06c3-48d8-871c-a0da9e5156c7 req-c180c931-6c4b-4ba7-8806-9a54de1bd506 service nova] Lock "8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d0760cac-06c3-48d8-871c-a0da9e5156c7 req-c180c931-6c4b-4ba7-8806-9a54de1bd506 service nova] Lock "8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:07 user nova-compute[73010]: DEBUG nova.compute.manager [req-d0760cac-06c3-48d8-871c-a0da9e5156c7 req-c180c931-6c4b-4ba7-8806-9a54de1bd506 service nova] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] No waiting events found dispatching network-vif-plugged-80cc26e3-8a79-465a-9976-59be5d7eeb72 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:42:07 user nova-compute[73010]: WARNING nova.compute.manager [req-d0760cac-06c3-48d8-871c-a0da9e5156c7 req-c180c931-6c4b-4ba7-8806-9a54de1bd506 service nova] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Received unexpected event network-vif-plugged-80cc26e3-8a79-465a-9976-59be5d7eeb72 for instance with vm_state building and task_state spawning.
Aug 15 00:42:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Removed pending event for 4b489f97-c8d4-4a6a-8404-e1a05a990261 due to event {{(pid=73010) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060129.534476, 4b489f97-c8d4-4a6a-8404-e1a05a990261 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:42:09 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] VM Resumed (Lifecycle Event)
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8ba1af19-3078-44a4-970b-078a0871a694 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.compute.manager [req-aad914d4-ef1c-4bfb-8075-ad5479b1977c req-bcb97759-7c74-46b4-b2d1-73b5c631520e service nova] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Received event network-vif-plugged-80cc26e3-8a79-465a-9976-59be5d7eeb72 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-aad914d4-ef1c-4bfb-8075-ad5479b1977c req-bcb97759-7c74-46b4-b2d1-73b5c631520e service nova] Acquiring lock "8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-aad914d4-ef1c-4bfb-8075-ad5479b1977c req-bcb97759-7c74-46b4-b2d1-73b5c631520e service nova] Lock "8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-aad914d4-ef1c-4bfb-8075-ad5479b1977c req-bcb97759-7c74-46b4-b2d1-73b5c631520e service nova] Lock "8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.compute.manager [req-aad914d4-ef1c-4bfb-8075-ad5479b1977c req-bcb97759-7c74-46b4-b2d1-73b5c631520e service nova] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] No waiting events found dispatching network-vif-plugged-80cc26e3-8a79-465a-9976-59be5d7eeb72 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:42:09 user nova-compute[73010]: WARNING nova.compute.manager [req-aad914d4-ef1c-4bfb-8075-ad5479b1977c req-bcb97759-7c74-46b4-b2d1-73b5c631520e service nova] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Received unexpected event network-vif-plugged-80cc26e3-8a79-465a-9976-59be5d7eeb72 for instance with vm_state building and task_state spawning.
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:42:09 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Creating image(s)
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Did not create local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Ensure instance console log exists: /opt/stack/data/nova/instances/6bf89433-15f9-44fd-a4c1-00b72287f65f/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Start _get_guest_xml network_info=[{"id": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "address": "fa:16:3e:e1:57:94", "network": {"id": "df55f352-d3b0-4133-939b-74d35a420b49", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159866404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869253a2da7e4e95bb720ab7b203284c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c6a8bc-4f", "ovs_interfaceid": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpZGkKBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6bf89433-15f9-44fd-a4c1-00b72287f65f', 'attached_at': '', 'detached_at': '', 'volume_id': '83bdf3fa-8592-419d-90c9-a3d7a56f1a2c', 'serial': '83bdf3fa-8592-419d-90c9-a3d7a56f1a2c'}, 'disk_bus': 'virtio', 'attachment_id': '8877fe3f-8499-444f-b41e-74833cf076b3', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:42:09 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 00:42:09 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:42:09 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060129.5388527, 4b489f97-c8d4-4a6a-8404-e1a05a990261 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:42:09 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] VM Started (Lifecycle Event)
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6bf89433-15f9-44fd-a4c1-00b72287f65f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:42:09 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Instance spawned successfully.
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpZGkKBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:42:09 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 00:42:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:42:09 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 00:42:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:42:09 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060129.6366935, 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:42:09 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] VM Resumed (Lifecycle Event)
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[368ad4c7-7366-4ffd-bf27-22ff4d594244]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:42:09 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34587c6-def1-4fdd-9a68-dd42df47faf2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c] added
Aug 15 00:42:09 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:09 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060129.6373687, 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:42:09 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] VM Started (Lifecycle Event)
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbb5630-f185-473f-bf3d-4325ba544205]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:09 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f56b7e-f606-4188-b4e6-424f52f074e7]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xpZGkKBA {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:09 user nova-compute[73010]: INFO nova.compute.manager [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Took 7.72 seconds to spawn the instance on the hypervisor.
Aug 15 00:42:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xpZGkKBA" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9a229b-8f66-42c6-a0de-4bf07ff78c43]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xpZGkKBA'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2670198-499c-4977-b8aa-7e611dc7b1f7]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef957e0-ce48-4bb1-8f53-211ce8db7cb3]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:42:09 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:42:09 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:09 user nova-compute[73010]: INFO nova.compute.manager [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Took 8.53 seconds to build instance.
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa3da41-345f-409e-8481-38c4b040b939]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c, portal: 172.16.0.220,3260]
Aug 15 00:42:09 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c, portal: 172.16.0.220,3260] successful.
Aug 15 00:42:09 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7122fdcf-32c9-42d3-a813-f1c66172ecdd tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.651s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04cadc4-a06b-4105-9e6f-2f4a4f5e232c]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d2fb0b-b72a-4fc3-8786-155366388de9]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:42:10 user nova-compute[73010]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:42:10 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:42:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:42:10 user nova-compute[73010]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:42:10 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:42:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:42:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:42:10 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:42:10 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:42:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8c959c-dcfc-48c1-a9a0-c5a0dad46a2f]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:10 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:42:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpZGkKBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:42:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:42:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23264383964393930', 'path': '/dev/sdc'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:42:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264383964393930', 'path': '/dev/sdc'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:42:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T00:39:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1847309333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-100459501',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMvoU/VZ3MSVvKPEfl46VySM54g5gxjuVwvlv2ViBOX1qb9sxUhG896E4HXK1GlhKtb8cZiIme4xtoJu/nd/1zEHxtFmbxdZPCP6Pee/6tKM6u6rfoWMfAG7Psx72fYJg==',key_name='tempest-keypair-848269880',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:40:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='869253a2da7e4e95bb720ab7b203284c',ramdisk_id='',reservation_id='r-xs10r9gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-710111316',owner_user_name='tempest-ServerActionsV293TestJSON-710111316-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:41:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19782b910361424ba7740c41f9331814',uuid=6bf89433-15f9-44fd-a4c1-00b72287f65f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "address": "fa:16:3e:e1:57:94", "network": {"id": "df55f352-d3b0-4133-939b-74d35a420b49", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159866404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869253a2da7e4e95bb720ab7b203284c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c6a8bc-4f", "ovs_interfaceid": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:42:11 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Converting VIF {"id": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "address": "fa:16:3e:e1:57:94", "network": {"id": "df55f352-d3b0-4133-939b-74d35a420b49", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159866404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869253a2da7e4e95bb720ab7b203284c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c6a8bc-4f", "ovs_interfaceid": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:42:11 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:57:94,bridge_name='br-int',has_traffic_filtering=True,id=f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8,network=Network(df55f352-d3b0-4133-939b-74d35a420b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c6a8bc-4f') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:42:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:42:11 user nova-compute[73010]:   <uuid>6bf89433-15f9-44fd-a4c1-00b72287f65f</uuid>
Aug 15 00:42:11 user nova-compute[73010]:   <name>instance-00000015</name>
Aug 15 00:42:11 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:42:11 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:42:11 user nova-compute[73010]:   <metadata>
Aug 15 00:42:11 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:42:11 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:42:11 user nova-compute[73010]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1847309333</nova:name>
Aug 15 00:42:11 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:42:09</nova:creationTime>
Aug 15 00:42:11 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:42:11 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:42:11 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:42:11 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:42:11 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:42:11 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:42:11 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:42:11 user nova-compute[73010]:       <nova:owner>
Aug 15 00:42:11 user nova-compute[73010]:         <nova:user uuid="19782b910361424ba7740c41f9331814">tempest-ServerActionsV293TestJSON-710111316-project-member</nova:user>
Aug 15 00:42:11 user nova-compute[73010]:         <nova:project uuid="869253a2da7e4e95bb720ab7b203284c">tempest-ServerActionsV293TestJSON-710111316</nova:project>
Aug 15 00:42:11 user nova-compute[73010]:       </nova:owner>
Aug 15 00:42:11 user nova-compute[73010]:       <nova:ports>
Aug 15 00:42:11 user nova-compute[73010]:         <nova:port uuid="f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8">
Aug 15 00:42:11 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 00:42:11 user nova-compute[73010]:         </nova:port>
Aug 15 00:42:11 user nova-compute[73010]:       </nova:ports>
Aug 15 00:42:11 user nova-compute[73010]:     </nova:instance>
Aug 15 00:42:11 user nova-compute[73010]:   </metadata>
Aug 15 00:42:11 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:42:11 user nova-compute[73010]:     <system>
Aug 15 00:42:11 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:42:11 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:42:11 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:42:11 user nova-compute[73010]:       <entry name="serial">6bf89433-15f9-44fd-a4c1-00b72287f65f</entry>
Aug 15 00:42:11 user nova-compute[73010]:       <entry name="uuid">6bf89433-15f9-44fd-a4c1-00b72287f65f</entry>
Aug 15 00:42:11 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:42:11 user nova-compute[73010]:     </system>
Aug 15 00:42:11 user nova-compute[73010]:   </sysinfo>
Aug 15 00:42:11 user nova-compute[73010]:   <os>
Aug 15 00:42:11 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:42:11 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:42:11 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:42:11 user nova-compute[73010]:   </os>
Aug 15 00:42:11 user nova-compute[73010]:   <features>
Aug 15 00:42:11 user nova-compute[73010]:     <acpi/>
Aug 15 00:42:11 user nova-compute[73010]:     <apic/>
Aug 15 00:42:11 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:42:11 user nova-compute[73010]:   </features>
Aug 15 00:42:11 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:42:11 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:42:11 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:42:11 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:42:11 user nova-compute[73010]:   </clock>
Aug 15 00:42:11 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:42:11 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:42:11 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:42:11 user nova-compute[73010]:   </cpu>
Aug 15 00:42:11 user nova-compute[73010]:   <devices>
Aug 15 00:42:11 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 00:42:11 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:42:11 user nova-compute[73010]:       <source dev="/dev/sdc"/>
Aug 15 00:42:11 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:42:11 user nova-compute[73010]:       <serial>83bdf3fa-8592-419d-90c9-a3d7a56f1a2c</serial>
Aug 15 00:42:11 user nova-compute[73010]:     </disk>
Aug 15 00:42:11 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:42:11 user nova-compute[73010]:       <mac address="fa:16:3e:e1:57:94"/>
Aug 15 00:42:11 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:42:11 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:42:11 user nova-compute[73010]:       <target dev="tapf5c6a8bc-4f"/>
Aug 15 00:42:11 user nova-compute[73010]:     </interface>
Aug 15 00:42:11 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:42:11 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/6bf89433-15f9-44fd-a4c1-00b72287f65f/console.log" append="off"/>
Aug 15 00:42:11 user nova-compute[73010]:     </serial>
Aug 15 00:42:11 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:42:11 user nova-compute[73010]:     <video>
Aug 15 00:42:11 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:42:11 user nova-compute[73010]:     </video>
Aug 15 00:42:11 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:42:11 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:42:11 user nova-compute[73010]:     </rng>
Aug 15 00:42:11 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:42:11 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:42:11 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:42:11 user nova-compute[73010]:     </memballoon>
Aug 15 00:42:11 user nova-compute[73010]:   </devices>
Aug 15 00:42:11 user nova-compute[73010]: </domain>
Aug 15 00:42:11 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:42:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T00:39:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1847309333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-100459501',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMvoU/VZ3MSVvKPEfl46VySM54g5gxjuVwvlv2ViBOX1qb9sxUhG896E4HXK1GlhKtb8cZiIme4xtoJu/nd/1zEHxtFmbxdZPCP6Pee/6tKM6u6rfoWMfAG7Psx72fYJg==',key_name='tempest-keypair-848269880',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:40:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='869253a2da7e4e95bb720ab7b203284c',ramdisk_id='',reservation_id='r-xs10r9gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-710111316',owner_user_name='tempest-ServerActionsV293TestJSON-710111316-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:41:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19782b910361424ba7740c41f9331814',uuid=6bf89433-15f9-44fd-a4c1-00b72287f65f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "address": "fa:16:3e:e1:57:94", "network": {"id": "df55f352-d3b0-4133-939b-74d35a420b49", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159866404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869253a2da7e4e95bb720ab7b203284c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c6a8bc-4f", "ovs_interfaceid": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:42:11 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Converting VIF {"id": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "address": "fa:16:3e:e1:57:94", "network": {"id": "df55f352-d3b0-4133-939b-74d35a420b49", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159866404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869253a2da7e4e95bb720ab7b203284c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c6a8bc-4f", "ovs_interfaceid": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:42:11 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:57:94,bridge_name='br-int',has_traffic_filtering=True,id=f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8,network=Network(df55f352-d3b0-4133-939b-74d35a420b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c6a8bc-4f') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:42:11 user nova-compute[73010]: DEBUG os_vif [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:57:94,bridge_name='br-int',has_traffic_filtering=True,id=f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8,network=Network(df55f352-d3b0-4133-939b-74d35a420b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c6a8bc-4f') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:42:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:42:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:42:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5c6a8bc-4f, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:42:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf5c6a8bc-4f, col_values=(('external_ids', {'iface-id': 'f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:57:94', 'vm-uuid': '6bf89433-15f9-44fd-a4c1-00b72287f65f'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:42:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:42:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:11 user nova-compute[73010]: INFO os_vif [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:57:94,bridge_name='br-int',has_traffic_filtering=True,id=f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8,network=Network(df55f352-d3b0-4133-939b-74d35a420b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c6a8bc-4f')
Aug 15 00:42:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:42:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] No VIF found with MAC fa:16:3e:e1:57:94, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:42:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-684ec3cc-7482-40ef-b18b-58ba7239f917 req-e1762b23-65c5-4e5b-971d-a59ebd3efdf1 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Received event network-vif-plugged-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:42:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-684ec3cc-7482-40ef-b18b-58ba7239f917 req-e1762b23-65c5-4e5b-971d-a59ebd3efdf1 service nova] Acquiring lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-684ec3cc-7482-40ef-b18b-58ba7239f917 req-e1762b23-65c5-4e5b-971d-a59ebd3efdf1 service nova] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-684ec3cc-7482-40ef-b18b-58ba7239f917 req-e1762b23-65c5-4e5b-971d-a59ebd3efdf1 service nova] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-684ec3cc-7482-40ef-b18b-58ba7239f917 req-e1762b23-65c5-4e5b-971d-a59ebd3efdf1 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] No waiting events found dispatching network-vif-plugged-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:42:12 user nova-compute[73010]: WARNING nova.compute.manager [req-684ec3cc-7482-40ef-b18b-58ba7239f917 req-e1762b23-65c5-4e5b-971d-a59ebd3efdf1 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Received unexpected event network-vif-plugged-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 for instance with vm_state active and task_state rebuild_spawning.
Aug 15 00:42:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:14 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060134.7543585, 6bf89433-15f9-44fd-a4c1-00b72287f65f => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:42:14 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] VM Resumed (Lifecycle Event)
Aug 15 00:42:14 user nova-compute[73010]: DEBUG nova.compute.manager [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:42:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:42:14 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Instance spawned successfully.
Aug 15 00:42:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:42:14 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:42:14 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:42:14 user nova-compute[73010]: DEBUG nova.compute.manager [req-8f13f7d9-5150-455f-9db2-e7580e1094fc req-94bc0c08-6bc0-4149-988f-7872c839da4e service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Received event network-vif-plugged-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:42:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-8f13f7d9-5150-455f-9db2-e7580e1094fc req-94bc0c08-6bc0-4149-988f-7872c839da4e service nova] Acquiring lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-8f13f7d9-5150-455f-9db2-e7580e1094fc req-94bc0c08-6bc0-4149-988f-7872c839da4e service nova] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-8f13f7d9-5150-455f-9db2-e7580e1094fc req-94bc0c08-6bc0-4149-988f-7872c839da4e service nova] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:14 user nova-compute[73010]: DEBUG nova.compute.manager [req-8f13f7d9-5150-455f-9db2-e7580e1094fc req-94bc0c08-6bc0-4149-988f-7872c839da4e service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] No waiting events found dispatching network-vif-plugged-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:42:14 user nova-compute[73010]: WARNING nova.compute.manager [req-8f13f7d9-5150-455f-9db2-e7580e1094fc req-94bc0c08-6bc0-4149-988f-7872c839da4e service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Received unexpected event network-vif-plugged-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 for instance with vm_state active and task_state rebuild_spawning.
Aug 15 00:42:14 user nova-compute[73010]: DEBUG nova.compute.manager [req-8f13f7d9-5150-455f-9db2-e7580e1094fc req-94bc0c08-6bc0-4149-988f-7872c839da4e service nova] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Received event network-changed-db655edd-5181-47db-ba3c-4a79af26528e {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:42:14 user nova-compute[73010]: DEBUG nova.compute.manager [req-8f13f7d9-5150-455f-9db2-e7580e1094fc req-94bc0c08-6bc0-4149-988f-7872c839da4e service nova] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Refreshing instance network info cache due to event network-changed-db655edd-5181-47db-ba3c-4a79af26528e. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:42:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-8f13f7d9-5150-455f-9db2-e7580e1094fc req-94bc0c08-6bc0-4149-988f-7872c839da4e service nova] Acquiring lock "refresh_cache-98fa0e64-cf36-4991-924d-ba4b713239d0" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:42:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-8f13f7d9-5150-455f-9db2-e7580e1094fc req-94bc0c08-6bc0-4149-988f-7872c839da4e service nova] Acquired lock "refresh_cache-98fa0e64-cf36-4991-924d-ba4b713239d0" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:42:14 user nova-compute[73010]: DEBUG nova.network.neutron [req-8f13f7d9-5150-455f-9db2-e7580e1094fc req-94bc0c08-6bc0-4149-988f-7872c839da4e service nova] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Refreshing network info cache for port db655edd-5181-47db-ba3c-4a79af26528e {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:42:15 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 00:42:15 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060134.758341, 6bf89433-15f9-44fd-a4c1-00b72287f65f => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:42:15 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] VM Started (Lifecycle Event)
Aug 15 00:42:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:42:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:42:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:42:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:42:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:42:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:42:15 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:42:15 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:42:15 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 00:42:15 user nova-compute[73010]: DEBUG nova.compute.manager [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:42:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:15 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73010) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 00:42:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b2d43a67-8612-4a57-bb65-ee1de225a734 tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.100s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:15 user nova-compute[73010]: DEBUG nova.network.neutron [req-8f13f7d9-5150-455f-9db2-e7580e1094fc req-94bc0c08-6bc0-4149-988f-7872c839da4e service nova] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Updated VIF entry in instance network info cache for port db655edd-5181-47db-ba3c-4a79af26528e. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:42:15 user nova-compute[73010]: DEBUG nova.network.neutron [req-8f13f7d9-5150-455f-9db2-e7580e1094fc req-94bc0c08-6bc0-4149-988f-7872c839da4e service nova] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Updating instance_info_cache with network_info: [{"id": "db655edd-5181-47db-ba3c-4a79af26528e", "address": "fa:16:3e:1d:6a:3d", "network": {"id": "536a7c12-166a-4d44-b705-ea1ac348601d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-841639308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5a9782c512458e971f2bdf28a579c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb655edd-51", "ovs_interfaceid": "db655edd-5181-47db-ba3c-4a79af26528e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:42:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-8f13f7d9-5150-455f-9db2-e7580e1094fc req-94bc0c08-6bc0-4149-988f-7872c839da4e service nova] Releasing lock "refresh_cache-98fa0e64-cf36-4991-924d-ba4b713239d0" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:42:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "98fa0e64-cf36-4991-924d-ba4b713239d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG nova.objects.instance [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lazy-loading 'flavor' on Instance uuid 98fa0e64-cf36-4991-924d-ba4b713239d0 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "98fa0e64-cf36-4991-924d-ba4b713239d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:19 user nova-compute[73010]: INFO nova.compute.manager [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Attaching volume fde18e9c-9183-4a6a-bf17-8af0c5008d11 to /dev/vdb
Aug 15 00:42:19 user nova-compute[73010]: DEBUG os_brick.utils [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0499c04-dcd0-452d-9ee7-888899159b8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[04615ab6-a45e-4888-a363-9716c4f17b1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[434833b6-a526-449a-8b24-06d16e204fca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[da51e558-d2ca-48bb-8eb7-279dcc684864]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:42:19 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:42:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efc0214-34ca-43cf-bb79-48c2685b689c]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG os_brick.utils [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:42:19 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Updating existing volume attachment record: 995a0190-ebe8-4453-961a-4d4199e10add {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:42:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cc19ed64-8312-4b06-9182-6ad257ba8340 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Acquiring lock "84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cc19ed64-8312-4b06-9182-6ad257ba8340 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cc19ed64-8312-4b06-9182-6ad257ba8340 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Acquiring lock "84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cc19ed64-8312-4b06-9182-6ad257ba8340 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cc19ed64-8312-4b06-9182-6ad257ba8340 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:23 user nova-compute[73010]: INFO nova.compute.manager [None req-cc19ed64-8312-4b06-9182-6ad257ba8340 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Terminating instance
Aug 15 00:42:23 user nova-compute[73010]: DEBUG nova.compute.manager [None req-cc19ed64-8312-4b06-9182-6ad257ba8340 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG nova.compute.manager [req-e1734bae-dd6b-47d4-b328-1a4607fc42f7 req-d01f2fad-5592-41a6-a7ca-466f6929ba43 service nova] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Received event network-vif-unplugged-00049ba1-5997-43d4-a713-839f076f490c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e1734bae-dd6b-47d4-b328-1a4607fc42f7 req-d01f2fad-5592-41a6-a7ca-466f6929ba43 service nova] Acquiring lock "84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e1734bae-dd6b-47d4-b328-1a4607fc42f7 req-d01f2fad-5592-41a6-a7ca-466f6929ba43 service nova] Lock "84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e1734bae-dd6b-47d4-b328-1a4607fc42f7 req-d01f2fad-5592-41a6-a7ca-466f6929ba43 service nova] Lock "84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG nova.compute.manager [req-e1734bae-dd6b-47d4-b328-1a4607fc42f7 req-d01f2fad-5592-41a6-a7ca-466f6929ba43 service nova] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] No waiting events found dispatching network-vif-unplugged-00049ba1-5997-43d4-a713-839f076f490c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG nova.compute.manager [req-e1734bae-dd6b-47d4-b328-1a4607fc42f7 req-d01f2fad-5592-41a6-a7ca-466f6929ba43 service nova] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Received event network-vif-unplugged-00049ba1-5997-43d4-a713-839f076f490c for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:42:23 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Instance destroyed successfully.
Aug 15 00:42:23 user nova-compute[73010]: DEBUG nova.objects.instance [None req-cc19ed64-8312-4b06-9182-6ad257ba8340 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lazy-loading 'resources' on Instance uuid 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-cc19ed64-8312-4b06-9182-6ad257ba8340 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:40:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-406316629',display_name='tempest-VolumesActionsTest-instance-406316629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-406316629',id=26,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:40:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3735c817d3d2455ca95902bd1eaea878',ramdisk_id='',reservation_id='r-cijvrhw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1275308888',owner_user_name='tempest-VolumesActionsTest-1275308888-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:40:39Z,user_data=None,user_id='40b76f3f670f4808817395410be6d6bf',uuid=84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00049ba1-5997-43d4-a713-839f076f490c", "address": "fa:16:3e:ac:26:7d", "network": {"id": "258ca453-3ceb-467a-8fc8-f5d5041c510c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1411807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c817d3d2455ca95902bd1eaea878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00049ba1-59", "ovs_interfaceid": "00049ba1-5997-43d4-a713-839f076f490c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-cc19ed64-8312-4b06-9182-6ad257ba8340 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Converting VIF {"id": "00049ba1-5997-43d4-a713-839f076f490c", "address": "fa:16:3e:ac:26:7d", "network": {"id": "258ca453-3ceb-467a-8fc8-f5d5041c510c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1411807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c817d3d2455ca95902bd1eaea878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00049ba1-59", "ovs_interfaceid": "00049ba1-5997-43d4-a713-839f076f490c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-cc19ed64-8312-4b06-9182-6ad257ba8340 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:26:7d,bridge_name='br-int',has_traffic_filtering=True,id=00049ba1-5997-43d4-a713-839f076f490c,network=Network(258ca453-3ceb-467a-8fc8-f5d5041c510c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00049ba1-59') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG os_vif [None req-cc19ed64-8312-4b06-9182-6ad257ba8340 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:26:7d,bridge_name='br-int',has_traffic_filtering=True,id=00049ba1-5997-43d4-a713-839f076f490c,network=Network(258ca453-3ceb-467a-8fc8-f5d5041c510c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00049ba1-59') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00049ba1-59, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:42:23 user nova-compute[73010]: INFO os_vif [None req-cc19ed64-8312-4b06-9182-6ad257ba8340 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:26:7d,bridge_name='br-int',has_traffic_filtering=True,id=00049ba1-5997-43d4-a713-839f076f490c,network=Network(258ca453-3ceb-467a-8fc8-f5d5041c510c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00049ba1-59')
Aug 15 00:42:23 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-cc19ed64-8312-4b06-9182-6ad257ba8340 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Deleting instance files /opt/stack/data/nova/instances/84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a_del
Aug 15 00:42:23 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-cc19ed64-8312-4b06-9182-6ad257ba8340 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Deletion of /opt/stack/data/nova/instances/84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a_del complete
Aug 15 00:42:23 user nova-compute[73010]: INFO nova.compute.manager [None req-cc19ed64-8312-4b06-9182-6ad257ba8340 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 15 00:42:23 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-cc19ed64-8312-4b06-9182-6ad257ba8340 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:42:23 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:42:24 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:42:24 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Took 0.63 seconds to deallocate network for instance.
Aug 15 00:42:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cc19ed64-8312-4b06-9182-6ad257ba8340 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cc19ed64-8312-4b06-9182-6ad257ba8340 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:24 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-cc19ed64-8312-4b06-9182-6ad257ba8340 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:42:24 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-cc19ed64-8312-4b06-9182-6ad257ba8340 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:42:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cc19ed64-8312-4b06-9182-6ad257ba8340 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:25 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-cc19ed64-8312-4b06-9182-6ad257ba8340 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Deleted allocations for instance 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a
Aug 15 00:42:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cc19ed64-8312-4b06-9182-6ad257ba8340 tempest-VolumesActionsTest-1275308888 tempest-VolumesActionsTest-1275308888-project-member] Lock "84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.111s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-b6a8453a-0e42-437a-b36e-52768d55ba66 req-5187832a-3674-4feb-956f-e49b500233ea service nova] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Received event network-vif-plugged-00049ba1-5997-43d4-a713-839f076f490c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:42:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b6a8453a-0e42-437a-b36e-52768d55ba66 req-5187832a-3674-4feb-956f-e49b500233ea service nova] Acquiring lock "84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b6a8453a-0e42-437a-b36e-52768d55ba66 req-5187832a-3674-4feb-956f-e49b500233ea service nova] Lock "84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b6a8453a-0e42-437a-b36e-52768d55ba66 req-5187832a-3674-4feb-956f-e49b500233ea service nova] Lock "84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-b6a8453a-0e42-437a-b36e-52768d55ba66 req-5187832a-3674-4feb-956f-e49b500233ea service nova] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] No waiting events found dispatching network-vif-plugged-00049ba1-5997-43d4-a713-839f076f490c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:42:25 user nova-compute[73010]: WARNING nova.compute.manager [req-b6a8453a-0e42-437a-b36e-52768d55ba66 req-5187832a-3674-4feb-956f-e49b500233ea service nova] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Received unexpected event network-vif-plugged-00049ba1-5997-43d4-a713-839f076f490c for instance with vm_state deleted and task_state None.
Aug 15 00:42:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-b6a8453a-0e42-437a-b36e-52768d55ba66 req-5187832a-3674-4feb-956f-e49b500233ea service nova] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Received event network-vif-deleted-00049ba1-5997-43d4-a713-839f076f490c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:42:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UmiBgcXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:42:29 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:42:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:42:29 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:42:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:42:29 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4d91f5-372e-45dd-9136-72676fc6355f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:42:29 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdd13bc-75aa-467d-b202-344f6f448c07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11] added
Aug 15 00:42:29 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e82971d-c17f-4802-9264-cf81d8566755]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[647c7c2b-017c-4770-8488-16f20e0945cf]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UmiBgcXa {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UmiBgcXa" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b7ff2d-1b91-4649-8f98-98fc912aec07]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UmiBgcXa'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad28f211-7d92-47b8-b00d-fcfdee09479e]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cb8c88-0060-4789-b48f-538d52934c8b]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:42:29 user nova-compute[73010]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:42:29 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:42:29 user nova-compute[73010]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:42:29 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcf33a5-afa8-4b4f-9dcd-8a36606bd299]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11, portal: 172.16.0.220,3260]
Aug 15 00:42:29 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11, portal: 172.16.0.220,3260] successful.
Aug 15 00:42:29 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.051s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6483999-2410-4f3c-b2b3-4cd57e9c901a]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae03998-c034-4fef-ac2e-5bec81fb7f09]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:42:29 user nova-compute[73010]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:42:29 user nova-compute[73010]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 (non-flash)
Aug 15 00:42:29 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:42:29 user nova-compute[73010]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:42:29 user nova-compute[73010]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 (non-flash)
Aug 15 00:42:29 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d009131-d4a0-425e-92fb-4a1daa461c79]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:42:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UmiBgcXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:42:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:42:30 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23333643831346362', 'path': '/dev/sdd'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:42:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333643831346362', 'path': '/dev/sdd'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:42:30 user nova-compute[73010]: DEBUG nova.objects.instance [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lazy-loading 'flavor' on Instance uuid 98fa0e64-cf36-4991-924d-ba4b713239d0 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:42:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:42:30 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:42:30 user nova-compute[73010]:   <source dev="/dev/sdd"/>
Aug 15 00:42:30 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:42:30 user nova-compute[73010]:   <serial>fde18e9c-9183-4a6a-bf17-8af0c5008d11</serial>
Aug 15 00:42:30 user nova-compute[73010]: </disk>
Aug 15 00:42:30 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:42:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:42:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:42:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] No VIF found with MAC fa:16:3e:1d:6a:3d, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:42:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8ebc5d93-749c-4edf-9adc-3e765a86dd45 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.537s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:35 user nova-compute[73010]: DEBUG nova.compute.manager [req-037eaebc-c439-4881-9cc3-86fd93889cc5 req-a510ffc1-4cff-403f-9998-6aa7bf05157a service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Received event network-changed-bf9a1845-c225-4c08-bc5a-929ebdceda57 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:42:35 user nova-compute[73010]: DEBUG nova.compute.manager [req-037eaebc-c439-4881-9cc3-86fd93889cc5 req-a510ffc1-4cff-403f-9998-6aa7bf05157a service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Refreshing instance network info cache due to event network-changed-bf9a1845-c225-4c08-bc5a-929ebdceda57. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:42:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-037eaebc-c439-4881-9cc3-86fd93889cc5 req-a510ffc1-4cff-403f-9998-6aa7bf05157a service nova] Acquiring lock "refresh_cache-4b5baaac-bb54-462c-b833-4f37de8f24dc" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:42:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-037eaebc-c439-4881-9cc3-86fd93889cc5 req-a510ffc1-4cff-403f-9998-6aa7bf05157a service nova] Acquired lock "refresh_cache-4b5baaac-bb54-462c-b833-4f37de8f24dc" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:42:35 user nova-compute[73010]: DEBUG nova.network.neutron [req-037eaebc-c439-4881-9cc3-86fd93889cc5 req-a510ffc1-4cff-403f-9998-6aa7bf05157a service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Refreshing network info cache for port bf9a1845-c225-4c08-bc5a-929ebdceda57 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "4b5baaac-bb54-462c-b833-4f37de8f24dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG nova.objects.instance [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lazy-loading 'flavor' on Instance uuid 4b5baaac-bb54-462c-b833-4f37de8f24dc {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.177s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "4b5baaac-bb54-462c-b833-4f37de8f24dc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:36 user nova-compute[73010]: INFO nova.compute.manager [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Attaching volume 81943610-47b7-4bd7-8c92-e9c1f1d115b3 to /dev/vdb
Aug 15 00:42:36 user nova-compute[73010]: DEBUG os_brick.utils [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd4fb1a-558c-4c19-9aa7-54ff4d89f38c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1f0258-72b9-482b-9538-05ad3fd1748b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9e5cfa-07e8-4468-af2d-4094422bbec2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9ada44-e4bd-41ab-8ef3-e62c73fef1b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:42:36 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:42:36 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b0c592-ed89-46a7-8c60-7df49f20ce04]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG os_brick.utils [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Updating existing volume attachment record: 96a3b4ca-57df-446e-84e2-72eca6ee4693 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG nova.network.neutron [req-037eaebc-c439-4881-9cc3-86fd93889cc5 req-a510ffc1-4cff-403f-9998-6aa7bf05157a service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Updated VIF entry in instance network info cache for port bf9a1845-c225-4c08-bc5a-929ebdceda57. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG nova.network.neutron [req-037eaebc-c439-4881-9cc3-86fd93889cc5 req-a510ffc1-4cff-403f-9998-6aa7bf05157a service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Updating instance_info_cache with network_info: [{"id": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "address": "fa:16:3e:ec:63:2a", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9a1845-c2", "ovs_interfaceid": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:42:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-037eaebc-c439-4881-9cc3-86fd93889cc5 req-a510ffc1-4cff-403f-9998-6aa7bf05157a service nova] Releasing lock "refresh_cache-4b5baaac-bb54-462c-b833-4f37de8f24dc" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:42:38 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060143.8626952, 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:42:38 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] VM Stopped (Lifecycle Event)
Aug 15 00:42:38 user nova-compute[73010]: DEBUG nova.compute.manager [None req-9d73ac0b-6ca1-4c16-b8ad-03163cc0b1b2 None None] [instance: 84ce2a4e-e4f5-4ce5-998f-8e6aef471b3a] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:42:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "c844e062-d79e-4c50-a116-4e6a6661e1d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:42:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:39 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:42:39 user nova-compute[73010]: INFO nova.compute.claims [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Claim successful on node user
Aug 15 00:42:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:42:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:39 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:42:39 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:42:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:42:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.322s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:39 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:42:39 user nova-compute[73010]: INFO nova.compute.claims [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Claim successful on node user
Aug 15 00:42:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:42:39 user nova-compute[73010]: DEBUG nova.network.neutron [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:42:39 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:42:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG nova.policy [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53c8150819854d29b1d8c865da2642ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50aaf528c8c4d4ba8d39b3b203b5a52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG nova.compute.manager [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:42:40 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Creating image(s)
Aug 15 00:42:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "/opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "/opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "/opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.203s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.560s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG nova.compute.manager [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG nova.compute.manager [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG nova.network.neutron [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:42:40 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:42:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.189s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG nova.compute.manager [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6/disk 1073741824" returned: 0 in 0.058s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG nova.policy [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '928ab235d55d4bfc86de82f2387c9d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e962745e3a554f2b8f42d97434173a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG nova.compute.manager [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:42:40 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Creating image(s)
Aug 15 00:42:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "/opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "/opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.202s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG nova.network.neutron [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Successfully created port: fa402f22-9164-478b-816a-1b63709fbe59 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.194s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Cannot resize image /opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG nova.objects.instance [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'migration_context' on Instance uuid c844e062-d79e-4c50-a116-4e6a6661e1d6 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Ensure instance console log exists: /opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.202s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4/disk 1073741824" returned: 0 in 0.051s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.196s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG nova.network.neutron [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Successfully created port: b7c4cb21-45d7-4383-8716-d9b5f6de9000 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Cannot resize image /opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG nova.objects.instance [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lazy-loading 'migration_context' on Instance uuid 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Ensure instance console log exists: /opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG nova.network.neutron [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Successfully updated port: fa402f22-9164-478b-816a-1b63709fbe59 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "refresh_cache-c844e062-d79e-4c50-a116-4e6a6661e1d6" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquired lock "refresh_cache-c844e062-d79e-4c50-a116-4e6a6661e1d6" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG nova.network.neutron [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG nova.network.neutron [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-6c64ac3d-7307-47d1-8ac0-1ce57513ed25 req-edcb69db-beaa-4ad7-af14-a5e30d86db65 service nova] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Received event network-changed-fa402f22-9164-478b-816a-1b63709fbe59 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-6c64ac3d-7307-47d1-8ac0-1ce57513ed25 req-edcb69db-beaa-4ad7-af14-a5e30d86db65 service nova] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Refreshing instance network info cache due to event network-changed-fa402f22-9164-478b-816a-1b63709fbe59. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:42:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6c64ac3d-7307-47d1-8ac0-1ce57513ed25 req-edcb69db-beaa-4ad7-af14-a5e30d86db65 service nova] Acquiring lock "refresh_cache-c844e062-d79e-4c50-a116-4e6a6661e1d6" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.network.neutron [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Updating instance_info_cache with network_info: [{"id": "fa402f22-9164-478b-816a-1b63709fbe59", "address": "fa:16:3e:61:cc:e9", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa402f22-91", "ovs_interfaceid": "fa402f22-9164-478b-816a-1b63709fbe59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Releasing lock "refresh_cache-c844e062-d79e-4c50-a116-4e6a6661e1d6" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Instance network_info: |[{"id": "fa402f22-9164-478b-816a-1b63709fbe59", "address": "fa:16:3e:61:cc:e9", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa402f22-91", "ovs_interfaceid": "fa402f22-9164-478b-816a-1b63709fbe59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6c64ac3d-7307-47d1-8ac0-1ce57513ed25 req-edcb69db-beaa-4ad7-af14-a5e30d86db65 service nova] Acquired lock "refresh_cache-c844e062-d79e-4c50-a116-4e6a6661e1d6" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.network.neutron [req-6c64ac3d-7307-47d1-8ac0-1ce57513ed25 req-edcb69db-beaa-4ad7-af14-a5e30d86db65 service nova] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Refreshing network info cache for port fa402f22-9164-478b-816a-1b63709fbe59 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Start _get_guest_xml network_info=[{"id": "fa402f22-9164-478b-816a-1b63709fbe59", "address": "fa:16:3e:61:cc:e9", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa402f22-91", "ovs_interfaceid": "fa402f22-9164-478b-816a-1b63709fbe59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:42:42 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:42:42 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:42:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1214047890',display_name='tempest-AttachVolumeTestJSON-server-1214047890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1214047890',id=29,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLn4vMbR6w+hxE9VRvl3MqN3qRkIWnNg45D49WR2R5zEzcLfvAY0/rjZEh2U1Nd/ptkUVCA9uuyDO7xJUqtSDozWClMO4kBFgFesbi3byRnBamR4dc4JKesil0kATJDKw==',key_name='tempest-keypair-1941125271',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50aaf528c8c4d4ba8d39b3b203b5a52',ramdisk_id='',reservation_id='r-970uy0r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-338922600',owner_user_name='tempest-AttachVolumeTestJSON-338922600-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:42:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53c8150819854d29b1d8c865da2642ca',uuid=c844e062-d79e-4c50-a116-4e6a6661e1d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa402f22-9164-478b-816a-1b63709fbe59", "address": "fa:16:3e:61:cc:e9", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa402f22-91", "ovs_interfaceid": "fa402f22-9164-478b-816a-1b63709fbe59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Converting VIF {"id": "fa402f22-9164-478b-816a-1b63709fbe59", "address": "fa:16:3e:61:cc:e9", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa402f22-91", "ovs_interfaceid": "fa402f22-9164-478b-816a-1b63709fbe59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:cc:e9,bridge_name='br-int',has_traffic_filtering=True,id=fa402f22-9164-478b-816a-1b63709fbe59,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa402f22-91') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.objects.instance [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'pci_devices' on Instance uuid c844e062-d79e-4c50-a116-4e6a6661e1d6 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.network.neutron [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Successfully updated port: b7c4cb21-45d7-4383-8716-d9b5f6de9000 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:42:42 user nova-compute[73010]:   <uuid>c844e062-d79e-4c50-a116-4e6a6661e1d6</uuid>
Aug 15 00:42:42 user nova-compute[73010]:   <name>instance-0000001d</name>
Aug 15 00:42:42 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:42:42 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:42:42 user nova-compute[73010]:   <metadata>
Aug 15 00:42:42 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:42:42 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:42:42 user nova-compute[73010]:       <nova:name>tempest-AttachVolumeTestJSON-server-1214047890</nova:name>
Aug 15 00:42:42 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:42:42</nova:creationTime>
Aug 15 00:42:42 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:42:42 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:42:42 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:42:42 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:42:42 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:42:42 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:42:42 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:42:42 user nova-compute[73010]:       <nova:owner>
Aug 15 00:42:42 user nova-compute[73010]:         <nova:user uuid="53c8150819854d29b1d8c865da2642ca">tempest-AttachVolumeTestJSON-338922600-project-member</nova:user>
Aug 15 00:42:42 user nova-compute[73010]:         <nova:project uuid="e50aaf528c8c4d4ba8d39b3b203b5a52">tempest-AttachVolumeTestJSON-338922600</nova:project>
Aug 15 00:42:42 user nova-compute[73010]:       </nova:owner>
Aug 15 00:42:42 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:42:42 user nova-compute[73010]:       <nova:ports>
Aug 15 00:42:42 user nova-compute[73010]:         <nova:port uuid="fa402f22-9164-478b-816a-1b63709fbe59">
Aug 15 00:42:42 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 00:42:42 user nova-compute[73010]:         </nova:port>
Aug 15 00:42:42 user nova-compute[73010]:       </nova:ports>
Aug 15 00:42:42 user nova-compute[73010]:     </nova:instance>
Aug 15 00:42:42 user nova-compute[73010]:   </metadata>
Aug 15 00:42:42 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:42:42 user nova-compute[73010]:     <system>
Aug 15 00:42:42 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:42:42 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:42:42 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:42:42 user nova-compute[73010]:       <entry name="serial">c844e062-d79e-4c50-a116-4e6a6661e1d6</entry>
Aug 15 00:42:42 user nova-compute[73010]:       <entry name="uuid">c844e062-d79e-4c50-a116-4e6a6661e1d6</entry>
Aug 15 00:42:42 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:42:42 user nova-compute[73010]:     </system>
Aug 15 00:42:42 user nova-compute[73010]:   </sysinfo>
Aug 15 00:42:42 user nova-compute[73010]:   <os>
Aug 15 00:42:42 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:42:42 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:42:42 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:42:42 user nova-compute[73010]:   </os>
Aug 15 00:42:42 user nova-compute[73010]:   <features>
Aug 15 00:42:42 user nova-compute[73010]:     <acpi/>
Aug 15 00:42:42 user nova-compute[73010]:     <apic/>
Aug 15 00:42:42 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:42:42 user nova-compute[73010]:   </features>
Aug 15 00:42:42 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:42:42 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:42:42 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:42:42 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:42:42 user nova-compute[73010]:   </clock>
Aug 15 00:42:42 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:42:42 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:42:42 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:42:42 user nova-compute[73010]:   </cpu>
Aug 15 00:42:42 user nova-compute[73010]:   <devices>
Aug 15 00:42:42 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:42:42 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:42:42 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6/disk"/>
Aug 15 00:42:42 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:42:42 user nova-compute[73010]:     </disk>
Aug 15 00:42:42 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:42:42 user nova-compute[73010]:       <mac address="fa:16:3e:61:cc:e9"/>
Aug 15 00:42:42 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:42:42 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:42:42 user nova-compute[73010]:       <target dev="tapfa402f22-91"/>
Aug 15 00:42:42 user nova-compute[73010]:     </interface>
Aug 15 00:42:42 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:42:42 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6/console.log" append="off"/>
Aug 15 00:42:42 user nova-compute[73010]:     </serial>
Aug 15 00:42:42 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:42:42 user nova-compute[73010]:     <video>
Aug 15 00:42:42 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:42:42 user nova-compute[73010]:     </video>
Aug 15 00:42:42 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:42:42 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:42:42 user nova-compute[73010]:     </rng>
Aug 15 00:42:42 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:42:42 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:42:42 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:42:42 user nova-compute[73010]:     </memballoon>
Aug 15 00:42:42 user nova-compute[73010]:   </devices>
Aug 15 00:42:42 user nova-compute[73010]: </domain>
Aug 15 00:42:42 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:42:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1214047890',display_name='tempest-AttachVolumeTestJSON-server-1214047890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1214047890',id=29,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLn4vMbR6w+hxE9VRvl3MqN3qRkIWnNg45D49WR2R5zEzcLfvAY0/rjZEh2U1Nd/ptkUVCA9uuyDO7xJUqtSDozWClMO4kBFgFesbi3byRnBamR4dc4JKesil0kATJDKw==',key_name='tempest-keypair-1941125271',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50aaf528c8c4d4ba8d39b3b203b5a52',ramdisk_id='',reservation_id='r-970uy0r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-338922600',owner_user_name='tempest-AttachVolumeTestJSON-338922600-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:42:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53c8150819854d29b1d8c865da2642ca',uuid=c844e062-d79e-4c50-a116-4e6a6661e1d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa402f22-9164-478b-816a-1b63709fbe59", "address": "fa:16:3e:61:cc:e9", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa402f22-91", "ovs_interfaceid": "fa402f22-9164-478b-816a-1b63709fbe59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Converting VIF {"id": "fa402f22-9164-478b-816a-1b63709fbe59", "address": "fa:16:3e:61:cc:e9", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa402f22-91", "ovs_interfaceid": "fa402f22-9164-478b-816a-1b63709fbe59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:cc:e9,bridge_name='br-int',has_traffic_filtering=True,id=fa402f22-9164-478b-816a-1b63709fbe59,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa402f22-91') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG os_vif [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:cc:e9,bridge_name='br-int',has_traffic_filtering=True,id=fa402f22-9164-478b-816a-1b63709fbe59,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa402f22-91') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "refresh_cache-5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquired lock "refresh_cache-5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.network.neutron [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa402f22-91, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfa402f22-91, col_values=(('external_ids', {'iface-id': 'fa402f22-9164-478b-816a-1b63709fbe59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:cc:e9', 'vm-uuid': 'c844e062-d79e-4c50-a116-4e6a6661e1d6'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:42 user nova-compute[73010]: INFO os_vif [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:cc:e9,bridge_name='br-int',has_traffic_filtering=True,id=fa402f22-9164-478b-816a-1b63709fbe59,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa402f22-91')
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.compute.manager [req-30134703-36f4-44e5-ab42-0f4b30fb3818 req-0ed715b8-1418-4f17-a825-f5967d94aaf7 service nova] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Received event network-changed-b7c4cb21-45d7-4383-8716-d9b5f6de9000 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.compute.manager [req-30134703-36f4-44e5-ab42-0f4b30fb3818 req-0ed715b8-1418-4f17-a825-f5967d94aaf7 service nova] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Refreshing instance network info cache due to event network-changed-b7c4cb21-45d7-4383-8716-d9b5f6de9000. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-30134703-36f4-44e5-ab42-0f4b30fb3818 req-0ed715b8-1418-4f17-a825-f5967d94aaf7 service nova] Acquiring lock "refresh_cache-5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.network.neutron [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] No VIF found with MAC fa:16:3e:61:cc:e9, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.network.neutron [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Updating instance_info_cache with network_info: [{"id": "b7c4cb21-45d7-4383-8716-d9b5f6de9000", "address": "fa:16:3e:86:b7:e1", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c4cb21-45", "ovs_interfaceid": "b7c4cb21-45d7-4383-8716-d9b5f6de9000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.network.neutron [req-6c64ac3d-7307-47d1-8ac0-1ce57513ed25 req-edcb69db-beaa-4ad7-af14-a5e30d86db65 service nova] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Updated VIF entry in instance network info cache for port fa402f22-9164-478b-816a-1b63709fbe59. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.network.neutron [req-6c64ac3d-7307-47d1-8ac0-1ce57513ed25 req-edcb69db-beaa-4ad7-af14-a5e30d86db65 service nova] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Updating instance_info_cache with network_info: [{"id": "fa402f22-9164-478b-816a-1b63709fbe59", "address": "fa:16:3e:61:cc:e9", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa402f22-91", "ovs_interfaceid": "fa402f22-9164-478b-816a-1b63709fbe59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Releasing lock "refresh_cache-5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Instance network_info: |[{"id": "b7c4cb21-45d7-4383-8716-d9b5f6de9000", "address": "fa:16:3e:86:b7:e1", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c4cb21-45", "ovs_interfaceid": "b7c4cb21-45d7-4383-8716-d9b5f6de9000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-30134703-36f4-44e5-ab42-0f4b30fb3818 req-0ed715b8-1418-4f17-a825-f5967d94aaf7 service nova] Acquired lock "refresh_cache-5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.network.neutron [req-30134703-36f4-44e5-ab42-0f4b30fb3818 req-0ed715b8-1418-4f17-a825-f5967d94aaf7 service nova] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Refreshing network info cache for port b7c4cb21-45d7-4383-8716-d9b5f6de9000 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Start _get_guest_xml network_info=[{"id": "b7c4cb21-45d7-4383-8716-d9b5f6de9000", "address": "fa:16:3e:86:b7:e1", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c4cb21-45", "ovs_interfaceid": "b7c4cb21-45d7-4383-8716-d9b5f6de9000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6c64ac3d-7307-47d1-8ac0-1ce57513ed25 req-edcb69db-beaa-4ad7-af14-a5e30d86db65 service nova] Releasing lock "refresh_cache-c844e062-d79e-4c50-a116-4e6a6661e1d6" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:42:42 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:42:42 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:42:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1531298251',display_name='tempest-AttachVolumeNegativeTest-server-1531298251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1531298251',id=30,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5/hNasas6vAGBh55ekwBkNfiwtmdTuxogu286OghwqdxVOoTqsWI/yqUUuU1U2kvuLPMyUs/C5pFb+SHXzPk6HmvBSKXQIatqgXkG4iYrhi7Ynu5yA3q4gaft3eEfhZw==',key_name='tempest-keypair-1426278430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e962745e3a554f2b8f42d97434173a7a',ramdisk_id='',reservation_id='r-lyvivsr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-865469153',owner_user_name='tempest-AttachVolumeNegativeTest-865469153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:42:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928ab235d55d4bfc86de82f2387c9d06',uuid=5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7c4cb21-45d7-4383-8716-d9b5f6de9000", "address": "fa:16:3e:86:b7:e1", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c4cb21-45", "ovs_interfaceid": "b7c4cb21-45d7-4383-8716-d9b5f6de9000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Converting VIF {"id": "b7c4cb21-45d7-4383-8716-d9b5f6de9000", "address": "fa:16:3e:86:b7:e1", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c4cb21-45", "ovs_interfaceid": "b7c4cb21-45d7-4383-8716-d9b5f6de9000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:b7:e1,bridge_name='br-int',has_traffic_filtering=True,id=b7c4cb21-45d7-4383-8716-d9b5f6de9000,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c4cb21-45') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.objects.instance [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:42:42 user nova-compute[73010]:   <uuid>5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4</uuid>
Aug 15 00:42:42 user nova-compute[73010]:   <name>instance-0000001e</name>
Aug 15 00:42:42 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:42:42 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:42:42 user nova-compute[73010]:   <metadata>
Aug 15 00:42:42 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:42:42 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:42:42 user nova-compute[73010]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1531298251</nova:name>
Aug 15 00:42:42 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:42:42</nova:creationTime>
Aug 15 00:42:42 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:42:42 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:42:42 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:42:42 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:42:42 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:42:42 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:42:42 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:42:42 user nova-compute[73010]:       <nova:owner>
Aug 15 00:42:42 user nova-compute[73010]:         <nova:user uuid="928ab235d55d4bfc86de82f2387c9d06">tempest-AttachVolumeNegativeTest-865469153-project-member</nova:user>
Aug 15 00:42:42 user nova-compute[73010]:         <nova:project uuid="e962745e3a554f2b8f42d97434173a7a">tempest-AttachVolumeNegativeTest-865469153</nova:project>
Aug 15 00:42:42 user nova-compute[73010]:       </nova:owner>
Aug 15 00:42:42 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:42:42 user nova-compute[73010]:       <nova:ports>
Aug 15 00:42:42 user nova-compute[73010]:         <nova:port uuid="b7c4cb21-45d7-4383-8716-d9b5f6de9000">
Aug 15 00:42:42 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 00:42:42 user nova-compute[73010]:         </nova:port>
Aug 15 00:42:42 user nova-compute[73010]:       </nova:ports>
Aug 15 00:42:42 user nova-compute[73010]:     </nova:instance>
Aug 15 00:42:42 user nova-compute[73010]:   </metadata>
Aug 15 00:42:42 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:42:42 user nova-compute[73010]:     <system>
Aug 15 00:42:42 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:42:42 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:42:42 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:42:42 user nova-compute[73010]:       <entry name="serial">5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4</entry>
Aug 15 00:42:42 user nova-compute[73010]:       <entry name="uuid">5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4</entry>
Aug 15 00:42:42 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:42:42 user nova-compute[73010]:     </system>
Aug 15 00:42:42 user nova-compute[73010]:   </sysinfo>
Aug 15 00:42:42 user nova-compute[73010]:   <os>
Aug 15 00:42:42 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:42:42 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:42:42 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:42:42 user nova-compute[73010]:   </os>
Aug 15 00:42:42 user nova-compute[73010]:   <features>
Aug 15 00:42:42 user nova-compute[73010]:     <acpi/>
Aug 15 00:42:42 user nova-compute[73010]:     <apic/>
Aug 15 00:42:42 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:42:42 user nova-compute[73010]:   </features>
Aug 15 00:42:42 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:42:42 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:42:42 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:42:42 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:42:42 user nova-compute[73010]:   </clock>
Aug 15 00:42:42 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:42:42 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:42:42 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:42:42 user nova-compute[73010]:   </cpu>
Aug 15 00:42:42 user nova-compute[73010]:   <devices>
Aug 15 00:42:42 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:42:42 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:42:42 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4/disk"/>
Aug 15 00:42:42 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:42:42 user nova-compute[73010]:     </disk>
Aug 15 00:42:42 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:42:42 user nova-compute[73010]:       <mac address="fa:16:3e:86:b7:e1"/>
Aug 15 00:42:42 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:42:42 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:42:42 user nova-compute[73010]:       <target dev="tapb7c4cb21-45"/>
Aug 15 00:42:42 user nova-compute[73010]:     </interface>
Aug 15 00:42:42 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:42:42 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4/console.log" append="off"/>
Aug 15 00:42:42 user nova-compute[73010]:     </serial>
Aug 15 00:42:42 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:42:42 user nova-compute[73010]:     <video>
Aug 15 00:42:42 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:42:42 user nova-compute[73010]:     </video>
Aug 15 00:42:42 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:42:42 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:42:42 user nova-compute[73010]:     </rng>
Aug 15 00:42:42 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:42:42 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:42:42 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:42:42 user nova-compute[73010]:     </memballoon>
Aug 15 00:42:42 user nova-compute[73010]:   </devices>
Aug 15 00:42:42 user nova-compute[73010]: </domain>
Aug 15 00:42:42 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:42:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1531298251',display_name='tempest-AttachVolumeNegativeTest-server-1531298251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1531298251',id=30,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5/hNasas6vAGBh55ekwBkNfiwtmdTuxogu286OghwqdxVOoTqsWI/yqUUuU1U2kvuLPMyUs/C5pFb+SHXzPk6HmvBSKXQIatqgXkG4iYrhi7Ynu5yA3q4gaft3eEfhZw==',key_name='tempest-keypair-1426278430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e962745e3a554f2b8f42d97434173a7a',ramdisk_id='',reservation_id='r-lyvivsr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-865469153',owner_user_name='tempest-AttachVolumeNegativeTest-865469153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:42:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928ab235d55d4bfc86de82f2387c9d06',uuid=5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7c4cb21-45d7-4383-8716-d9b5f6de9000", "address": "fa:16:3e:86:b7:e1", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c4cb21-45", "ovs_interfaceid": "b7c4cb21-45d7-4383-8716-d9b5f6de9000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Converting VIF {"id": "b7c4cb21-45d7-4383-8716-d9b5f6de9000", "address": "fa:16:3e:86:b7:e1", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c4cb21-45", "ovs_interfaceid": "b7c4cb21-45d7-4383-8716-d9b5f6de9000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:b7:e1,bridge_name='br-int',has_traffic_filtering=True,id=b7c4cb21-45d7-4383-8716-d9b5f6de9000,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c4cb21-45') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG os_vif [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:b7:e1,bridge_name='br-int',has_traffic_filtering=True,id=b7c4cb21-45d7-4383-8716-d9b5f6de9000,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c4cb21-45') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7c4cb21-45, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb7c4cb21-45, col_values=(('external_ids', {'iface-id': 'b7c4cb21-45d7-4383-8716-d9b5f6de9000', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:b7:e1', 'vm-uuid': '5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:42 user nova-compute[73010]: INFO os_vif [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:b7:e1,bridge_name='br-int',has_traffic_filtering=True,id=b7c4cb21-45d7-4383-8716-d9b5f6de9000,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c4cb21-45')
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:42:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] No VIF found with MAC fa:16:3e:86:b7:e1, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:42:43 user nova-compute[73010]: DEBUG nova.network.neutron [req-30134703-36f4-44e5-ab42-0f4b30fb3818 req-0ed715b8-1418-4f17-a825-f5967d94aaf7 service nova] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Updated VIF entry in instance network info cache for port b7c4cb21-45d7-4383-8716-d9b5f6de9000. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:42:43 user nova-compute[73010]: DEBUG nova.network.neutron [req-30134703-36f4-44e5-ab42-0f4b30fb3818 req-0ed715b8-1418-4f17-a825-f5967d94aaf7 service nova] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Updating instance_info_cache with network_info: [{"id": "b7c4cb21-45d7-4383-8716-d9b5f6de9000", "address": "fa:16:3e:86:b7:e1", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c4cb21-45", "ovs_interfaceid": "b7c4cb21-45d7-4383-8716-d9b5f6de9000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:42:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-30134703-36f4-44e5-ab42-0f4b30fb3818 req-0ed715b8-1418-4f17-a825-f5967d94aaf7 service nova] Releasing lock "refresh_cache-5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:42:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:44 user nova-compute[73010]: DEBUG nova.compute.manager [req-34f79767-b81d-43dd-849a-76b2ac65c921 req-82207e8b-f174-40ba-9639-aca13c75f2d8 service nova] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Received event network-vif-plugged-fa402f22-9164-478b-816a-1b63709fbe59 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:42:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-34f79767-b81d-43dd-849a-76b2ac65c921 req-82207e8b-f174-40ba-9639-aca13c75f2d8 service nova] Acquiring lock "c844e062-d79e-4c50-a116-4e6a6661e1d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-34f79767-b81d-43dd-849a-76b2ac65c921 req-82207e8b-f174-40ba-9639-aca13c75f2d8 service nova] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-34f79767-b81d-43dd-849a-76b2ac65c921 req-82207e8b-f174-40ba-9639-aca13c75f2d8 service nova] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:44 user nova-compute[73010]: DEBUG nova.compute.manager [req-34f79767-b81d-43dd-849a-76b2ac65c921 req-82207e8b-f174-40ba-9639-aca13c75f2d8 service nova] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] No waiting events found dispatching network-vif-plugged-fa402f22-9164-478b-816a-1b63709fbe59 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:42:44 user nova-compute[73010]: WARNING nova.compute.manager [req-34f79767-b81d-43dd-849a-76b2ac65c921 req-82207e8b-f174-40ba-9639-aca13c75f2d8 service nova] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Received unexpected event network-vif-plugged-fa402f22-9164-478b-816a-1b63709fbe59 for instance with vm_state building and task_state spawning.
Aug 15 00:42:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMnGUXuE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:42:46 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:42:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:42:46 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:42:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:42:46 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efd906e-084c-4af5-9f61-31ff6f9aed56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:42:46 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e77c06d-b5a7-4f30-8899-db77b92bdec3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3] added
Aug 15 00:42:46 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaf7c0b-13be-4dde-b260-72ac7d4ecac5]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2d272d-8a12-493c-8cb3-ede3b54d58ea]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SMnGUXuE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SMnGUXuE" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c7ed62-e1ad-4b83-b1b1-7e5700c52aac]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SMnGUXuE'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d63cab-b22c-40e6-a525-afbe34bb424f]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7e02ba-013e-4b2d-bfe5-45106cc6c9ad]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:42:46 user nova-compute[73010]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:42:46 user nova-compute[73010]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 (non-flash)
Aug 15 00:42:46 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:42:46 user nova-compute[73010]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:42:46 user nova-compute[73010]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 (non-flash)
Aug 15 00:42:46 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7841a281-6691-4a29-8d21-5a43e841c412]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3, portal: 172.16.0.220,3260]
Aug 15 00:42:46 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3, portal: 172.16.0.220,3260] successful.
Aug 15 00:42:46 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[98da660e-1d17-4e63-8ea6-55d908ea05e7]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9f4f36-b710-4f0e-95ad-c0a73fe3b098]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:42:46 user nova-compute[73010]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:42:46 user nova-compute[73010]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 (non-flash)
Aug 15 00:42:46 user nova-compute[73010]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:42:46 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:42:46 user nova-compute[73010]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:42:46 user nova-compute[73010]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 (non-flash)
Aug 15 00:42:46 user nova-compute[73010]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:42:46 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a017650-a929-484a-893e-5a37eedc8e3c]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: None {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG nova.compute.manager [req-72b8bd6a-2ccb-40b6-a51c-bd54278a3668 req-f06adc40-bc09-4001-954d-314def3a1fb9 service nova] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Received event network-vif-plugged-fa402f22-9164-478b-816a-1b63709fbe59 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-72b8bd6a-2ccb-40b6-a51c-bd54278a3668 req-f06adc40-bc09-4001-954d-314def3a1fb9 service nova] Acquiring lock "c844e062-d79e-4c50-a116-4e6a6661e1d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-72b8bd6a-2ccb-40b6-a51c-bd54278a3668 req-f06adc40-bc09-4001-954d-314def3a1fb9 service nova] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-72b8bd6a-2ccb-40b6-a51c-bd54278a3668 req-f06adc40-bc09-4001-954d-314def3a1fb9 service nova] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG nova.compute.manager [req-72b8bd6a-2ccb-40b6-a51c-bd54278a3668 req-f06adc40-bc09-4001-954d-314def3a1fb9 service nova] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] No waiting events found dispatching network-vif-plugged-fa402f22-9164-478b-816a-1b63709fbe59 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:42:46 user nova-compute[73010]: WARNING nova.compute.manager [req-72b8bd6a-2ccb-40b6-a51c-bd54278a3668 req-f06adc40-bc09-4001-954d-314def3a1fb9 service nova] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Received unexpected event network-vif-plugged-fa402f22-9164-478b-816a-1b63709fbe59 for instance with vm_state building and task_state spawning.
Aug 15 00:42:46 user nova-compute[73010]: DEBUG nova.compute.manager [req-72b8bd6a-2ccb-40b6-a51c-bd54278a3668 req-f06adc40-bc09-4001-954d-314def3a1fb9 service nova] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Received event network-vif-plugged-b7c4cb21-45d7-4383-8716-d9b5f6de9000 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-72b8bd6a-2ccb-40b6-a51c-bd54278a3668 req-f06adc40-bc09-4001-954d-314def3a1fb9 service nova] Acquiring lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-72b8bd6a-2ccb-40b6-a51c-bd54278a3668 req-f06adc40-bc09-4001-954d-314def3a1fb9 service nova] Lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-72b8bd6a-2ccb-40b6-a51c-bd54278a3668 req-f06adc40-bc09-4001-954d-314def3a1fb9 service nova] Lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG nova.compute.manager [req-72b8bd6a-2ccb-40b6-a51c-bd54278a3668 req-f06adc40-bc09-4001-954d-314def3a1fb9 service nova] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] No waiting events found dispatching network-vif-plugged-b7c4cb21-45d7-4383-8716-d9b5f6de9000 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:42:46 user nova-compute[73010]: WARNING nova.compute.manager [req-72b8bd6a-2ccb-40b6-a51c-bd54278a3668 req-f06adc40-bc09-4001-954d-314def3a1fb9 service nova] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Received unexpected event network-vif-plugged-b7c4cb21-45d7-4383-8716-d9b5f6de9000 for instance with vm_state building and task_state spawning.
Aug 15 00:42:46 user nova-compute[73010]: DEBUG nova.compute.manager [req-72b8bd6a-2ccb-40b6-a51c-bd54278a3668 req-f06adc40-bc09-4001-954d-314def3a1fb9 service nova] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Received event network-vif-plugged-b7c4cb21-45d7-4383-8716-d9b5f6de9000 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-72b8bd6a-2ccb-40b6-a51c-bd54278a3668 req-f06adc40-bc09-4001-954d-314def3a1fb9 service nova] Acquiring lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-72b8bd6a-2ccb-40b6-a51c-bd54278a3668 req-f06adc40-bc09-4001-954d-314def3a1fb9 service nova] Lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-72b8bd6a-2ccb-40b6-a51c-bd54278a3668 req-f06adc40-bc09-4001-954d-314def3a1fb9 service nova] Lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:46 user nova-compute[73010]: DEBUG nova.compute.manager [req-72b8bd6a-2ccb-40b6-a51c-bd54278a3668 req-f06adc40-bc09-4001-954d-314def3a1fb9 service nova] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] No waiting events found dispatching network-vif-plugged-b7c4cb21-45d7-4383-8716-d9b5f6de9000 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:42:46 user nova-compute[73010]: WARNING nova.compute.manager [req-72b8bd6a-2ccb-40b6-a51c-bd54278a3668 req-f06adc40-bc09-4001-954d-314def3a1fb9 service nova] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Received unexpected event network-vif-plugged-b7c4cb21-45d7-4383-8716-d9b5f6de9000 for instance with vm_state building and task_state spawning.
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060167.5402806, 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:42:47 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] VM Resumed (Lifecycle Event)
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:42:47 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Instance spawned successfully.
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:42:47 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Instance spawned successfully.
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:42:47 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060167.5422747, 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:42:47 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] VM Started (Lifecycle Event)
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:42:47 user nova-compute[73010]: INFO nova.compute.manager [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Took 6.95 seconds to spawn the instance on the hypervisor.
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:42:47 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060167.59607, c844e062-d79e-4c50-a116-4e6a6661e1d6 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:42:47 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] VM Resumed (Lifecycle Event)
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:42:47 user nova-compute[73010]: INFO nova.compute.manager [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Took 7.59 seconds to spawn the instance on the hypervisor.
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:42:47 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060167.5975451, c844e062-d79e-4c50-a116-4e6a6661e1d6 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:42:47 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] VM Started (Lifecycle Event)
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:42:47 user nova-compute[73010]: INFO nova.compute.manager [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Took 8.23 seconds to build instance.
Aug 15 00:42:47 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:42:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-79e886cc-8eb4-4e86-b209-156063d90902 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.351s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:47 user nova-compute[73010]: INFO nova.compute.manager [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Took 8.40 seconds to build instance.
Aug 15 00:42:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3cf9723d-33bd-4e20-85c0-5a7db5e05549 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.489s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMnGUXuE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26338636665356632', 'path': '/dev/sde'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338636665356632', 'path': '/dev/sde'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.objects.instance [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lazy-loading 'flavor' on Instance uuid 4b5baaac-bb54-462c-b833-4f37de8f24dc {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:42:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:42:47 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:42:47 user nova-compute[73010]:   <source dev="/dev/sde"/>
Aug 15 00:42:47 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:42:47 user nova-compute[73010]:   <serial>81943610-47b7-4bd7-8c92-e9c1f1d115b3</serial>
Aug 15 00:42:47 user nova-compute[73010]: </disk>
Aug 15 00:42:47 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:42:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:42:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:42:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] No VIF found with MAC fa:16:3e:ec:63:2a, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:42:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-68ce779f-ce65-4868-aa4e-c06b94f8e783 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.965s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:49 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:42:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:49 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:42:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:50 user nova-compute[73010]: INFO nova.compute.manager [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Rebuilding instance
Aug 15 00:42:50 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4b5baaac-bb54-462c-b833-4f37de8f24dc {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:42:50 user nova-compute[73010]: DEBUG nova.compute.manager [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:42:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:50 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lazy-loading 'pci_requests' on Instance uuid 4b5baaac-bb54-462c-b833-4f37de8f24dc {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:42:50 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b5baaac-bb54-462c-b833-4f37de8f24dc {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:42:50 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lazy-loading 'resources' on Instance uuid 4b5baaac-bb54-462c-b833-4f37de8f24dc {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:42:50 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lazy-loading 'migration_context' on Instance uuid 4b5baaac-bb54-462c-b833-4f37de8f24dc {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:42:50 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73010) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 00:42:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG nova.compute.manager [req-fb2b421b-b07d-4be3-84ec-608c3bb42cd4 req-c844db7b-f9d0-4022-8d99-d276fabeb81d service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Received event network-vif-unplugged-bf9a1845-c225-4c08-bc5a-929ebdceda57 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-fb2b421b-b07d-4be3-84ec-608c3bb42cd4 req-c844db7b-f9d0-4022-8d99-d276fabeb81d service nova] Acquiring lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-fb2b421b-b07d-4be3-84ec-608c3bb42cd4 req-c844db7b-f9d0-4022-8d99-d276fabeb81d service nova] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-fb2b421b-b07d-4be3-84ec-608c3bb42cd4 req-c844db7b-f9d0-4022-8d99-d276fabeb81d service nova] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG nova.compute.manager [req-fb2b421b-b07d-4be3-84ec-608c3bb42cd4 req-c844db7b-f9d0-4022-8d99-d276fabeb81d service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] No waiting events found dispatching network-vif-unplugged-bf9a1845-c225-4c08-bc5a-929ebdceda57 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:42:51 user nova-compute[73010]: WARNING nova.compute.manager [req-fb2b421b-b07d-4be3-84ec-608c3bb42cd4 req-c844db7b-f9d0-4022-8d99-d276fabeb81d service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Received unexpected event network-vif-unplugged-bf9a1845-c225-4c08-bc5a-929ebdceda57 for instance with vm_state active and task_state rebuilding.
Aug 15 00:42:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:51 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Instance destroyed successfully.
Aug 15 00:42:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:51 user nova-compute[73010]: INFO nova.compute.manager [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Detaching volume 81943610-47b7-4bd7-8c92-e9c1f1d115b3
Aug 15 00:42:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:51 user nova-compute[73010]: INFO nova.virt.block_device [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Attempting to driver detach volume 81943610-47b7-4bd7-8c92-e9c1f1d115b3 from mountpoint /dev/vdb
Aug 15 00:42:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Attempting to detach device vdb from instance 4b5baaac-bb54-462c-b833-4f37de8f24dc from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:42:51 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:42:51 user nova-compute[73010]:   <source dev="/dev/sde"/>
Aug 15 00:42:51 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:42:51 user nova-compute[73010]:   <serial>81943610-47b7-4bd7-8c92-e9c1f1d115b3</serial>
Aug 15 00:42:51 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:42:51 user nova-compute[73010]: </disk>
Aug 15 00:42:51 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:42:51 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Successfully detached device vdb from instance 4b5baaac-bb54-462c-b833-4f37de8f24dc from the persistent domain config.
Aug 15 00:42:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMnGUXuE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:42:51 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 00:42:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[12647d9a-747a-413d-b982-d9ce7330f041]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4f6c78-1b1b-4391-bc42-e4e4b3aeed8a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:42:51 user nova-compute[73010]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:42:51 user nova-compute[73010]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 (non-flash)
Aug 15 00:42:51 user nova-compute[73010]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:42:51 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:42:51 user nova-compute[73010]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:42:51 user nova-compute[73010]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 (non-flash)
Aug 15 00:42:51 user nova-compute[73010]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:42:51 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec5052a320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3'): ({'sde'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Removing single pathed devices sde {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:42:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[df496ba3-c26e-4501-855c-9264765c6d52]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[365fb3d7-d125-4d35-89a2-e0bfb97cfff8]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Flushing IO for device /dev/sde {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b82529-3d72-4aac-b9d3-f1d24359ded6]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.273s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fc2de1-08c7-42dd-a03a-21a08597bb50]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] SCSI volumes sde have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd28846d-2fda-4660-8387-aed09ac7d89c]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.112s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad2cea8-cee6-44d9-859a-91f1385ae7cc]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3, portal: 172.16.0.220,3260]
Aug 15 00:42:52 user nova-compute[73010]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3, portal: 172.16.0.220,3260] successful.
Aug 15 00:42:52 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9621628e-8fdb-44fb-9354-5df44abc4031]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] <== disconnect_volume: return (435ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG nova.compute.manager [req-e0e43bce-1e9a-43fa-9b5b-ef72386d63c1 req-e75d866f-9d00-445a-99bb-8706c96eefe5 service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Received event network-vif-plugged-bf9a1845-c225-4c08-bc5a-929ebdceda57 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e0e43bce-1e9a-43fa-9b5b-ef72386d63c1 req-e75d866f-9d00-445a-99bb-8706c96eefe5 service nova] Acquiring lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e0e43bce-1e9a-43fa-9b5b-ef72386d63c1 req-e75d866f-9d00-445a-99bb-8706c96eefe5 service nova] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e0e43bce-1e9a-43fa-9b5b-ef72386d63c1 req-e75d866f-9d00-445a-99bb-8706c96eefe5 service nova] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG nova.compute.manager [req-e0e43bce-1e9a-43fa-9b5b-ef72386d63c1 req-e75d866f-9d00-445a-99bb-8706c96eefe5 service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] No waiting events found dispatching network-vif-plugged-bf9a1845-c225-4c08-bc5a-929ebdceda57 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:42:53 user nova-compute[73010]: WARNING nova.compute.manager [req-e0e43bce-1e9a-43fa-9b5b-ef72386d63c1 req-e75d866f-9d00-445a-99bb-8706c96eefe5 service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Received unexpected event network-vif-plugged-bf9a1845-c225-4c08-bc5a-929ebdceda57 for instance with vm_state active and task_state rebuilding.
Aug 15 00:42:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:53 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Instance destroyed successfully.
Aug 15 00:42:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-943819205',display_name='tempest-ServerActionsTestOtherA-server-1706685852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-943819205',id=27,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz9vv0hqGajePOZ+2oXviFPXzQK2KEcWfvP3fM07mI8g1goyyeZFkU5ISIVRZy9AWkrpm4V0CqGkVIurRbtfDkxSjm0VLFyN90TKUeEwHZdHfqNj3wkXYudQjaCa9ggDg==',key_name='tempest-keypair-1595777815',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:40:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='13115a64ccc24df68bdfda1fc72399c4',ramdisk_id='',reservation_id='r-2xbqlkxi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-671712537',owner_user_name='tempest-ServerActionsTestOtherA-671712537-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0e48e71bb404f26926ac7a8176e04bb',uuid=4b5baaac-bb54-462c-b833-4f37de8f24dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "address": "fa:16:3e:ec:63:2a", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9a1845-c2", "ovs_interfaceid": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converting VIF {"id": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "address": "fa:16:3e:ec:63:2a", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9a1845-c2", "ovs_interfaceid": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:63:2a,bridge_name='br-int',has_traffic_filtering=True,id=bf9a1845-c225-4c08-bc5a-929ebdceda57,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9a1845-c2') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG os_vif [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:63:2a,bridge_name='br-int',has_traffic_filtering=True,id=bf9a1845-c225-4c08-bc5a-929ebdceda57,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9a1845-c2') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf9a1845-c2, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:42:53 user nova-compute[73010]: INFO os_vif [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:63:2a,bridge_name='br-int',has_traffic_filtering=True,id=bf9a1845-c225-4c08-bc5a-929ebdceda57,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9a1845-c2')
Aug 15 00:42:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMnGUXuE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:42:53 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 00:42:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d564f94b-c1d3-44a0-a14b-c1210248f369]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[051dbed8-6d3d-4a6e-8a89-beb72a2272c6]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:42:53 user nova-compute[73010]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:42:53 user nova-compute[73010]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 (non-flash)
Aug 15 00:42:53 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:42:53 user nova-compute[73010]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:42:53 user nova-compute[73010]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 (non-flash)
Aug 15 00:42:53 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec504f6d40>, {}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Disconnecting from: [] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.085s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] <== disconnect_volume: return (88ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:42:53 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Deleting instance files /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc_del
Aug 15 00:42:53 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Deletion of /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc_del complete
Aug 15 00:42:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:53 user nova-compute[73010]: INFO nova.virt.block_device [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Booting with volume 81943610-47b7-4bd7-8c92-e9c1f1d115b3 at /dev/vdb
Aug 15 00:42:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG os_brick.utils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e4a549-2f62-4cdc-a173-187b38bebac2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a87b7f-bae8-4307-9e8b-1dc05d7e554e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c68b793-cd71-4d47-a2c6-573341fef798]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc35e06-f979-42e3-8dfb-7949791290ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:42:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:42:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:42:54 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:42:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a67f6d-928f-4f7a-9150-b160fadb9505]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:42:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:42:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:42:54 user nova-compute[73010]: DEBUG os_brick.utils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:42:54 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Updating existing volume attachment record: 954d1ee6-263d-4adf-8af9-0d0149fb009f {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:42:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:55 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:42:55 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:42:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=7159MB free_disk=25.55471420288086GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:42:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6dfc356b-953a-47b0-9da7-70cc59a80853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:42:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:42:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6bf89433-15f9-44fd-a4c1-00b72287f65f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:42:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance eec545e8-eeda-443c-9892-980e19e7267a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:42:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4b489f97-c8d4-4a6a-8404-e1a05a990261 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:42:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 98fa0e64-cf36-4991-924d-ba4b713239d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:42:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4b5baaac-bb54-462c-b833-4f37de8f24dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:42:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:42:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance c844e062-d79e-4c50-a116-4e6a6661e1d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:42:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:42:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:42:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:42:55 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:42:55 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:42:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:42:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.478s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:55 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:42:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Cleaning up deleted instances {{(pid=73010) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 00:42:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] There are 0 instances to clean {{(pid=73010) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 00:42:55 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:42:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "98fa0e64-cf36-4991-924d-ba4b713239d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:42:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:42:56 user nova-compute[73010]: INFO nova.compute.manager [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Detaching volume fde18e9c-9183-4a6a-bf17-8af0c5008d11
Aug 15 00:42:57 user nova-compute[73010]: INFO nova.virt.block_device [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Attempting to driver detach volume fde18e9c-9183-4a6a-bf17-8af0c5008d11 from mountpoint /dev/vdb
Aug 15 00:42:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Attempting to detach device vdb from instance 98fa0e64-cf36-4991-924d-ba4b713239d0 from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:42:57 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:42:57 user nova-compute[73010]:   <source dev="/dev/sdd"/>
Aug 15 00:42:57 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:42:57 user nova-compute[73010]:   <serial>fde18e9c-9183-4a6a-bf17-8af0c5008d11</serial>
Aug 15 00:42:57 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:42:57 user nova-compute[73010]: </disk>
Aug 15 00:42:57 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:42:57 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Successfully detached device vdb from instance 98fa0e64-cf36-4991-924d-ba4b713239d0 from the persistent domain config.
Aug 15 00:42:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 98fa0e64-cf36-4991-924d-ba4b713239d0 from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:42:57 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:42:57 user nova-compute[73010]:   <source dev="/dev/sdd"/>
Aug 15 00:42:57 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:42:57 user nova-compute[73010]:   <serial>fde18e9c-9183-4a6a-bf17-8af0c5008d11</serial>
Aug 15 00:42:57 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:42:57 user nova-compute[73010]: </disk>
Aug 15 00:42:57 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692060177.5086486, 98fa0e64-cf36-4991-924d-ba4b713239d0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 98fa0e64-cf36-4991-924d-ba4b713239d0 {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:42:57 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Successfully detached device vdb from instance 98fa0e64-cf36-4991-924d-ba4b713239d0 from the live domain config.
Aug 15 00:42:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UmiBgcXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:42:57 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:42:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9a5ab0-7877-457f-a8be-4d329539c1f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a138cd-a7eb-4076-a7e7-ec6a490b5ae9]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:42:57 user nova-compute[73010]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:42:57 user nova-compute[73010]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 (non-flash)
Aug 15 00:42:57 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:42:57 user nova-compute[73010]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:42:57 user nova-compute[73010]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 (non-flash)
Aug 15 00:42:57 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec305c2830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11'): ({'sdd'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Removing single pathed devices sdd {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e5c50e-c2da-4e93-8cc5-d89032785aae]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc8b92a-61b6-4a57-b2b6-ee4dc428b16f]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Flushing IO for device /dev/sdd {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcc2109-b4f6-4c51-9d95-8c86f38969b4]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8211310-6059-47c4-91e5-2030ce798614]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] SCSI volumes sdd have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ab7042-89a3-4875-8680-4506fb210983]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a21181f-7747-4c6c-8e23-303c8eec6c10]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11, portal: 172.16.0.220,3260]
Aug 15 00:42:57 user nova-compute[73010]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11, portal: 172.16.0.220,3260] successful.
Aug 15 00:42:57 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde18e9c-9183-4a6a-bf17-8af0c5008d11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded756e7-e0ce-424a-bfa7-0fd5e5f02eb4]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] <== disconnect_volume: return (287ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:42:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:42:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:42:58 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:42:58 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:42:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:42:58 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lazy-loading 'flavor' on Instance uuid 98fa0e64-cf36-4991-924d-ba4b713239d0 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:42:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b039e5c5-a226-4d51-89c1-4418362357fe tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.817s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:42:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:42:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:42:58 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 00:42:59 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Updating instance_info_cache with network_info: [{"id": "5db62e1b-e013-4958-8470-da256258503d", "address": "fa:16:3e:71:55:dd", "network": {"id": "22954f6c-78d2-40d7-91fc-1e8eb0881e40", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1057005040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadfec8dd5ed4c8b8c8730c98b2711ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db62e1b-e0", "ovs_interfaceid": "5db62e1b-e013-4958-8470-da256258503d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:42:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:42:59 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 00:42:59 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:42:59 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:42:59 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:42:59 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:42:59 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:43:01 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:43:02 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:43:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:43:03 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Creating image(s)
Aug 15 00:43:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "/opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "/opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:43:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.166s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk 1073741824" returned: 0 in 0.047s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.172s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:03 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:43:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Cannot resize image /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Ensure instance console log exists: /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Start _get_guest_xml network_info=[{"id": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "address": "fa:16:3e:ec:63:2a", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9a1845-c2", "ovs_interfaceid": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMnGUXuE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4b5baaac-bb54-462c-b833-4f37de8f24dc', 'attached_at': '', 'detached_at': '', 'volume_id': '81943610-47b7-4bd7-8c92-e9c1f1d115b3', 'serial': '81943610-47b7-4bd7-8c92-e9c1f1d115b3'}, 'disk_bus': 'virtio', 'attachment_id': '954d1ee6-263d-4adf-8af9-0d0149fb009f', 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:43:04 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 00:43:04 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 00:43:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4b5baaac-bb54-462c-b833-4f37de8f24dc {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMnGUXuE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:43:04 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 00:43:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:43:04 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 00:43:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:43:04 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[794ea281-edf7-49c6-8fd9-b2c871fd7862]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:43:04 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be265a7-3a20-45f3-a5cd-292eea76173c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3] added
Aug 15 00:43:04 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1416d460-a501-4c4b-a565-dce398b31552]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0593ec-24b7-47d5-94a9-63c4406792ed]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SMnGUXuE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SMnGUXuE" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b90d42-c576-47ea-a8c9-1c07e8c049b5]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SMnGUXuE'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b48d3c-45c6-4a63-9cb0-2c70b91e3c6b]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ab4050-9a63-40e0-91ec-1082c9380b80]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:43:04 user nova-compute[73010]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:43:04 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:43:04 user nova-compute[73010]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:43:04 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3819bcd5-d002-4a2e-83c6-a77c4996d6e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3, portal: 172.16.0.220,3260]
Aug 15 00:43:04 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3, portal: 172.16.0.220,3260] successful.
Aug 15 00:43:04 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac449d3e-599c-4766-9828-220d41266686]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f325c632-9535-4c4a-86a9-949df4fec9f7]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:43:04 user nova-compute[73010]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:43:04 user nova-compute[73010]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:43:04 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:43:04 user nova-compute[73010]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:43:04 user nova-compute[73010]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:43:04 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[202a3015-c0ac-4e8e-8a98-f0bf9112e3ce]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMnGUXuE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:43:04 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73010) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 00:43:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:43:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26338636665356632', 'path': '/dev/sdd'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:43:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338636665356632', 'path': '/dev/sdd'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:43:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T00:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-943819205',display_name='tempest-ServerActionsTestOtherA-server-1706685852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-943819205',id=27,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz9vv0hqGajePOZ+2oXviFPXzQK2KEcWfvP3fM07mI8g1goyyeZFkU5ISIVRZy9AWkrpm4V0CqGkVIurRbtfDkxSjm0VLFyN90TKUeEwHZdHfqNj3wkXYudQjaCa9ggDg==',key_name='tempest-keypair-1595777815',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:40:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='13115a64ccc24df68bdfda1fc72399c4',ramdisk_id='',reservation_id='r-2xbqlkxi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-671712537',owner_user_name='tempest-ServerActionsTestOtherA-671712537-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:42:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0e48e71bb404f26926ac7a8176e04bb',uuid=4b5baaac-bb54-462c-b833-4f37de8f24dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "address": "fa:16:3e:ec:63:2a", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9a1845-c2", "ovs_interfaceid": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:43:05 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converting VIF {"id": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "address": "fa:16:3e:ec:63:2a", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9a1845-c2", "ovs_interfaceid": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:43:05 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:63:2a,bridge_name='br-int',has_traffic_filtering=True,id=bf9a1845-c225-4c08-bc5a-929ebdceda57,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9a1845-c2') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:43:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:43:05 user nova-compute[73010]:   <uuid>4b5baaac-bb54-462c-b833-4f37de8f24dc</uuid>
Aug 15 00:43:05 user nova-compute[73010]:   <name>instance-0000001b</name>
Aug 15 00:43:05 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:43:05 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:43:05 user nova-compute[73010]:   <metadata>
Aug 15 00:43:05 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:43:05 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:43:05 user nova-compute[73010]:       <nova:name>tempest-ServerActionsTestOtherA-server-1706685852</nova:name>
Aug 15 00:43:05 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:43:04</nova:creationTime>
Aug 15 00:43:05 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:43:05 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:43:05 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:43:05 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:43:05 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:43:05 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:43:05 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:43:05 user nova-compute[73010]:       <nova:owner>
Aug 15 00:43:05 user nova-compute[73010]:         <nova:user uuid="b0e48e71bb404f26926ac7a8176e04bb">tempest-ServerActionsTestOtherA-671712537-project-member</nova:user>
Aug 15 00:43:05 user nova-compute[73010]:         <nova:project uuid="13115a64ccc24df68bdfda1fc72399c4">tempest-ServerActionsTestOtherA-671712537</nova:project>
Aug 15 00:43:05 user nova-compute[73010]:       </nova:owner>
Aug 15 00:43:05 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:43:05 user nova-compute[73010]:       <nova:ports>
Aug 15 00:43:05 user nova-compute[73010]:         <nova:port uuid="bf9a1845-c225-4c08-bc5a-929ebdceda57">
Aug 15 00:43:05 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 00:43:05 user nova-compute[73010]:         </nova:port>
Aug 15 00:43:05 user nova-compute[73010]:       </nova:ports>
Aug 15 00:43:05 user nova-compute[73010]:     </nova:instance>
Aug 15 00:43:05 user nova-compute[73010]:   </metadata>
Aug 15 00:43:05 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:43:05 user nova-compute[73010]:     <system>
Aug 15 00:43:05 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:43:05 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:43:05 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:43:05 user nova-compute[73010]:       <entry name="serial">4b5baaac-bb54-462c-b833-4f37de8f24dc</entry>
Aug 15 00:43:05 user nova-compute[73010]:       <entry name="uuid">4b5baaac-bb54-462c-b833-4f37de8f24dc</entry>
Aug 15 00:43:05 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:43:05 user nova-compute[73010]:     </system>
Aug 15 00:43:05 user nova-compute[73010]:   </sysinfo>
Aug 15 00:43:05 user nova-compute[73010]:   <os>
Aug 15 00:43:05 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:43:05 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:43:05 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:43:05 user nova-compute[73010]:   </os>
Aug 15 00:43:05 user nova-compute[73010]:   <features>
Aug 15 00:43:05 user nova-compute[73010]:     <acpi/>
Aug 15 00:43:05 user nova-compute[73010]:     <apic/>
Aug 15 00:43:05 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:43:05 user nova-compute[73010]:   </features>
Aug 15 00:43:05 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:43:05 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:43:05 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:43:05 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:43:05 user nova-compute[73010]:   </clock>
Aug 15 00:43:05 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:43:05 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:43:05 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:43:05 user nova-compute[73010]:   </cpu>
Aug 15 00:43:05 user nova-compute[73010]:   <devices>
Aug 15 00:43:05 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:43:05 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:43:05 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk"/>
Aug 15 00:43:05 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:43:05 user nova-compute[73010]:     </disk>
Aug 15 00:43:05 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 00:43:05 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:43:05 user nova-compute[73010]:       <source dev="/dev/sdd"/>
Aug 15 00:43:05 user nova-compute[73010]:       <target dev="vdb" bus="virtio"/>
Aug 15 00:43:05 user nova-compute[73010]:       <serial>81943610-47b7-4bd7-8c92-e9c1f1d115b3</serial>
Aug 15 00:43:05 user nova-compute[73010]:     </disk>
Aug 15 00:43:05 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:43:05 user nova-compute[73010]:       <mac address="fa:16:3e:ec:63:2a"/>
Aug 15 00:43:05 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:43:05 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:43:05 user nova-compute[73010]:       <target dev="tapbf9a1845-c2"/>
Aug 15 00:43:05 user nova-compute[73010]:     </interface>
Aug 15 00:43:05 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:43:05 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/console.log" append="off"/>
Aug 15 00:43:05 user nova-compute[73010]:     </serial>
Aug 15 00:43:05 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:43:05 user nova-compute[73010]:     <video>
Aug 15 00:43:05 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:43:05 user nova-compute[73010]:     </video>
Aug 15 00:43:05 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:43:05 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:43:05 user nova-compute[73010]:     </rng>
Aug 15 00:43:05 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:43:05 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:43:05 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:43:05 user nova-compute[73010]:     </memballoon>
Aug 15 00:43:05 user nova-compute[73010]:   </devices>
Aug 15 00:43:05 user nova-compute[73010]: </domain>
Aug 15 00:43:05 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:43:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T00:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-943819205',display_name='tempest-ServerActionsTestOtherA-server-1706685852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-943819205',id=27,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz9vv0hqGajePOZ+2oXviFPXzQK2KEcWfvP3fM07mI8g1goyyeZFkU5ISIVRZy9AWkrpm4V0CqGkVIurRbtfDkxSjm0VLFyN90TKUeEwHZdHfqNj3wkXYudQjaCa9ggDg==',key_name='tempest-keypair-1595777815',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:40:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='13115a64ccc24df68bdfda1fc72399c4',ramdisk_id='',reservation_id='r-2xbqlkxi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-671712537',owner_user_name='tempest-ServerActionsTestOtherA-671712537-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:42:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0e48e71bb404f26926ac7a8176e04bb',uuid=4b5baaac-bb54-462c-b833-4f37de8f24dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "address": "fa:16:3e:ec:63:2a", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9a1845-c2", "ovs_interfaceid": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:43:05 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converting VIF {"id": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "address": "fa:16:3e:ec:63:2a", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9a1845-c2", "ovs_interfaceid": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:43:05 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:63:2a,bridge_name='br-int',has_traffic_filtering=True,id=bf9a1845-c225-4c08-bc5a-929ebdceda57,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9a1845-c2') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:43:05 user nova-compute[73010]: DEBUG os_vif [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:63:2a,bridge_name='br-int',has_traffic_filtering=True,id=bf9a1845-c225-4c08-bc5a-929ebdceda57,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9a1845-c2') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:43:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:43:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:43:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf9a1845-c2, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:43:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf9a1845-c2, col_values=(('external_ids', {'iface-id': 'bf9a1845-c225-4c08-bc5a-929ebdceda57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:63:2a', 'vm-uuid': '4b5baaac-bb54-462c-b833-4f37de8f24dc'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:43:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:43:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:05 user nova-compute[73010]: INFO os_vif [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:63:2a,bridge_name='br-int',has_traffic_filtering=True,id=bf9a1845-c225-4c08-bc5a-929ebdceda57,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9a1845-c2')
Aug 15 00:43:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:43:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:43:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] No VIF found with MAC fa:16:3e:ec:63:2a, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:43:06 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060171.5406423, 4b5baaac-bb54-462c-b833-4f37de8f24dc => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:43:06 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] VM Stopped (Lifecycle Event)
Aug 15 00:43:06 user nova-compute[73010]: DEBUG nova.compute.manager [None req-d5a5c6b9-fcd4-4256-9b95-9c0c7799826b None None] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:43:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:07 user nova-compute[73010]: DEBUG nova.compute.manager [req-515cdfa9-ac32-469a-bfe5-d264aef8e905 req-64e519a5-a616-443a-9bc2-8b839783fece service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Received event network-vif-plugged-bf9a1845-c225-4c08-bc5a-929ebdceda57 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:43:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-515cdfa9-ac32-469a-bfe5-d264aef8e905 req-64e519a5-a616-443a-9bc2-8b839783fece service nova] Acquiring lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-515cdfa9-ac32-469a-bfe5-d264aef8e905 req-64e519a5-a616-443a-9bc2-8b839783fece service nova] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-515cdfa9-ac32-469a-bfe5-d264aef8e905 req-64e519a5-a616-443a-9bc2-8b839783fece service nova] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:07 user nova-compute[73010]: DEBUG nova.compute.manager [req-515cdfa9-ac32-469a-bfe5-d264aef8e905 req-64e519a5-a616-443a-9bc2-8b839783fece service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] No waiting events found dispatching network-vif-plugged-bf9a1845-c225-4c08-bc5a-929ebdceda57 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:43:07 user nova-compute[73010]: WARNING nova.compute.manager [req-515cdfa9-ac32-469a-bfe5-d264aef8e905 req-64e519a5-a616-443a-9bc2-8b839783fece service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Received unexpected event network-vif-plugged-bf9a1845-c225-4c08-bc5a-929ebdceda57 for instance with vm_state active and task_state rebuild_spawning.
Aug 15 00:43:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:09 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060189.0962813, 4b5baaac-bb54-462c-b833-4f37de8f24dc => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:43:09 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] VM Resumed (Lifecycle Event)
Aug 15 00:43:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:43:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:43:09 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Instance spawned successfully.
Aug 15 00:43:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:43:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:43:09 user nova-compute[73010]: DEBUG nova.compute.manager [req-ac62869b-0654-4d48-b0aa-f9f40c8779d7 req-9c878240-21fb-4d2d-a07e-22505bac72fe service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Received event network-vif-plugged-bf9a1845-c225-4c08-bc5a-929ebdceda57 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:43:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ac62869b-0654-4d48-b0aa-f9f40c8779d7 req-9c878240-21fb-4d2d-a07e-22505bac72fe service nova] Acquiring lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ac62869b-0654-4d48-b0aa-f9f40c8779d7 req-9c878240-21fb-4d2d-a07e-22505bac72fe service nova] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ac62869b-0654-4d48-b0aa-f9f40c8779d7 req-9c878240-21fb-4d2d-a07e-22505bac72fe service nova] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:09 user nova-compute[73010]: DEBUG nova.compute.manager [req-ac62869b-0654-4d48-b0aa-f9f40c8779d7 req-9c878240-21fb-4d2d-a07e-22505bac72fe service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] No waiting events found dispatching network-vif-plugged-bf9a1845-c225-4c08-bc5a-929ebdceda57 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:43:09 user nova-compute[73010]: WARNING nova.compute.manager [req-ac62869b-0654-4d48-b0aa-f9f40c8779d7 req-9c878240-21fb-4d2d-a07e-22505bac72fe service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Received unexpected event network-vif-plugged-bf9a1845-c225-4c08-bc5a-929ebdceda57 for instance with vm_state active and task_state rebuild_spawning.
Aug 15 00:43:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:43:09 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 00:43:09 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060189.0982401, 4b5baaac-bb54-462c-b833-4f37de8f24dc => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:43:09 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] VM Started (Lifecycle Event)
Aug 15 00:43:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:43:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:43:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:43:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:43:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:43:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:43:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:43:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:43:09 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 00:43:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:43:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:09 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73010) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 00:43:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b9478706-b17a-4086-9f87-e44ff2ad00b6 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.069s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:43:25 user nova-compute[73010]: INFO nova.compute.manager [None req-31bf7dee-db98-46b8-8f60-22d035e9db22 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Unrescuing
Aug 15 00:43:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-31bf7dee-db98-46b8-8f60-22d035e9db22 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquiring lock "refresh_cache-f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:43:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-31bf7dee-db98-46b8-8f60-22d035e9db22 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquired lock "refresh_cache-f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:43:25 user nova-compute[73010]: DEBUG nova.network.neutron [None req-31bf7dee-db98-46b8-8f60-22d035e9db22 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:43:26 user nova-compute[73010]: DEBUG nova.network.neutron [None req-31bf7dee-db98-46b8-8f60-22d035e9db22 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Updating instance_info_cache with network_info: [{"id": "5db62e1b-e013-4958-8470-da256258503d", "address": "fa:16:3e:71:55:dd", "network": {"id": "22954f6c-78d2-40d7-91fc-1e8eb0881e40", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1057005040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadfec8dd5ed4c8b8c8730c98b2711ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db62e1b-e0", "ovs_interfaceid": "5db62e1b-e013-4958-8470-da256258503d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:43:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-31bf7dee-db98-46b8-8f60-22d035e9db22 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Releasing lock "refresh_cache-f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:43:26 user nova-compute[73010]: DEBUG nova.objects.instance [None req-31bf7dee-db98-46b8-8f60-22d035e9db22 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lazy-loading 'flavor' on Instance uuid f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:43:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:26 user nova-compute[73010]: DEBUG nova.compute.manager [req-1de11920-7975-4971-9e62-9f3ba7396c9c req-49884d86-a900-4cf0-923b-c6f3b0c04c0a service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received event network-vif-unplugged-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:43:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1de11920-7975-4971-9e62-9f3ba7396c9c req-49884d86-a900-4cf0-923b-c6f3b0c04c0a service nova] Acquiring lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1de11920-7975-4971-9e62-9f3ba7396c9c req-49884d86-a900-4cf0-923b-c6f3b0c04c0a service nova] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1de11920-7975-4971-9e62-9f3ba7396c9c req-49884d86-a900-4cf0-923b-c6f3b0c04c0a service nova] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:26 user nova-compute[73010]: DEBUG nova.compute.manager [req-1de11920-7975-4971-9e62-9f3ba7396c9c req-49884d86-a900-4cf0-923b-c6f3b0c04c0a service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] No waiting events found dispatching network-vif-unplugged-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:43:26 user nova-compute[73010]: WARNING nova.compute.manager [req-1de11920-7975-4971-9e62-9f3ba7396c9c req-49884d86-a900-4cf0-923b-c6f3b0c04c0a service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received unexpected event network-vif-unplugged-5db62e1b-e013-4958-8470-da256258503d for instance with vm_state rescued and task_state unrescuing.
Aug 15 00:43:27 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Instance destroyed successfully.
Aug 15 00:43:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Acquiring lock "6bf89433-15f9-44fd-a4c1-00b72287f65f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Acquiring lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:28 user nova-compute[73010]: INFO nova.compute.manager [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Terminating instance
Aug 15 00:43:28 user nova-compute[73010]: DEBUG nova.compute.manager [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:43:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG nova.compute.manager [req-9ccb456f-06ab-447f-8f5e-2ccb47aa7920 req-e8f5b9d2-c51e-47a7-874f-3e238d6f0077 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Received event network-vif-unplugged-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9ccb456f-06ab-447f-8f5e-2ccb47aa7920 req-e8f5b9d2-c51e-47a7-874f-3e238d6f0077 service nova] Acquiring lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9ccb456f-06ab-447f-8f5e-2ccb47aa7920 req-e8f5b9d2-c51e-47a7-874f-3e238d6f0077 service nova] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9ccb456f-06ab-447f-8f5e-2ccb47aa7920 req-e8f5b9d2-c51e-47a7-874f-3e238d6f0077 service nova] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG nova.compute.manager [req-9ccb456f-06ab-447f-8f5e-2ccb47aa7920 req-e8f5b9d2-c51e-47a7-874f-3e238d6f0077 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] No waiting events found dispatching network-vif-unplugged-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG nova.compute.manager [req-9ccb456f-06ab-447f-8f5e-2ccb47aa7920 req-e8f5b9d2-c51e-47a7-874f-3e238d6f0077 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Received event network-vif-unplugged-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG nova.compute.manager [req-7b4368a5-dd7a-4cbf-8184-6fa69a2b874c req-7f42499f-411f-47ca-b57e-8c3a555fff2a service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received event network-changed-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG nova.compute.manager [req-7b4368a5-dd7a-4cbf-8184-6fa69a2b874c req-7f42499f-411f-47ca-b57e-8c3a555fff2a service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Refreshing instance network info cache due to event network-changed-5db62e1b-e013-4958-8470-da256258503d. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7b4368a5-dd7a-4cbf-8184-6fa69a2b874c req-7f42499f-411f-47ca-b57e-8c3a555fff2a service nova] Acquiring lock "refresh_cache-f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7b4368a5-dd7a-4cbf-8184-6fa69a2b874c req-7f42499f-411f-47ca-b57e-8c3a555fff2a service nova] Acquired lock "refresh_cache-f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG nova.network.neutron [req-7b4368a5-dd7a-4cbf-8184-6fa69a2b874c req-7f42499f-411f-47ca-b57e-8c3a555fff2a service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Refreshing network info cache for port 5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:29 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Instance destroyed successfully.
Aug 15 00:43:29 user nova-compute[73010]: DEBUG nova.objects.instance [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lazy-loading 'resources' on Instance uuid 6bf89433-15f9-44fd-a4c1-00b72287f65f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T00:39:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1847309333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-100459501',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMvoU/VZ3MSVvKPEfl46VySM54g5gxjuVwvlv2ViBOX1qb9sxUhG896E4HXK1GlhKtb8cZiIme4xtoJu/nd/1zEHxtFmbxdZPCP6Pee/6tKM6u6rfoWMfAG7Psx72fYJg==',key_name='tempest-keypair-848269880',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:42:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='869253a2da7e4e95bb720ab7b203284c',ramdisk_id='',reservation_id='r-xs10r9gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-710111316',owner_user_name='tempest-ServerActionsV293TestJSON-710111316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:42:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19782b910361424ba7740c41f9331814',uuid=6bf89433-15f9-44fd-a4c1-00b72287f65f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "address": "fa:16:3e:e1:57:94", "network": {"id": "df55f352-d3b0-4133-939b-74d35a420b49", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159866404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869253a2da7e4e95bb720ab7b203284c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c6a8bc-4f", "ovs_interfaceid": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Converting VIF {"id": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "address": "fa:16:3e:e1:57:94", "network": {"id": "df55f352-d3b0-4133-939b-74d35a420b49", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1159866404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869253a2da7e4e95bb720ab7b203284c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c6a8bc-4f", "ovs_interfaceid": "f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:57:94,bridge_name='br-int',has_traffic_filtering=True,id=f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8,network=Network(df55f352-d3b0-4133-939b-74d35a420b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c6a8bc-4f') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG os_vif [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:57:94,bridge_name='br-int',has_traffic_filtering=True,id=f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8,network=Network(df55f352-d3b0-4133-939b-74d35a420b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c6a8bc-4f') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5c6a8bc-4f, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:43:29 user nova-compute[73010]: INFO os_vif [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:57:94,bridge_name='br-int',has_traffic_filtering=True,id=f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8,network=Network(df55f352-d3b0-4133-939b-74d35a420b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c6a8bc-4f')
Aug 15 00:43:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpZGkKBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:43:29 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:43:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f747cb67-d239-40c2-b1df-93c0129af950]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1c2e95a-cb37-4153-89da-065f6203999d\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c953ddf-5c29-4734-84e3-ccef9822838c]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1c2e95a-cb37-4153-89da-065f6203999d (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:43:29 user nova-compute[73010]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:43:29 user nova-compute[73010]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:43:29 user nova-compute[73010]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1c2e95a-cb37-4153-89da-065f6203999d (non-flash)
Aug 15 00:43:29 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:43:29 user nova-compute[73010]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c (non-flash)
Aug 15 00:43:29 user nova-compute[73010]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:43:29 user nova-compute[73010]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1c2e95a-cb37-4153-89da-065f6203999d (non-flash)
Aug 15 00:43:29 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec30333b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c'): ({'sdc'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Removing single pathed devices sdc {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[599a0a9f-8ffa-4255-af41-42ee82e807a4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb516dcb-8a32-4a10-b7e0-41ed8d52f72b]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Flushing IO for device /dev/sdc {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47d0bba-b291-471d-9ae1-9060e1e2ab89]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.070s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bd8c82-f462-464a-b4bc-c8d99b7ed96b]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] SCSI volumes sdc have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[717d0a2b-fcd9-4d05-b5be-ff49a2033f65]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa467478-e0b3-47ee-a7e2-085090b8d15e]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c, portal: 172.16.0.220,3260]
Aug 15 00:43:29 user nova-compute[73010]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c, portal: 172.16.0.220,3260] successful.
Aug 15 00:43:29 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83bdf3fa-8592-419d-90c9-a3d7a56f1a2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c85102e-f2de-4cad-9e52-441d55e34d03]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] <== disconnect_volume: return (410ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:43:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:43:29 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Deleting instance files /opt/stack/data/nova/instances/6bf89433-15f9-44fd-a4c1-00b72287f65f_del
Aug 15 00:43:29 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Deletion of /opt/stack/data/nova/instances/6bf89433-15f9-44fd-a4c1-00b72287f65f_del complete
Aug 15 00:43:30 user nova-compute[73010]: INFO nova.compute.manager [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Took 1.41 seconds to destroy the instance on the hypervisor.
Aug 15 00:43:30 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:43:30 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:43:30 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:43:30 user nova-compute[73010]: DEBUG nova.network.neutron [req-7b4368a5-dd7a-4cbf-8184-6fa69a2b874c req-7f42499f-411f-47ca-b57e-8c3a555fff2a service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Updated VIF entry in instance network info cache for port 5db62e1b-e013-4958-8470-da256258503d. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:43:30 user nova-compute[73010]: DEBUG nova.network.neutron [req-7b4368a5-dd7a-4cbf-8184-6fa69a2b874c req-7f42499f-411f-47ca-b57e-8c3a555fff2a service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Updating instance_info_cache with network_info: [{"id": "5db62e1b-e013-4958-8470-da256258503d", "address": "fa:16:3e:71:55:dd", "network": {"id": "22954f6c-78d2-40d7-91fc-1e8eb0881e40", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1057005040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadfec8dd5ed4c8b8c8730c98b2711ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db62e1b-e0", "ovs_interfaceid": "5db62e1b-e013-4958-8470-da256258503d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:43:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7b4368a5-dd7a-4cbf-8184-6fa69a2b874c req-7f42499f-411f-47ca-b57e-8c3a555fff2a service nova] Releasing lock "refresh_cache-f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:43:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-7b4368a5-dd7a-4cbf-8184-6fa69a2b874c req-7f42499f-411f-47ca-b57e-8c3a555fff2a service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received event network-changed-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:43:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-7b4368a5-dd7a-4cbf-8184-6fa69a2b874c req-7f42499f-411f-47ca-b57e-8c3a555fff2a service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Refreshing instance network info cache due to event network-changed-5db62e1b-e013-4958-8470-da256258503d. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:43:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7b4368a5-dd7a-4cbf-8184-6fa69a2b874c req-7f42499f-411f-47ca-b57e-8c3a555fff2a service nova] Acquiring lock "refresh_cache-f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:43:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7b4368a5-dd7a-4cbf-8184-6fa69a2b874c req-7f42499f-411f-47ca-b57e-8c3a555fff2a service nova] Acquired lock "refresh_cache-f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:43:30 user nova-compute[73010]: DEBUG nova.network.neutron [req-7b4368a5-dd7a-4cbf-8184-6fa69a2b874c req-7f42499f-411f-47ca-b57e-8c3a555fff2a service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Refreshing network info cache for port 5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:43:30 user nova-compute[73010]: DEBUG nova.network.neutron [req-7b4368a5-dd7a-4cbf-8184-6fa69a2b874c req-7f42499f-411f-47ca-b57e-8c3a555fff2a service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Updated VIF entry in instance network info cache for port 5db62e1b-e013-4958-8470-da256258503d. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:43:30 user nova-compute[73010]: DEBUG nova.network.neutron [req-7b4368a5-dd7a-4cbf-8184-6fa69a2b874c req-7f42499f-411f-47ca-b57e-8c3a555fff2a service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Updating instance_info_cache with network_info: [{"id": "5db62e1b-e013-4958-8470-da256258503d", "address": "fa:16:3e:71:55:dd", "network": {"id": "22954f6c-78d2-40d7-91fc-1e8eb0881e40", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1057005040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadfec8dd5ed4c8b8c8730c98b2711ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db62e1b-e0", "ovs_interfaceid": "5db62e1b-e013-4958-8470-da256258503d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:43:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7b4368a5-dd7a-4cbf-8184-6fa69a2b874c req-7f42499f-411f-47ca-b57e-8c3a555fff2a service nova] Releasing lock "refresh_cache-f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:43:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-7b4368a5-dd7a-4cbf-8184-6fa69a2b874c req-7f42499f-411f-47ca-b57e-8c3a555fff2a service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received event network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:43:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7b4368a5-dd7a-4cbf-8184-6fa69a2b874c req-7f42499f-411f-47ca-b57e-8c3a555fff2a service nova] Acquiring lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7b4368a5-dd7a-4cbf-8184-6fa69a2b874c req-7f42499f-411f-47ca-b57e-8c3a555fff2a service nova] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7b4368a5-dd7a-4cbf-8184-6fa69a2b874c req-7f42499f-411f-47ca-b57e-8c3a555fff2a service nova] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-7b4368a5-dd7a-4cbf-8184-6fa69a2b874c req-7f42499f-411f-47ca-b57e-8c3a555fff2a service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] No waiting events found dispatching network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:43:30 user nova-compute[73010]: WARNING nova.compute.manager [req-7b4368a5-dd7a-4cbf-8184-6fa69a2b874c req-7f42499f-411f-47ca-b57e-8c3a555fff2a service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received unexpected event network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d for instance with vm_state rescued and task_state unrescuing.
Aug 15 00:43:31 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:43:31 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Took 0.99 seconds to deallocate network for instance.
Aug 15 00:43:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Removed pending event for f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 due to event {{(pid=73010) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 00:43:31 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060211.1286712, f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:43:31 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] VM Resumed (Lifecycle Event)
Aug 15 00:43:31 user nova-compute[73010]: DEBUG nova.compute.manager [None req-31bf7dee-db98-46b8-8f60-22d035e9db22 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:43:31 user nova-compute[73010]: DEBUG nova.compute.manager [req-bd9e8161-f2fc-4ec4-8056-aabab87276e0 req-509e41df-bfb4-4453-a24e-3a5def63c0b3 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Received event network-vif-plugged-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:43:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-bd9e8161-f2fc-4ec4-8056-aabab87276e0 req-509e41df-bfb4-4453-a24e-3a5def63c0b3 service nova] Acquiring lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-bd9e8161-f2fc-4ec4-8056-aabab87276e0 req-509e41df-bfb4-4453-a24e-3a5def63c0b3 service nova] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-bd9e8161-f2fc-4ec4-8056-aabab87276e0 req-509e41df-bfb4-4453-a24e-3a5def63c0b3 service nova] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:31 user nova-compute[73010]: DEBUG nova.compute.manager [req-bd9e8161-f2fc-4ec4-8056-aabab87276e0 req-509e41df-bfb4-4453-a24e-3a5def63c0b3 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] No waiting events found dispatching network-vif-plugged-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:43:31 user nova-compute[73010]: WARNING nova.compute.manager [req-bd9e8161-f2fc-4ec4-8056-aabab87276e0 req-509e41df-bfb4-4453-a24e-3a5def63c0b3 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Received unexpected event network-vif-plugged-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 for instance with vm_state active and task_state deleting.
Aug 15 00:43:31 user nova-compute[73010]: DEBUG nova.compute.manager [req-bd9e8161-f2fc-4ec4-8056-aabab87276e0 req-509e41df-bfb4-4453-a24e-3a5def63c0b3 service nova] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Received event network-vif-deleted-f5c6a8bc-4f8a-42a4-a257-0c3c00dda0a8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:43:31 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:43:31 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:43:31 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 00:43:31 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060211.1440346, f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:43:31 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] VM Started (Lifecycle Event)
Aug 15 00:43:31 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:43:31 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:43:31 user nova-compute[73010]: DEBUG nova.compute.manager [req-ce5c661b-6f14-4a35-a6bc-ea373dbe1662 req-7d1d893e-ad38-4c72-84de-e4c2f2f2d568 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received event network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:43:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ce5c661b-6f14-4a35-a6bc-ea373dbe1662 req-7d1d893e-ad38-4c72-84de-e4c2f2f2d568 service nova] Acquiring lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ce5c661b-6f14-4a35-a6bc-ea373dbe1662 req-7d1d893e-ad38-4c72-84de-e4c2f2f2d568 service nova] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ce5c661b-6f14-4a35-a6bc-ea373dbe1662 req-7d1d893e-ad38-4c72-84de-e4c2f2f2d568 service nova] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:31 user nova-compute[73010]: DEBUG nova.compute.manager [req-ce5c661b-6f14-4a35-a6bc-ea373dbe1662 req-7d1d893e-ad38-4c72-84de-e4c2f2f2d568 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] No waiting events found dispatching network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:43:31 user nova-compute[73010]: WARNING nova.compute.manager [req-ce5c661b-6f14-4a35-a6bc-ea373dbe1662 req-7d1d893e-ad38-4c72-84de-e4c2f2f2d568 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received unexpected event network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d for instance with vm_state active and task_state None.
Aug 15 00:43:31 user nova-compute[73010]: DEBUG nova.compute.manager [req-ce5c661b-6f14-4a35-a6bc-ea373dbe1662 req-7d1d893e-ad38-4c72-84de-e4c2f2f2d568 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received event network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:43:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ce5c661b-6f14-4a35-a6bc-ea373dbe1662 req-7d1d893e-ad38-4c72-84de-e4c2f2f2d568 service nova] Acquiring lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ce5c661b-6f14-4a35-a6bc-ea373dbe1662 req-7d1d893e-ad38-4c72-84de-e4c2f2f2d568 service nova] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ce5c661b-6f14-4a35-a6bc-ea373dbe1662 req-7d1d893e-ad38-4c72-84de-e4c2f2f2d568 service nova] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:31 user nova-compute[73010]: DEBUG nova.compute.manager [req-ce5c661b-6f14-4a35-a6bc-ea373dbe1662 req-7d1d893e-ad38-4c72-84de-e4c2f2f2d568 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] No waiting events found dispatching network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:43:31 user nova-compute[73010]: WARNING nova.compute.manager [req-ce5c661b-6f14-4a35-a6bc-ea373dbe1662 req-7d1d893e-ad38-4c72-84de-e4c2f2f2d568 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received unexpected event network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d for instance with vm_state active and task_state None.
Aug 15 00:43:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:32 user nova-compute[73010]: INFO nova.compute.manager [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Took 0.93 seconds to detach 1 volumes for instance.
Aug 15 00:43:32 user nova-compute[73010]: DEBUG nova.compute.manager [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Deleting volume: 83bdf3fa-8592-419d-90c9-a3d7a56f1a2c {{(pid=73010) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 00:43:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:32 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Refreshing inventories for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 00:43:32 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Updating ProviderTree inventory for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 00:43:32 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Updating inventory in ProviderTree for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 00:43:32 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Refreshing aggregate associations for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e, aggregates: None {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 00:43:32 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Refreshing trait associations for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 00:43:33 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:43:33 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:43:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.962s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:33 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Deleted allocations for instance 6bf89433-15f9-44fd-a4c1-00b72287f65f
Aug 15 00:43:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-62b85d8a-8ca8-4c5f-885b-c6baa3b47bfa tempest-ServerActionsV293TestJSON-710111316 tempest-ServerActionsV293TestJSON-710111316-project-member] Lock "6bf89433-15f9-44fd-a4c1-00b72287f65f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.617s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Acquiring lock "009d9050-1720-45de-8bc9-16f404e65911" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "009d9050-1720-45de-8bc9-16f404e65911" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:36 user nova-compute[73010]: INFO nova.compute.manager [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Unshelving
Aug 15 00:43:36 user nova-compute[73010]: INFO nova.virt.block_device [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Booting with volume 72f87474-057f-402d-883f-be3d848431a6 at /dev/vda
Aug 15 00:43:36 user nova-compute[73010]: DEBUG os_brick.utils [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:43:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.564s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:37 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fc298f-8a67-4c7f-a562-51190e247d06]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.126s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:37 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[391d4be7-4329-4f7f-bc7c-3b51dfc69100]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.044s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:37 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68f1b52-22c5-418a-9b8f-ca37a36b6ef0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:37 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[136035bb-90fb-4514-a59f-8201db4e292f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:43:37 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:43:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:43:37 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:43:37 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6819e47b-19d5-4b02-a5ed-f3829172b613]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:37 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:43:37 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:43:37 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:43:37 user nova-compute[73010]: DEBUG os_brick.utils [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] <== get_connector_properties: return (873ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:43:37 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Updating existing volume attachment record: ab50e836-80fa-4031-9cdc-8c8dcea62d0e {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:43:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:44 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060209.4972687, 6bf89433-15f9-44fd-a4c1-00b72287f65f => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:43:44 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] VM Stopped (Lifecycle Event)
Aug 15 00:43:44 user nova-compute[73010]: DEBUG nova.compute.manager [None req-859c3a33-d397-4399-9b18-a679eecbe308 None None] [instance: 6bf89433-15f9-44fd-a4c1-00b72287f65f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:43:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:43:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:47 user nova-compute[73010]: DEBUG nova.objects.instance [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lazy-loading 'pci_requests' on Instance uuid 009d9050-1720-45de-8bc9-16f404e65911 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:43:47 user nova-compute[73010]: DEBUG nova.objects.instance [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lazy-loading 'numa_topology' on Instance uuid 009d9050-1720-45de-8bc9-16f404e65911 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:43:47 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:43:47 user nova-compute[73010]: INFO nova.compute.claims [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Claim successful on node user
Aug 15 00:43:47 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:43:47 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:43:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:47 user nova-compute[73010]: INFO nova.network.neutron [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Updating port 96dadd50-12c8-430b-82ab-f113031f02d8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 00:43:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Acquiring lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:43:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Acquired lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:43:48 user nova-compute[73010]: DEBUG nova.network.neutron [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:43:48 user nova-compute[73010]: DEBUG nova.compute.manager [req-572b77ec-f51f-42dd-a3a4-6eddfc3482a0 req-02e53cc9-b2ca-445a-9f41-719babdbc8e8 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Received event network-changed-96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:43:48 user nova-compute[73010]: DEBUG nova.compute.manager [req-572b77ec-f51f-42dd-a3a4-6eddfc3482a0 req-02e53cc9-b2ca-445a-9f41-719babdbc8e8 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Refreshing instance network info cache due to event network-changed-96dadd50-12c8-430b-82ab-f113031f02d8. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:43:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-572b77ec-f51f-42dd-a3a4-6eddfc3482a0 req-02e53cc9-b2ca-445a-9f41-719babdbc8e8 service nova] Acquiring lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.network.neutron [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Updating instance_info_cache with network_info: [{"id": "96dadd50-12c8-430b-82ab-f113031f02d8", "address": "fa:16:3e:d4:06:17", "network": {"id": "935a0b3b-6f36-45b2-a8d0-4d4541cce103", "bridge": "br-int", "label": "tempest-TestShelveInstance-1947454102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c735a6d80a64492baf3346d0c96a872b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dadd50-12", "ovs_interfaceid": "96dadd50-12c8-430b-82ab-f113031f02d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Releasing lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:43:49 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Creating image(s)
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Did not create local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Ensure instance console log exists: /opt/stack/data/nova/instances/009d9050-1720-45de-8bc9-16f404e65911/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Start _get_guest_xml network_info=[{"id": "96dadd50-12c8-430b-82ab-f113031f02d8", "address": "fa:16:3e:d4:06:17", "network": {"id": "935a0b3b-6f36-45b2-a8d0-4d4541cce103", "bridge": "br-int", "label": "tempest-TestShelveInstance-1947454102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c735a6d80a64492baf3346d0c96a872b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dadd50-12", "ovs_interfaceid": "96dadd50-12c8-430b-82ab-f113031f02d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfoiFbEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '009d9050-1720-45de-8bc9-16f404e65911', 'attached_at': '', 'detached_at': '', 'volume_id': '72f87474-057f-402d-883f-be3d848431a6', 'serial': '72f87474-057f-402d-883f-be3d848431a6'}, 'disk_bus': 'virtio', 'attachment_id': 'ab50e836-80fa-4031-9cdc-8c8dcea62d0e', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-572b77ec-f51f-42dd-a3a4-6eddfc3482a0 req-02e53cc9-b2ca-445a-9f41-719babdbc8e8 service nova] Acquired lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.network.neutron [req-572b77ec-f51f-42dd-a3a4-6eddfc3482a0 req-02e53cc9-b2ca-445a-9f41-719babdbc8e8 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Refreshing network info cache for port 96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:43:49 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:43:49 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.objects.instance [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lazy-loading 'vcpu_model' on Instance uuid 009d9050-1720-45de-8bc9-16f404e65911 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfoiFbEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:43:49 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:43:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:43:49 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:43:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:43:49 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[05931897-fee1-4d3e-b2b0-6e54803278f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:43:49 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a184295e-061e-4f5b-9ba2-9b3de02d18c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6] added
Aug 15 00:43:49 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eca0d5f-7191-4f1d-ab74-3118e8bcc26d]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0935c97-b166-4988-b9f3-445371ed29b7]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MfoiFbEz {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MfoiFbEz" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b021c36f-ebd1-4b77-aa37-5b0cd28c94e8]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MfoiFbEz'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4647d1bd-a40c-44a6-96c9-00d9489e35c1]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97f2f5b-dcae-46ac-ab5c-2114bd17d496]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:43:49 user nova-compute[73010]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:43:49 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:43:49 user nova-compute[73010]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:43:49 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9235bab7-6f8d-4044-af42-19ab7ce3da89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6, portal: 172.16.0.220,3260]
Aug 15 00:43:49 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6, portal: 172.16.0.220,3260] successful.
Aug 15 00:43:49 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d755062-a48c-4ef3-9b91-77b4bfad4be8]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f63a2d-804c-4422-97e3-94794a8f8d36]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:43:49 user nova-compute[73010]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:43:49 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:43:49 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:43:49 user nova-compute[73010]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:43:49 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:43:49 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39a6269-d7d2-4769-9f62-89772107ffa0]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfoiFbEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.network.neutron [req-572b77ec-f51f-42dd-a3a4-6eddfc3482a0 req-02e53cc9-b2ca-445a-9f41-719babdbc8e8 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Updated VIF entry in instance network info cache for port 96dadd50-12c8-430b-82ab-f113031f02d8. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG nova.network.neutron [req-572b77ec-f51f-42dd-a3a4-6eddfc3482a0 req-02e53cc9-b2ca-445a-9f41-719babdbc8e8 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Updating instance_info_cache with network_info: [{"id": "96dadd50-12c8-430b-82ab-f113031f02d8", "address": "fa:16:3e:d4:06:17", "network": {"id": "935a0b3b-6f36-45b2-a8d0-4d4541cce103", "bridge": "br-int", "label": "tempest-TestShelveInstance-1947454102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c735a6d80a64492baf3346d0c96a872b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dadd50-12", "ovs_interfaceid": "96dadd50-12c8-430b-82ab-f113031f02d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:43:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-572b77ec-f51f-42dd-a3a4-6eddfc3482a0 req-02e53cc9-b2ca-445a-9f41-719babdbc8e8 service nova] Releasing lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26534646136353233', 'path': '/dev/sdc'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534646136353233', 'path': '/dev/sdc'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T00:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1795734941',display_name='tempest-TestShelveInstance-server-1795734941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1795734941',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1964489724',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:40:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c735a6d80a64492baf3346d0c96a872b',ramdisk_id='',reservation_id='r-ganojssg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1217563266',owner_user_name='tempest-TestShelveInstance-1217563266-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:43:36Z,user_data=None,user_id='9c8c404d2a364ce6be183c14da241836',uuid=009d9050-1720-45de-8bc9-16f404e65911,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "96dadd50-12c8-430b-82ab-f113031f02d8", "address": "fa:16:3e:d4:06:17", "network": {"id": "935a0b3b-6f36-45b2-a8d0-4d4541cce103", "bridge": "br-int", "label": "tempest-TestShelveInstance-1947454102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c735a6d80a64492baf3346d0c96a872b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dadd50-12", "ovs_interfaceid": "96dadd50-12c8-430b-82ab-f113031f02d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Converting VIF {"id": "96dadd50-12c8-430b-82ab-f113031f02d8", "address": "fa:16:3e:d4:06:17", "network": {"id": "935a0b3b-6f36-45b2-a8d0-4d4541cce103", "bridge": "br-int", "label": "tempest-TestShelveInstance-1947454102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c735a6d80a64492baf3346d0c96a872b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dadd50-12", "ovs_interfaceid": "96dadd50-12c8-430b-82ab-f113031f02d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:06:17,bridge_name='br-int',has_traffic_filtering=True,id=96dadd50-12c8-430b-82ab-f113031f02d8,network=Network(935a0b3b-6f36-45b2-a8d0-4d4541cce103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96dadd50-12') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG nova.objects.instance [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lazy-loading 'pci_devices' on Instance uuid 009d9050-1720-45de-8bc9-16f404e65911 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:43:50 user nova-compute[73010]:   <uuid>009d9050-1720-45de-8bc9-16f404e65911</uuid>
Aug 15 00:43:50 user nova-compute[73010]:   <name>instance-00000016</name>
Aug 15 00:43:50 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:43:50 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:43:50 user nova-compute[73010]:   <metadata>
Aug 15 00:43:50 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:43:50 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:43:50 user nova-compute[73010]:       <nova:name>tempest-TestShelveInstance-server-1795734941</nova:name>
Aug 15 00:43:50 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:43:49</nova:creationTime>
Aug 15 00:43:50 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:43:50 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:43:50 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:43:50 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:43:50 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:43:50 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:43:50 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:43:50 user nova-compute[73010]:       <nova:owner>
Aug 15 00:43:50 user nova-compute[73010]:         <nova:user uuid="9c8c404d2a364ce6be183c14da241836">tempest-TestShelveInstance-1217563266-project-member</nova:user>
Aug 15 00:43:50 user nova-compute[73010]:         <nova:project uuid="c735a6d80a64492baf3346d0c96a872b">tempest-TestShelveInstance-1217563266</nova:project>
Aug 15 00:43:50 user nova-compute[73010]:       </nova:owner>
Aug 15 00:43:50 user nova-compute[73010]:       <nova:ports>
Aug 15 00:43:50 user nova-compute[73010]:         <nova:port uuid="96dadd50-12c8-430b-82ab-f113031f02d8">
Aug 15 00:43:50 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 00:43:50 user nova-compute[73010]:         </nova:port>
Aug 15 00:43:50 user nova-compute[73010]:       </nova:ports>
Aug 15 00:43:50 user nova-compute[73010]:     </nova:instance>
Aug 15 00:43:50 user nova-compute[73010]:   </metadata>
Aug 15 00:43:50 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:43:50 user nova-compute[73010]:     <system>
Aug 15 00:43:50 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:43:50 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:43:50 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:43:50 user nova-compute[73010]:       <entry name="serial">009d9050-1720-45de-8bc9-16f404e65911</entry>
Aug 15 00:43:50 user nova-compute[73010]:       <entry name="uuid">009d9050-1720-45de-8bc9-16f404e65911</entry>
Aug 15 00:43:50 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:43:50 user nova-compute[73010]:     </system>
Aug 15 00:43:50 user nova-compute[73010]:   </sysinfo>
Aug 15 00:43:50 user nova-compute[73010]:   <os>
Aug 15 00:43:50 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:43:50 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:43:50 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:43:50 user nova-compute[73010]:   </os>
Aug 15 00:43:50 user nova-compute[73010]:   <features>
Aug 15 00:43:50 user nova-compute[73010]:     <acpi/>
Aug 15 00:43:50 user nova-compute[73010]:     <apic/>
Aug 15 00:43:50 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:43:50 user nova-compute[73010]:   </features>
Aug 15 00:43:50 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:43:50 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:43:50 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:43:50 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:43:50 user nova-compute[73010]:   </clock>
Aug 15 00:43:50 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:43:50 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:43:50 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:43:50 user nova-compute[73010]:   </cpu>
Aug 15 00:43:50 user nova-compute[73010]:   <devices>
Aug 15 00:43:50 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 00:43:50 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:43:50 user nova-compute[73010]:       <source dev="/dev/sdc"/>
Aug 15 00:43:50 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:43:50 user nova-compute[73010]:       <serial>72f87474-057f-402d-883f-be3d848431a6</serial>
Aug 15 00:43:50 user nova-compute[73010]:     </disk>
Aug 15 00:43:50 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:43:50 user nova-compute[73010]:       <mac address="fa:16:3e:d4:06:17"/>
Aug 15 00:43:50 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:43:50 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:43:50 user nova-compute[73010]:       <target dev="tap96dadd50-12"/>
Aug 15 00:43:50 user nova-compute[73010]:     </interface>
Aug 15 00:43:50 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:43:50 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/009d9050-1720-45de-8bc9-16f404e65911/console.log" append="off"/>
Aug 15 00:43:50 user nova-compute[73010]:     </serial>
Aug 15 00:43:50 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:43:50 user nova-compute[73010]:     <video>
Aug 15 00:43:50 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:43:50 user nova-compute[73010]:     </video>
Aug 15 00:43:50 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:43:50 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:43:50 user nova-compute[73010]:     </rng>
Aug 15 00:43:50 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:43:50 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:43:50 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:43:50 user nova-compute[73010]:     </memballoon>
Aug 15 00:43:50 user nova-compute[73010]:   </devices>
Aug 15 00:43:50 user nova-compute[73010]: </domain>
Aug 15 00:43:50 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T00:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1795734941',display_name='tempest-TestShelveInstance-server-1795734941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1795734941',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1964489724',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:40:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c735a6d80a64492baf3346d0c96a872b',ramdisk_id='',reservation_id='r-ganojssg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1217563266',owner_user_name='tempest-TestShelveInstance-1217563266-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:43:36Z,user_data=None,user_id='9c8c404d2a364ce6be183c14da241836',uuid=009d9050-1720-45de-8bc9-16f404e65911,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "96dadd50-12c8-430b-82ab-f113031f02d8", "address": "fa:16:3e:d4:06:17", "network": {"id": "935a0b3b-6f36-45b2-a8d0-4d4541cce103", "bridge": "br-int", "label": "tempest-TestShelveInstance-1947454102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c735a6d80a64492baf3346d0c96a872b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dadd50-12", "ovs_interfaceid": "96dadd50-12c8-430b-82ab-f113031f02d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Converting VIF {"id": "96dadd50-12c8-430b-82ab-f113031f02d8", "address": "fa:16:3e:d4:06:17", "network": {"id": "935a0b3b-6f36-45b2-a8d0-4d4541cce103", "bridge": "br-int", "label": "tempest-TestShelveInstance-1947454102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c735a6d80a64492baf3346d0c96a872b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dadd50-12", "ovs_interfaceid": "96dadd50-12c8-430b-82ab-f113031f02d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:06:17,bridge_name='br-int',has_traffic_filtering=True,id=96dadd50-12c8-430b-82ab-f113031f02d8,network=Network(935a0b3b-6f36-45b2-a8d0-4d4541cce103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96dadd50-12') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG os_vif [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:06:17,bridge_name='br-int',has_traffic_filtering=True,id=96dadd50-12c8-430b-82ab-f113031f02d8,network=Network(935a0b3b-6f36-45b2-a8d0-4d4541cce103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96dadd50-12') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96dadd50-12, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96dadd50-12, col_values=(('external_ids', {'iface-id': '96dadd50-12c8-430b-82ab-f113031f02d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:06:17', 'vm-uuid': '009d9050-1720-45de-8bc9-16f404e65911'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:50 user nova-compute[73010]: INFO os_vif [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:06:17,bridge_name='br-int',has_traffic_filtering=True,id=96dadd50-12c8-430b-82ab-f113031f02d8,network=Network(935a0b3b-6f36-45b2-a8d0-4d4541cce103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96dadd50-12')
Aug 15 00:43:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] No VIF found with MAC fa:16:3e:d4:06:17, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "98fa0e64-cf36-4991-924d-ba4b713239d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:51 user nova-compute[73010]: DEBUG nova.objects.instance [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lazy-loading 'flavor' on Instance uuid 98fa0e64-cf36-4991-924d-ba4b713239d0 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:43:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.209s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "98fa0e64-cf36-4991-924d-ba4b713239d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:51 user nova-compute[73010]: INFO nova.compute.manager [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Attaching volume 43be3c13-13a6-44f6-9d9a-64f8109e0e35 to /dev/vdb
Aug 15 00:43:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json" returned: 0 in 0.323s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:51 user nova-compute[73010]: DEBUG os_brick.utils [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:43:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e109c7-9eea-4aa6-8092-bb93369036d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f790ef9b-0f49-4f28-a174-bbb0b5676ba4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ec537c-e030-48d0-b6b0-717b30d69b78]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5df9df6-31d7-48c9-b191-189855082708]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:43:52 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:43:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1c0bd2-4e96-421d-9999-e9b97fc60cdb]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG os_brick.utils [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Updating existing volume attachment record: fc1f307a-f56f-4b16-b084-45d3ba605888 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG nova.compute.manager [req-fab5f12e-9c5a-4478-a24b-52ec45f9b9a9 req-7a5985fb-f84d-4379-bb19-9506ba9d6f25 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Received event network-vif-plugged-96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-fab5f12e-9c5a-4478-a24b-52ec45f9b9a9 req-7a5985fb-f84d-4379-bb19-9506ba9d6f25 service nova] Acquiring lock "009d9050-1720-45de-8bc9-16f404e65911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-fab5f12e-9c5a-4478-a24b-52ec45f9b9a9 req-7a5985fb-f84d-4379-bb19-9506ba9d6f25 service nova] Lock "009d9050-1720-45de-8bc9-16f404e65911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-fab5f12e-9c5a-4478-a24b-52ec45f9b9a9 req-7a5985fb-f84d-4379-bb19-9506ba9d6f25 service nova] Lock "009d9050-1720-45de-8bc9-16f404e65911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG nova.compute.manager [req-fab5f12e-9c5a-4478-a24b-52ec45f9b9a9 req-7a5985fb-f84d-4379-bb19-9506ba9d6f25 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] No waiting events found dispatching network-vif-plugged-96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:43:52 user nova-compute[73010]: WARNING nova.compute.manager [req-fab5f12e-9c5a-4478-a24b-52ec45f9b9a9 req-7a5985fb-f84d-4379-bb19-9506ba9d6f25 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Received unexpected event network-vif-plugged-96dadd50-12c8-430b-82ab-f113031f02d8 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 00:43:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Acquiring lock "b78b36ca-699c-4cac-a28a-61a6e684022f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "b78b36ca-699c-4cac-a28a-61a6e684022f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:53 user nova-compute[73010]: DEBUG nova.compute.manager [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:43:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.247s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:53 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:43:53 user nova-compute[73010]: INFO nova.compute.claims [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Claim successful on node user
Aug 15 00:43:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:53 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:43:53 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:43:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.698s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:53 user nova-compute[73010]: DEBUG nova.compute.manager [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:43:53 user nova-compute[73010]: DEBUG nova.compute.manager [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:43:53 user nova-compute[73010]: DEBUG nova.network.neutron [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:43:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:53 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:43:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG nova.policy [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9515da5654394bf7b5175d74e7350a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09136fc9ddd9408892ac461a306a1618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:43:54 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Creating image(s)
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Acquiring lock "/opt/stack/data/nova/instances/b78b36ca-699c-4cac-a28a-61a6e684022f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "/opt/stack/data/nova/instances/b78b36ca-699c-4cac-a28a-61a6e684022f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "/opt/stack/data/nova/instances/b78b36ca-699c-4cac-a28a-61a6e684022f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.202s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060234.5620406, 009d9050-1720-45de-8bc9-16f404e65911 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:43:54 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 009d9050-1720-45de-8bc9-16f404e65911] VM Resumed (Lifecycle Event)
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.201s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/b78b36ca-699c-4cac-a28a-61a6e684022f/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/b78b36ca-699c-4cac-a28a-61a6e684022f/disk 1073741824" returned: 0 in 0.097s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG nova.compute.manager [req-326ee0ee-5558-4494-8a91-189a7e756211 req-98f9ba30-8cd9-41e3-89e8-0528ac71740a service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Received event network-vif-plugged-96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-326ee0ee-5558-4494-8a91-189a7e756211 req-98f9ba30-8cd9-41e3-89e8-0528ac71740a service nova] Acquiring lock "009d9050-1720-45de-8bc9-16f404e65911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-326ee0ee-5558-4494-8a91-189a7e756211 req-98f9ba30-8cd9-41e3-89e8-0528ac71740a service nova] Lock "009d9050-1720-45de-8bc9-16f404e65911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-326ee0ee-5558-4494-8a91-189a7e756211 req-98f9ba30-8cd9-41e3-89e8-0528ac71740a service nova] Lock "009d9050-1720-45de-8bc9-16f404e65911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG nova.compute.manager [req-326ee0ee-5558-4494-8a91-189a7e756211 req-98f9ba30-8cd9-41e3-89e8-0528ac71740a service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] No waiting events found dispatching network-vif-plugged-96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:43:54 user nova-compute[73010]: WARNING nova.compute.manager [req-326ee0ee-5558-4494-8a91-189a7e756211 req-98f9ba30-8cd9-41e3-89e8-0528ac71740a service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Received unexpected event network-vif-plugged-96dadd50-12c8-430b-82ab-f113031f02d8 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:43:54 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Instance spawned successfully.
Aug 15 00:43:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:43:54 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 009d9050-1720-45de-8bc9-16f404e65911] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:43:54 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060234.572782, 009d9050-1720-45de-8bc9-16f404e65911 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:43:54 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 009d9050-1720-45de-8bc9-16f404e65911] VM Started (Lifecycle Event)
Aug 15 00:43:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG nova.network.neutron [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Successfully created port: 80c40092-db14-49f0-95b6-e56d82db8d44 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:43:54 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 009d9050-1720-45de-8bc9-16f404e65911] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-06b6ee6a-1d08-4206-9915-32bf0ebb7818 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "009d9050-1720-45de-8bc9-16f404e65911" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.850s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.208s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b78b36ca-699c-4cac-a28a-61a6e684022f/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:43:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b78b36ca-699c-4cac-a28a-61a6e684022f/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b78b36ca-699c-4cac-a28a-61a6e684022f/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:55 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Cannot resize image /opt/stack/data/nova/instances/b78b36ca-699c-4cac-a28a-61a6e684022f/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:43:55 user nova-compute[73010]: DEBUG nova.objects.instance [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lazy-loading 'migration_context' on Instance uuid b78b36ca-699c-4cac-a28a-61a6e684022f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:43:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:43:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Ensure instance console log exists: /opt/stack/data/nova/instances/b78b36ca-699c-4cac-a28a-61a6e684022f/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:43:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.network.neutron [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Successfully updated port: 80c40092-db14-49f0-95b6-e56d82db8d44 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.compute.manager [req-29d8f6f8-e465-4c68-8345-af051b198712 req-e18b05ea-35f4-4ebf-b59f-6ea3954bdd2e service nova] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Received event network-changed-80c40092-db14-49f0-95b6-e56d82db8d44 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.compute.manager [req-29d8f6f8-e465-4c68-8345-af051b198712 req-e18b05ea-35f4-4ebf-b59f-6ea3954bdd2e service nova] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Refreshing instance network info cache due to event network-changed-80c40092-db14-49f0-95b6-e56d82db8d44. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-29d8f6f8-e465-4c68-8345-af051b198712 req-e18b05ea-35f4-4ebf-b59f-6ea3954bdd2e service nova] Acquiring lock "refresh_cache-b78b36ca-699c-4cac-a28a-61a6e684022f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-29d8f6f8-e465-4c68-8345-af051b198712 req-e18b05ea-35f4-4ebf-b59f-6ea3954bdd2e service nova] Acquired lock "refresh_cache-b78b36ca-699c-4cac-a28a-61a6e684022f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.network.neutron [req-29d8f6f8-e465-4c68-8345-af051b198712 req-e18b05ea-35f4-4ebf-b59f-6ea3954bdd2e service nova] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Refreshing network info cache for port 80c40092-db14-49f0-95b6-e56d82db8d44 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Acquiring lock "refresh_cache-b78b36ca-699c-4cac-a28a-61a6e684022f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:43:56 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:43:56 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=7229MB free_disk=25.49636459350586GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.network.neutron [req-29d8f6f8-e465-4c68-8345-af051b198712 req-e18b05ea-35f4-4ebf-b59f-6ea3954bdd2e service nova] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6dfc356b-953a-47b0-9da7-70cc59a80853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance eec545e8-eeda-443c-9892-980e19e7267a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4b489f97-c8d4-4a6a-8404-e1a05a990261 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 98fa0e64-cf36-4991-924d-ba4b713239d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4b5baaac-bb54-462c-b833-4f37de8f24dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance c844e062-d79e-4c50-a116-4e6a6661e1d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 009d9050-1720-45de-8bc9-16f404e65911 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance b78b36ca-699c-4cac-a28a-61a6e684022f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.network.neutron [req-29d8f6f8-e465-4c68-8345-af051b198712 req-e18b05ea-35f4-4ebf-b59f-6ea3954bdd2e service nova] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-29d8f6f8-e465-4c68-8345-af051b198712 req-e18b05ea-35f4-4ebf-b59f-6ea3954bdd2e service nova] Releasing lock "refresh_cache-b78b36ca-699c-4cac-a28a-61a6e684022f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Acquired lock "refresh_cache-b78b36ca-699c-4cac-a28a-61a6e684022f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.network.neutron [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.network.neutron [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.829s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:56 user nova-compute[73010]: DEBUG nova.network.neutron [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Updating instance_info_cache with network_info: [{"id": "80c40092-db14-49f0-95b6-e56d82db8d44", "address": "fa:16:3e:4b:e9:91", "network": {"id": "2f9cb7ad-5cb3-4458-993a-780ab047d4e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-145440789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09136fc9ddd9408892ac461a306a1618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c40092-db", "ovs_interfaceid": "80c40092-db14-49f0-95b6-e56d82db8d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Releasing lock "refresh_cache-b78b36ca-699c-4cac-a28a-61a6e684022f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Instance network_info: |[{"id": "80c40092-db14-49f0-95b6-e56d82db8d44", "address": "fa:16:3e:4b:e9:91", "network": {"id": "2f9cb7ad-5cb3-4458-993a-780ab047d4e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-145440789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09136fc9ddd9408892ac461a306a1618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c40092-db", "ovs_interfaceid": "80c40092-db14-49f0-95b6-e56d82db8d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Start _get_guest_xml network_info=[{"id": "80c40092-db14-49f0-95b6-e56d82db8d44", "address": "fa:16:3e:4b:e9:91", "network": {"id": "2f9cb7ad-5cb3-4458-993a-780ab047d4e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-145440789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09136fc9ddd9408892ac461a306a1618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c40092-db", "ovs_interfaceid": "80c40092-db14-49f0-95b6-e56d82db8d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:43:57 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:43:57 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:43:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-863199853',display_name='tempest-ServersNegativeTestJSON-server-863199853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-863199853',id=31,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09136fc9ddd9408892ac461a306a1618',ramdisk_id='',reservation_id='r-yqt9llj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-590131230',owner_user_name='tempest-ServersNegativeTestJSON-590131230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:43:54Z,user_data=None,user_id='9515da5654394bf7b5175d74e7350a42',uuid=b78b36ca-699c-4cac-a28a-61a6e684022f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80c40092-db14-49f0-95b6-e56d82db8d44", "address": "fa:16:3e:4b:e9:91", "network": {"id": "2f9cb7ad-5cb3-4458-993a-780ab047d4e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-145440789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09136fc9ddd9408892ac461a306a1618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c40092-db", "ovs_interfaceid": "80c40092-db14-49f0-95b6-e56d82db8d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Converting VIF {"id": "80c40092-db14-49f0-95b6-e56d82db8d44", "address": "fa:16:3e:4b:e9:91", "network": {"id": "2f9cb7ad-5cb3-4458-993a-780ab047d4e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-145440789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09136fc9ddd9408892ac461a306a1618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c40092-db", "ovs_interfaceid": "80c40092-db14-49f0-95b6-e56d82db8d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:e9:91,bridge_name='br-int',has_traffic_filtering=True,id=80c40092-db14-49f0-95b6-e56d82db8d44,network=Network(2f9cb7ad-5cb3-4458-993a-780ab047d4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c40092-db') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.objects.instance [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lazy-loading 'pci_devices' on Instance uuid b78b36ca-699c-4cac-a28a-61a6e684022f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:43:57 user nova-compute[73010]:   <uuid>b78b36ca-699c-4cac-a28a-61a6e684022f</uuid>
Aug 15 00:43:57 user nova-compute[73010]:   <name>instance-0000001f</name>
Aug 15 00:43:57 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:43:57 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:43:57 user nova-compute[73010]:   <metadata>
Aug 15 00:43:57 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:43:57 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:43:57 user nova-compute[73010]:       <nova:name>tempest-ServersNegativeTestJSON-server-863199853</nova:name>
Aug 15 00:43:57 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:43:57</nova:creationTime>
Aug 15 00:43:57 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:43:57 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:43:57 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:43:57 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:43:57 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:43:57 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:43:57 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:43:57 user nova-compute[73010]:       <nova:owner>
Aug 15 00:43:57 user nova-compute[73010]:         <nova:user uuid="9515da5654394bf7b5175d74e7350a42">tempest-ServersNegativeTestJSON-590131230-project-member</nova:user>
Aug 15 00:43:57 user nova-compute[73010]:         <nova:project uuid="09136fc9ddd9408892ac461a306a1618">tempest-ServersNegativeTestJSON-590131230</nova:project>
Aug 15 00:43:57 user nova-compute[73010]:       </nova:owner>
Aug 15 00:43:57 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:43:57 user nova-compute[73010]:       <nova:ports>
Aug 15 00:43:57 user nova-compute[73010]:         <nova:port uuid="80c40092-db14-49f0-95b6-e56d82db8d44">
Aug 15 00:43:57 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 00:43:57 user nova-compute[73010]:         </nova:port>
Aug 15 00:43:57 user nova-compute[73010]:       </nova:ports>
Aug 15 00:43:57 user nova-compute[73010]:     </nova:instance>
Aug 15 00:43:57 user nova-compute[73010]:   </metadata>
Aug 15 00:43:57 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:43:57 user nova-compute[73010]:     <system>
Aug 15 00:43:57 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:43:57 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:43:57 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:43:57 user nova-compute[73010]:       <entry name="serial">b78b36ca-699c-4cac-a28a-61a6e684022f</entry>
Aug 15 00:43:57 user nova-compute[73010]:       <entry name="uuid">b78b36ca-699c-4cac-a28a-61a6e684022f</entry>
Aug 15 00:43:57 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:43:57 user nova-compute[73010]:     </system>
Aug 15 00:43:57 user nova-compute[73010]:   </sysinfo>
Aug 15 00:43:57 user nova-compute[73010]:   <os>
Aug 15 00:43:57 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:43:57 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:43:57 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:43:57 user nova-compute[73010]:   </os>
Aug 15 00:43:57 user nova-compute[73010]:   <features>
Aug 15 00:43:57 user nova-compute[73010]:     <acpi/>
Aug 15 00:43:57 user nova-compute[73010]:     <apic/>
Aug 15 00:43:57 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:43:57 user nova-compute[73010]:   </features>
Aug 15 00:43:57 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:43:57 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:43:57 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:43:57 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:43:57 user nova-compute[73010]:   </clock>
Aug 15 00:43:57 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:43:57 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:43:57 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:43:57 user nova-compute[73010]:   </cpu>
Aug 15 00:43:57 user nova-compute[73010]:   <devices>
Aug 15 00:43:57 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:43:57 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:43:57 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/b78b36ca-699c-4cac-a28a-61a6e684022f/disk"/>
Aug 15 00:43:57 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:43:57 user nova-compute[73010]:     </disk>
Aug 15 00:43:57 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:43:57 user nova-compute[73010]:       <mac address="fa:16:3e:4b:e9:91"/>
Aug 15 00:43:57 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:43:57 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:43:57 user nova-compute[73010]:       <target dev="tap80c40092-db"/>
Aug 15 00:43:57 user nova-compute[73010]:     </interface>
Aug 15 00:43:57 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:43:57 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/b78b36ca-699c-4cac-a28a-61a6e684022f/console.log" append="off"/>
Aug 15 00:43:57 user nova-compute[73010]:     </serial>
Aug 15 00:43:57 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:43:57 user nova-compute[73010]:     <video>
Aug 15 00:43:57 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:43:57 user nova-compute[73010]:     </video>
Aug 15 00:43:57 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:43:57 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:43:57 user nova-compute[73010]:     </rng>
Aug 15 00:43:57 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:43:57 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:43:57 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:43:57 user nova-compute[73010]:     </memballoon>
Aug 15 00:43:57 user nova-compute[73010]:   </devices>
Aug 15 00:43:57 user nova-compute[73010]: </domain>
Aug 15 00:43:57 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:43:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-863199853',display_name='tempest-ServersNegativeTestJSON-server-863199853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-863199853',id=31,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09136fc9ddd9408892ac461a306a1618',ramdisk_id='',reservation_id='r-yqt9llj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-590131230',owner_user_name='tempest-ServersNegativeTestJSON-590131230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:43:54Z,user_data=None,user_id='9515da5654394bf7b5175d74e7350a42',uuid=b78b36ca-699c-4cac-a28a-61a6e684022f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80c40092-db14-49f0-95b6-e56d82db8d44", "address": "fa:16:3e:4b:e9:91", "network": {"id": "2f9cb7ad-5cb3-4458-993a-780ab047d4e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-145440789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09136fc9ddd9408892ac461a306a1618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c40092-db", "ovs_interfaceid": "80c40092-db14-49f0-95b6-e56d82db8d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Converting VIF {"id": "80c40092-db14-49f0-95b6-e56d82db8d44", "address": "fa:16:3e:4b:e9:91", "network": {"id": "2f9cb7ad-5cb3-4458-993a-780ab047d4e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-145440789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09136fc9ddd9408892ac461a306a1618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c40092-db", "ovs_interfaceid": "80c40092-db14-49f0-95b6-e56d82db8d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:e9:91,bridge_name='br-int',has_traffic_filtering=True,id=80c40092-db14-49f0-95b6-e56d82db8d44,network=Network(2f9cb7ad-5cb3-4458-993a-780ab047d4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c40092-db') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG os_vif [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:e9:91,bridge_name='br-int',has_traffic_filtering=True,id=80c40092-db14-49f0-95b6-e56d82db8d44,network=Network(2f9cb7ad-5cb3-4458-993a-780ab047d4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c40092-db') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80c40092-db, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap80c40092-db, col_values=(('external_ids', {'iface-id': '80c40092-db14-49f0-95b6-e56d82db8d44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:e9:91', 'vm-uuid': 'b78b36ca-699c-4cac-a28a-61a6e684022f'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:57 user nova-compute[73010]: INFO os_vif [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:e9:91,bridge_name='br-int',has_traffic_filtering=True,id=80c40092-db14-49f0-95b6-e56d82db8d44,network=Network(2f9cb7ad-5cb3-4458-993a-780ab047d4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c40092-db')
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:43:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] No VIF found with MAC fa:16:3e:4b:e9:91, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:43:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:58 user nova-compute[73010]: DEBUG nova.compute.manager [req-1216904d-1414-4406-80c1-88195d493947 req-75bb29b8-139f-4da5-96e0-b74e7c205cc7 service nova] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Received event network-vif-plugged-80c40092-db14-49f0-95b6-e56d82db8d44 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:43:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1216904d-1414-4406-80c1-88195d493947 req-75bb29b8-139f-4da5-96e0-b74e7c205cc7 service nova] Acquiring lock "b78b36ca-699c-4cac-a28a-61a6e684022f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1216904d-1414-4406-80c1-88195d493947 req-75bb29b8-139f-4da5-96e0-b74e7c205cc7 service nova] Lock "b78b36ca-699c-4cac-a28a-61a6e684022f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1216904d-1414-4406-80c1-88195d493947 req-75bb29b8-139f-4da5-96e0-b74e7c205cc7 service nova] Lock "b78b36ca-699c-4cac-a28a-61a6e684022f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:43:58 user nova-compute[73010]: DEBUG nova.compute.manager [req-1216904d-1414-4406-80c1-88195d493947 req-75bb29b8-139f-4da5-96e0-b74e7c205cc7 service nova] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] No waiting events found dispatching network-vif-plugged-80c40092-db14-49f0-95b6-e56d82db8d44 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:43:58 user nova-compute[73010]: WARNING nova.compute.manager [req-1216904d-1414-4406-80c1-88195d493947 req-75bb29b8-139f-4da5-96e0-b74e7c205cc7 service nova] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Received unexpected event network-vif-plugged-80c40092-db14-49f0-95b6-e56d82db8d44 for instance with vm_state building and task_state spawning.
Aug 15 00:43:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquiring lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:43:59 user nova-compute[73010]: INFO nova.compute.manager [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Detaching volume 8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132
Aug 15 00:43:59 user nova-compute[73010]: INFO nova.virt.block_device [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Attempting to driver detach volume 8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 from mountpoint /dev/vdb
Aug 15 00:43:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Attempting to detach device vdb from instance f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:43:59 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:43:59 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:43:59 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:43:59 user nova-compute[73010]:   <serial>8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132</serial>
Aug 15 00:43:59 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:43:59 user nova-compute[73010]: </disk>
Aug 15 00:43:59 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:43:59 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Successfully detached device vdb from instance f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 from the persistent domain config.
Aug 15 00:43:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:43:59 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:43:59 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:43:59 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:43:59 user nova-compute[73010]:   <serial>8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132</serial>
Aug 15 00:43:59 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:43:59 user nova-compute[73010]: </disk>
Aug 15 00:43:59 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692060239.6924698, f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:43:59 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Successfully detached device vdb from instance f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 from the live domain config.
Aug 15 00:43:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AELlQJDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:43:59 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:43:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c7ab3b-4f3a-4417-b759-6d51e3cd57a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a12865c-348e-44fd-bc3d-cecde9b75103]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:43:59 user nova-compute[73010]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:43:59 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:43:59 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 (non-flash)
Aug 15 00:43:59 user nova-compute[73010]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:43:59 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:43:59 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec5052ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132'): ({'sdb'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Removing single pathed devices sdb {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[237eef89-ae17-4099-b60d-c98e1fbdb1b0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c74bf11-9ed8-4141-a16d-1b90735963ea]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Flushing IO for device /dev/sdb {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c626817b-4245-4cb6-b9ef-397b136f2c4a]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f42bcb2-a3d5-4de9-ac52-21e02f9430f6]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9a2120-d638-4ea4-93d5-033e63052766]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b311c73d-154a-4d5d-bac6-6e6f6803defe]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132, portal: 172.16.0.220,3260]
Aug 15 00:43:59 user nova-compute[73010]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132, portal: 172.16.0.220,3260] successful.
Aug 15 00:43:59 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:43:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f13ef2c-3bda-4ed2-9fce-3af0e2bbf132 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d201d1d5-8aa7-4262-9b58-f9c5f2a198fc]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] <== disconnect_volume: return (298ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lazy-loading 'flavor' on Instance uuid f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b18228b7-b70c-4513-bd65-076bf3cde08e tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.716s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Skipping network cache update for instance because it is Building. {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060240.9521003, b78b36ca-699c-4cac-a28a-61a6e684022f => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:44:00 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] VM Resumed (Lifecycle Event)
Aug 15 00:44:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-6dfc356b-953a-47b0-9da7-70cc59a80853" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-6dfc356b-953a-47b0-9da7-70cc59a80853" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lazy-loading 'info_cache' on Instance uuid 6dfc356b-953a-47b0-9da7-70cc59a80853 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:44:00 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Instance spawned successfully.
Aug 15 00:44:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG nova.compute.manager [req-01010649-5c7f-437e-ba0e-a4d18451ca80 req-ca16abb5-ef2b-473d-b698-da65a02f732d service nova] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Received event network-vif-plugged-80c40092-db14-49f0-95b6-e56d82db8d44 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-01010649-5c7f-437e-ba0e-a4d18451ca80 req-ca16abb5-ef2b-473d-b698-da65a02f732d service nova] Acquiring lock "b78b36ca-699c-4cac-a28a-61a6e684022f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-01010649-5c7f-437e-ba0e-a4d18451ca80 req-ca16abb5-ef2b-473d-b698-da65a02f732d service nova] Lock "b78b36ca-699c-4cac-a28a-61a6e684022f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-01010649-5c7f-437e-ba0e-a4d18451ca80 req-ca16abb5-ef2b-473d-b698-da65a02f732d service nova] Lock "b78b36ca-699c-4cac-a28a-61a6e684022f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:44:00 user nova-compute[73010]: DEBUG nova.compute.manager [req-01010649-5c7f-437e-ba0e-a4d18451ca80 req-ca16abb5-ef2b-473d-b698-da65a02f732d service nova] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] No waiting events found dispatching network-vif-plugged-80c40092-db14-49f0-95b6-e56d82db8d44 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:44:00 user nova-compute[73010]: WARNING nova.compute.manager [req-01010649-5c7f-437e-ba0e-a4d18451ca80 req-ca16abb5-ef2b-473d-b698-da65a02f732d service nova] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Received unexpected event network-vif-plugged-80c40092-db14-49f0-95b6-e56d82db8d44 for instance with vm_state building and task_state spawning.
Aug 15 00:44:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:44:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:44:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:44:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:44:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:44:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:44:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:44:01 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:44:01 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060240.9561203, b78b36ca-699c-4cac-a28a-61a6e684022f => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:44:01 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] VM Started (Lifecycle Event)
Aug 15 00:44:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:44:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:44:01 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:44:01 user nova-compute[73010]: INFO nova.compute.manager [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Took 6.97 seconds to spawn the instance on the hypervisor.
Aug 15 00:44:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:44:01 user nova-compute[73010]: INFO nova.compute.manager [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Took 8.11 seconds to build instance.
Aug 15 00:44:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56dad127-0620-43e9-ac83-f5f95244133b tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "b78b36ca-699c-4cac-a28a-61a6e684022f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.230s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:44:01 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Updating instance_info_cache with network_info: [{"id": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "address": "fa:16:3e:63:99:69", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff59e78-ba", "ovs_interfaceid": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:44:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-6dfc356b-953a-47b0-9da7-70cc59a80853" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:44:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 00:44:01 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:44:01 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:44:01 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:44:01 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:44:01 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:44:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:44:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hcWvRDOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:44:02 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:44:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:44:02 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:44:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:44:02 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a09174-2db3-4c8a-8fc1-5806f867d434]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:44:02 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d0979d-0806-433c-8c6e-e10a806018b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35] added
Aug 15 00:44:02 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdce970-1040-408c-9202-a5f73521bbd0]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34b8731-522a-41f2-bb6f-9353fe8c2cbf]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hcWvRDOU {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hcWvRDOU" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc0ed12-f1e6-4a06-ba8a-8ff8459fdc70]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hcWvRDOU'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b880a4e5-9a6c-49a3-945a-646ef972fc45]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4b27fb-391a-41ac-8e33-94f5ca06f0cd]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:44:02 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:44:02 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:44:02 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:44:02 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce132395-adde-41ac-a226-18e781f507bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35, portal: 172.16.0.220,3260]
Aug 15 00:44:02 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35, portal: 172.16.0.220,3260] successful.
Aug 15 00:44:02 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[391e24d6-d6fc-4ec7-8267-08f8d93284ee]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde8a1e5-1c38-4bcb-afb2-3bbf3b13b038]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:44:02 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:44:02 user nova-compute[73010]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 (non-flash)
Aug 15 00:44:02 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:44:02 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:44:02 user nova-compute[73010]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 (non-flash)
Aug 15 00:44:02 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1e3bec-72ec-4482-8864-f19e4efba4fc]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:44:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hcWvRDOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:44:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:44:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26534343136353163', 'path': '/dev/sdb'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:44:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534343136353163', 'path': '/dev/sdb'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:44:03 user nova-compute[73010]: DEBUG nova.objects.instance [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lazy-loading 'flavor' on Instance uuid 98fa0e64-cf36-4991-924d-ba4b713239d0 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:44:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:44:03 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:44:03 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:44:03 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:44:03 user nova-compute[73010]:   <serial>43be3c13-13a6-44f6-9d9a-64f8109e0e35</serial>
Aug 15 00:44:03 user nova-compute[73010]: </disk>
Aug 15 00:44:03 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:44:04 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:44:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:44:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:44:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] No VIF found with MAC fa:16:3e:1d:6a:3d, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:44:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4783703f-76ba-47cd-9815-8897c105fe02 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.673s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:44:04 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:44:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "98fa0e64-cf36-4991-924d-ba4b713239d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:44:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:44:06 user nova-compute[73010]: INFO nova.compute.manager [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Detaching volume 43be3c13-13a6-44f6-9d9a-64f8109e0e35
Aug 15 00:44:06 user nova-compute[73010]: INFO nova.virt.block_device [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Attempting to driver detach volume 43be3c13-13a6-44f6-9d9a-64f8109e0e35 from mountpoint /dev/vdb
Aug 15 00:44:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Attempting to detach device vdb from instance 98fa0e64-cf36-4991-924d-ba4b713239d0 from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:44:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:44:06 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:44:06 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:44:06 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:44:06 user nova-compute[73010]:   <serial>43be3c13-13a6-44f6-9d9a-64f8109e0e35</serial>
Aug 15 00:44:06 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:44:06 user nova-compute[73010]: </disk>
Aug 15 00:44:06 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:44:06 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Successfully detached device vdb from instance 98fa0e64-cf36-4991-924d-ba4b713239d0 from the persistent domain config.
Aug 15 00:44:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 98fa0e64-cf36-4991-924d-ba4b713239d0 from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:44:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:44:06 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:44:06 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:44:06 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:44:06 user nova-compute[73010]:   <serial>43be3c13-13a6-44f6-9d9a-64f8109e0e35</serial>
Aug 15 00:44:06 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:44:06 user nova-compute[73010]: </disk>
Aug 15 00:44:06 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692060247.3314002, 98fa0e64-cf36-4991-924d-ba4b713239d0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 98fa0e64-cf36-4991-924d-ba4b713239d0 {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:44:07 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Successfully detached device vdb from instance 98fa0e64-cf36-4991-924d-ba4b713239d0 from the live domain config.
Aug 15 00:44:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hcWvRDOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:44:07 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:44:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9ad944-fc84-471d-8abc-d5a6ff5e9cb0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bebac14-bfbd-423d-9b5f-c115acd7e9f8]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:44:07 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:44:07 user nova-compute[73010]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 (non-flash)
Aug 15 00:44:07 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:44:07 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:44:07 user nova-compute[73010]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 (non-flash)
Aug 15 00:44:07 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec3064a050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35'): ({'sdb'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Removing single pathed devices sdb {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a408511-dccd-4902-8c06-35f2a32e255d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2e7bb9-2a62-4f6d-aa74-7a5fd2c449a8]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Flushing IO for device /dev/sdb {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfddddfc-92d1-448b-9929-6fdb386de7d6]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd608dac-e3fb-4157-b69b-b75816e998bc]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a1009c-945b-457d-826f-8d7b12c1e9f1]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f7a040-43d2-4f74-851f-c72c7f7f185a]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35, portal: 172.16.0.220,3260]
Aug 15 00:44:07 user nova-compute[73010]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35, portal: 172.16.0.220,3260] successful.
Aug 15 00:44:07 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43be3c13-13a6-44f6-9d9a-64f8109e0e35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba31e55f-7f01-4549-a2f1-338de6934d2d]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] <== disconnect_volume: return (300ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:44:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:44:08 user nova-compute[73010]: DEBUG nova.objects.instance [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lazy-loading 'flavor' on Instance uuid 98fa0e64-cf36-4991-924d-ba4b713239d0 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:44:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a8cc743e-7ae9-4d55-a410-d8687c57ee99 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.706s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:44:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:31 user nova-compute[73010]: DEBUG nova.compute.manager [req-5b91613d-1b67-49cc-868b-383bef129521 req-6c3b10d8-2cd7-4c2b-8ab2-c1c29f06cff7 service nova] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Received event network-changed-fa402f22-9164-478b-816a-1b63709fbe59 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:44:31 user nova-compute[73010]: DEBUG nova.compute.manager [req-5b91613d-1b67-49cc-868b-383bef129521 req-6c3b10d8-2cd7-4c2b-8ab2-c1c29f06cff7 service nova] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Refreshing instance network info cache due to event network-changed-fa402f22-9164-478b-816a-1b63709fbe59. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:44:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5b91613d-1b67-49cc-868b-383bef129521 req-6c3b10d8-2cd7-4c2b-8ab2-c1c29f06cff7 service nova] Acquiring lock "refresh_cache-c844e062-d79e-4c50-a116-4e6a6661e1d6" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:44:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5b91613d-1b67-49cc-868b-383bef129521 req-6c3b10d8-2cd7-4c2b-8ab2-c1c29f06cff7 service nova] Acquired lock "refresh_cache-c844e062-d79e-4c50-a116-4e6a6661e1d6" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:44:31 user nova-compute[73010]: DEBUG nova.network.neutron [req-5b91613d-1b67-49cc-868b-383bef129521 req-6c3b10d8-2cd7-4c2b-8ab2-c1c29f06cff7 service nova] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Refreshing network info cache for port fa402f22-9164-478b-816a-1b63709fbe59 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:44:31 user nova-compute[73010]: DEBUG nova.compute.manager [req-a2eb29fc-d904-4d3f-9f26-402944499449 req-d6250ff1-d294-48fb-a816-47dc8196e8f2 service nova] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Received event network-changed-b7c4cb21-45d7-4383-8716-d9b5f6de9000 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:44:31 user nova-compute[73010]: DEBUG nova.compute.manager [req-a2eb29fc-d904-4d3f-9f26-402944499449 req-d6250ff1-d294-48fb-a816-47dc8196e8f2 service nova] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Refreshing instance network info cache due to event network-changed-b7c4cb21-45d7-4383-8716-d9b5f6de9000. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:44:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a2eb29fc-d904-4d3f-9f26-402944499449 req-d6250ff1-d294-48fb-a816-47dc8196e8f2 service nova] Acquiring lock "refresh_cache-5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:44:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a2eb29fc-d904-4d3f-9f26-402944499449 req-d6250ff1-d294-48fb-a816-47dc8196e8f2 service nova] Acquired lock "refresh_cache-5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:44:31 user nova-compute[73010]: DEBUG nova.network.neutron [req-a2eb29fc-d904-4d3f-9f26-402944499449 req-d6250ff1-d294-48fb-a816-47dc8196e8f2 service nova] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Refreshing network info cache for port b7c4cb21-45d7-4383-8716-d9b5f6de9000 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:44:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:31 user nova-compute[73010]: DEBUG nova.network.neutron [req-5b91613d-1b67-49cc-868b-383bef129521 req-6c3b10d8-2cd7-4c2b-8ab2-c1c29f06cff7 service nova] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Updated VIF entry in instance network info cache for port fa402f22-9164-478b-816a-1b63709fbe59. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:44:31 user nova-compute[73010]: DEBUG nova.network.neutron [req-5b91613d-1b67-49cc-868b-383bef129521 req-6c3b10d8-2cd7-4c2b-8ab2-c1c29f06cff7 service nova] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Updating instance_info_cache with network_info: [{"id": "fa402f22-9164-478b-816a-1b63709fbe59", "address": "fa:16:3e:61:cc:e9", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa402f22-91", "ovs_interfaceid": "fa402f22-9164-478b-816a-1b63709fbe59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:44:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5b91613d-1b67-49cc-868b-383bef129521 req-6c3b10d8-2cd7-4c2b-8ab2-c1c29f06cff7 service nova] Releasing lock "refresh_cache-c844e062-d79e-4c50-a116-4e6a6661e1d6" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:44:31 user nova-compute[73010]: DEBUG nova.network.neutron [req-a2eb29fc-d904-4d3f-9f26-402944499449 req-d6250ff1-d294-48fb-a816-47dc8196e8f2 service nova] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Updated VIF entry in instance network info cache for port b7c4cb21-45d7-4383-8716-d9b5f6de9000. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:44:31 user nova-compute[73010]: DEBUG nova.network.neutron [req-a2eb29fc-d904-4d3f-9f26-402944499449 req-d6250ff1-d294-48fb-a816-47dc8196e8f2 service nova] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Updating instance_info_cache with network_info: [{"id": "b7c4cb21-45d7-4383-8716-d9b5f6de9000", "address": "fa:16:3e:86:b7:e1", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c4cb21-45", "ovs_interfaceid": "b7c4cb21-45d7-4383-8716-d9b5f6de9000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:44:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a2eb29fc-d904-4d3f-9f26-402944499449 req-d6250ff1-d294-48fb-a816-47dc8196e8f2 service nova] Releasing lock "refresh_cache-5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:44:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "c844e062-d79e-4c50-a116-4e6a6661e1d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:44:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:44:34 user nova-compute[73010]: DEBUG nova.objects.instance [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'flavor' on Instance uuid c844e062-d79e-4c50-a116-4e6a6661e1d6 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:44:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:44:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "c844e062-d79e-4c50-a116-4e6a6661e1d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:44:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:44:34 user nova-compute[73010]: INFO nova.compute.manager [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Attaching volume 66a4c5a7-26fe-4c22-8c65-727b08364b9f to /dev/vdb
Aug 15 00:44:35 user nova-compute[73010]: DEBUG os_brick.utils [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:44:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:35 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc367ba-9b9c-4666-947a-217ab160f8e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:35 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb56de3-8b0b-4561-a0c6-bf3d16522a2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:35 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bee018f-eba5-4be2-b34b-ef28dc1f0661]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:35 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e7eeee-532f-4e76-9bdf-332d0fe0d00d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:44:35 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:44:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:44:35 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:44:35 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14fb706-b1d9-497b-b616-b386b78f31a0]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:35 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:44:35 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:44:35 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:44:35 user nova-compute[73010]: DEBUG os_brick.utils [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:44:35 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Updating existing volume attachment record: 6ed12129-90cf-4e24-a172-c1c8cbd18741 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG nova.objects.instance [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lazy-loading 'flavor' on Instance uuid 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:44:36 user nova-compute[73010]: INFO nova.compute.manager [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Attaching volume fff5cf20-2dc0-4962-b7b3-c8a454545adb to /dev/vdb
Aug 15 00:44:36 user nova-compute[73010]: DEBUG os_brick.utils [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[50def308-7bf0-46ed-9363-4bdddc9b9ef8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fb38fa-9ef9-45ce-ac08-13f2acd1c0f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff687e4-b1e4-4e91-82eb-bde04631ecb4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[893bbdf7-adb8-4816-a2cb-5dc56c1d0bb0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:44:36 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:44:36 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6f55fb-11de-4158-b026-d91b0b2c4791]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG os_brick.utils [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Updating existing volume attachment record: 463ed7a7-f497-428a-a38e-e8a1348a6cdc {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:44:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WHTGjzbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:44:44 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:44:44 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:44:44 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:44:44 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:44:44 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc326dce-6b95-4594-9fdb-85f27a75b5d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:44:44 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92f3f5d-72fc-4574-9c18-9cb4dbcb7b8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f] added
Aug 15 00:44:44 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de06b2c-3aed-49b2-adcb-4c939ba3557b]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[41428e11-36c6-4f47-b648-df633093109f]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WHTGjzbv {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WHTGjzbv" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[03216875-641d-4265-a96c-66147102d951]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WHTGjzbv'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b787746e-9a8a-4136-9765-679cd29513bb]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0658d6d8-ce2f-404e-974a-26701fa2edbc]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:44:44 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:44:44 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:44:44 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:44:44 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[76193216-509d-4491-91b4-f3810a44d8b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f, portal: 172.16.0.220,3260]
Aug 15 00:44:44 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f, portal: 172.16.0.220,3260] successful.
Aug 15 00:44:44 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5321d5df-a6e2-416e-a631-743847df13f1]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[53086caa-1f19-43bd-b242-a725929bcbda]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:44:44 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:44:44 user nova-compute[73010]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f (non-flash)
Aug 15 00:44:44 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:44:44 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:44:44 user nova-compute[73010]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f (non-flash)
Aug 15 00:44:44 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d498e90-87d8-4849-a242-cc0a47947aec]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:44 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: None {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'obTLrtsd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:44:45 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:44:45 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WHTGjzbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26132353832656539', 'path': '/dev/sdb'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132353832656539', 'path': '/dev/sdb'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.100s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:44:45 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:44:45 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:44:45 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:44:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG nova.objects.instance [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'flavor' on Instance uuid c844e062-d79e-4c50-a116-4e6a6661e1d6 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[119895c0-08dd-492a-be56-919502d696ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:44:45 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:44:45 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:44:45 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:44:45 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:44:45 user nova-compute[73010]:   <serial>66a4c5a7-26fe-4c22-8c65-727b08364b9f</serial>
Aug 15 00:44:45 user nova-compute[73010]: </disk>
Aug 15 00:44:45 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c699c3c-2da6-4d49-87ee-bb84710eb8a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb] added
Aug 15 00:44:45 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[43396ace-7d57-4f0e-a90b-1675423de0e4]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2828200-d46a-4b0c-bc3b-49147b1f0c70]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v obTLrtsd {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v obTLrtsd" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8bba14-241a-412c-ad37-014f385dccd6]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'obTLrtsd'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2405bcf-79aa-4f48-af93-bdaec7fe9171]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c21906-8c7e-47d3-9bee-0ba145acbef0]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:44:46 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:44:46 user nova-compute[73010]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f (non-flash)
Aug 15 00:44:46 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:44:46 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:44:46 user nova-compute[73010]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f (non-flash)
Aug 15 00:44:46 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee22bceb-3642-4e24-b08d-c9b0e1ff00af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb, portal: 172.16.0.220,3260]
Aug 15 00:44:46 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb, portal: 172.16.0.220,3260] successful.
Aug 15 00:44:46 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[265b3193-c4f1-452f-8c6b-875f97ec50b6]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b4b32f-c226-439e-9f4e-4f83fef0f07c]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:44:46 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:44:46 user nova-compute[73010]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f (non-flash)
Aug 15 00:44:46 user nova-compute[73010]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb (non-flash)
Aug 15 00:44:46 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:44:46 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:44:46 user nova-compute[73010]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f (non-flash)
Aug 15 00:44:46 user nova-compute[73010]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb (non-flash)
Aug 15 00:44:46 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[24268adf-db41-42ef-949b-6b693f16ca57]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: None {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] No VIF found with MAC fa:16:3e:61:cc:e9, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3ba0b280-ce20-4dd2-acad-cda67cbed840 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.494s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:44:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:47 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:44:47 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'obTLrtsd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:44:47 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:44:47 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] <== connect_volume: return (1464ms) {'type': 'block', 'scsi_wwn': '23935376234313935', 'path': '/dev/sde'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:44:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935376234313935', 'path': '/dev/sde'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:44:47 user nova-compute[73010]: DEBUG nova.objects.instance [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lazy-loading 'flavor' on Instance uuid 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:44:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:44:47 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:44:47 user nova-compute[73010]:   <source dev="/dev/sde"/>
Aug 15 00:44:47 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:44:47 user nova-compute[73010]:   <serial>fff5cf20-2dc0-4962-b7b3-c8a454545adb</serial>
Aug 15 00:44:47 user nova-compute[73010]: </disk>
Aug 15 00:44:47 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:44:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:44:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:44:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] No VIF found with MAC fa:16:3e:86:b7:e1, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:44:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-32a6243a-afa1-4373-b686-4ac5000c66c2 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.412s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:44:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:44:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:44:48 user nova-compute[73010]: INFO nova.compute.manager [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Detaching volume fff5cf20-2dc0-4962-b7b3-c8a454545adb
Aug 15 00:44:48 user nova-compute[73010]: INFO nova.virt.block_device [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Attempting to driver detach volume fff5cf20-2dc0-4962-b7b3-c8a454545adb from mountpoint /dev/vdb
Aug 15 00:44:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Attempting to detach device vdb from instance 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4 from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:44:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:44:48 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:44:48 user nova-compute[73010]:   <source dev="/dev/sde"/>
Aug 15 00:44:48 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:44:48 user nova-compute[73010]:   <serial>fff5cf20-2dc0-4962-b7b3-c8a454545adb</serial>
Aug 15 00:44:48 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:44:48 user nova-compute[73010]: </disk>
Aug 15 00:44:48 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:44:48 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Successfully detached device vdb from instance 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4 from the persistent domain config.
Aug 15 00:44:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4 from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:44:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:44:48 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:44:48 user nova-compute[73010]:   <source dev="/dev/sde"/>
Aug 15 00:44:48 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:44:48 user nova-compute[73010]:   <serial>fff5cf20-2dc0-4962-b7b3-c8a454545adb</serial>
Aug 15 00:44:48 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:44:48 user nova-compute[73010]: </disk>
Aug 15 00:44:48 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692060289.1602628, 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4 {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:44:49 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Successfully detached device vdb from instance 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4 from the live domain config.
Aug 15 00:44:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'obTLrtsd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:44:49 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:44:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9a0046-877e-4c66-9b16-f2b833ed5332]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d335af2b-04df-4874-9fea-ba237853f7b6]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:44:49 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:44:49 user nova-compute[73010]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f (non-flash)
Aug 15 00:44:49 user nova-compute[73010]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb (non-flash)
Aug 15 00:44:49 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:44:49 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:44:49 user nova-compute[73010]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f (non-flash)
Aug 15 00:44:49 user nova-compute[73010]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb (non-flash)
Aug 15 00:44:49 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec30404ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb'): ({'sde'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Removing single pathed devices sde {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f14700-d54c-4392-8cb0-41cc504ce0b6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1e0feb-8f58-4ee8-8768-5b643cf634bd]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Flushing IO for device /dev/sde {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[47560d5c-df3c-44b7-8001-191b52e063bc]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0051eeba-550c-4ba5-b105-23e461d150da]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] SCSI volumes sde have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d398a2c2-01b1-4de4-80b8-384412aa3015]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbd0939-18e3-4864-bbc6-04bc41ae22b4]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb, portal: 172.16.0.220,3260]
Aug 15 00:44:49 user nova-compute[73010]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb, portal: 172.16.0.220,3260] successful.
Aug 15 00:44:49 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fff5cf20-2dc0-4962-b7b3-c8a454545adb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af2b1ec-b1eb-4788-b107-48bb0790a377]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] <== disconnect_volume: return (318ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4198d878-334c-44bd-9a2d-0491b6aa01c0 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquiring lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4198d878-334c-44bd-9a2d-0491b6aa01c0 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4198d878-334c-44bd-9a2d-0491b6aa01c0 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquiring lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4198d878-334c-44bd-9a2d-0491b6aa01c0 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4198d878-334c-44bd-9a2d-0491b6aa01c0 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:44:49 user nova-compute[73010]: INFO nova.compute.manager [None req-4198d878-334c-44bd-9a2d-0491b6aa01c0 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Terminating instance
Aug 15 00:44:49 user nova-compute[73010]: DEBUG nova.compute.manager [None req-4198d878-334c-44bd-9a2d-0491b6aa01c0 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:44:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG nova.objects.instance [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lazy-loading 'flavor' on Instance uuid 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG nova.compute.manager [req-9d81ec3d-9e3f-479b-b262-843d5846f870 req-30655250-3088-4425-8107-d107f07d8d4b service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received event network-vif-unplugged-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9d81ec3d-9e3f-479b-b262-843d5846f870 req-30655250-3088-4425-8107-d107f07d8d4b service nova] Acquiring lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9d81ec3d-9e3f-479b-b262-843d5846f870 req-30655250-3088-4425-8107-d107f07d8d4b service nova] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9d81ec3d-9e3f-479b-b262-843d5846f870 req-30655250-3088-4425-8107-d107f07d8d4b service nova] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG nova.compute.manager [req-9d81ec3d-9e3f-479b-b262-843d5846f870 req-30655250-3088-4425-8107-d107f07d8d4b service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] No waiting events found dispatching network-vif-unplugged-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG nova.compute.manager [req-9d81ec3d-9e3f-479b-b262-843d5846f870 req-30655250-3088-4425-8107-d107f07d8d4b service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received event network-vif-unplugged-5db62e1b-e013-4958-8470-da256258503d for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-74a0efc1-409e-49fa-a96d-d97fc1b0ac77 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.750s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:44:50 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Instance destroyed successfully.
Aug 15 00:44:50 user nova-compute[73010]: DEBUG nova.objects.instance [None req-4198d878-334c-44bd-9a2d-0491b6aa01c0 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lazy-loading 'resources' on Instance uuid f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-4198d878-334c-44bd-9a2d-0491b6aa01c0 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:37:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-187035777',display_name='tempest-ServerStableDeviceRescueTest-server-187035777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-187035777',id=18,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl48HAmcfFRrH0rUkUHs/8dSGQIF1uCxQEyzMtTaxr3R25Tjk85cbgCHshsmycnRK+vD67hffvzQCcRdwaXrKsXIdJGDiJmiNMcQzgqMkHe9ej/2bb6LdarHKVQSu8gAg==',key_name='tempest-keypair-1148060121',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:41:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aadfec8dd5ed4c8b8c8730c98b2711ff',ramdisk_id='',reservation_id='r-rd3n8zy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1325761686',owner_user_name='tempest-ServerStableDeviceRescueTest-1325761686-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:43:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0256395ac9eb4654932c0fe37dea75c1',uuid=f22d29a4-26d1-4bfd-acf7-80dcdbc4d889,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5db62e1b-e013-4958-8470-da256258503d", "address": "fa:16:3e:71:55:dd", "network": {"id": "22954f6c-78d2-40d7-91fc-1e8eb0881e40", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1057005040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadfec8dd5ed4c8b8c8730c98b2711ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db62e1b-e0", "ovs_interfaceid": "5db62e1b-e013-4958-8470-da256258503d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-4198d878-334c-44bd-9a2d-0491b6aa01c0 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Converting VIF {"id": "5db62e1b-e013-4958-8470-da256258503d", "address": "fa:16:3e:71:55:dd", "network": {"id": "22954f6c-78d2-40d7-91fc-1e8eb0881e40", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1057005040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadfec8dd5ed4c8b8c8730c98b2711ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5db62e1b-e0", "ovs_interfaceid": "5db62e1b-e013-4958-8470-da256258503d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-4198d878-334c-44bd-9a2d-0491b6aa01c0 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:55:dd,bridge_name='br-int',has_traffic_filtering=True,id=5db62e1b-e013-4958-8470-da256258503d,network=Network(22954f6c-78d2-40d7-91fc-1e8eb0881e40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db62e1b-e0') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG os_vif [None req-4198d878-334c-44bd-9a2d-0491b6aa01c0 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:55:dd,bridge_name='br-int',has_traffic_filtering=True,id=5db62e1b-e013-4958-8470-da256258503d,network=Network(22954f6c-78d2-40d7-91fc-1e8eb0881e40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db62e1b-e0') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5db62e1b-e0, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "c844e062-d79e-4c50-a116-4e6a6661e1d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:44:50 user nova-compute[73010]: INFO os_vif [None req-4198d878-334c-44bd-9a2d-0491b6aa01c0 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:55:dd,bridge_name='br-int',has_traffic_filtering=True,id=5db62e1b-e013-4958-8470-da256258503d,network=Network(22954f6c-78d2-40d7-91fc-1e8eb0881e40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5db62e1b-e0')
Aug 15 00:44:50 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-4198d878-334c-44bd-9a2d-0491b6aa01c0 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Deleting instance files /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889_del
Aug 15 00:44:50 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-4198d878-334c-44bd-9a2d-0491b6aa01c0 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Deletion of /opt/stack/data/nova/instances/f22d29a4-26d1-4bfd-acf7-80dcdbc4d889_del complete
Aug 15 00:44:50 user nova-compute[73010]: DEBUG nova.objects.instance [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'flavor' on Instance uuid c844e062-d79e-4c50-a116-4e6a6661e1d6 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:44:50 user nova-compute[73010]: INFO nova.compute.manager [None req-4198d878-334c-44bd-9a2d-0491b6aa01c0 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 15 00:44:50 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-4198d878-334c-44bd-9a2d-0491b6aa01c0 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "c844e062-d79e-4c50-a116-4e6a6661e1d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:44:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:44:50 user nova-compute[73010]: INFO nova.compute.manager [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Attaching volume 2a7657b4-02d5-444f-9957-77ba96ab8e87 to /dev/vdc
Aug 15 00:44:51 user nova-compute[73010]: DEBUG os_brick.utils [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[81005216-ff18-4dd2-897e-ebac057d6f34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c8ed56-383a-468c-a3ea-8db1fbcf00e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[509f0c2f-4b90-4273-90b6-e736f39f16cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0626f99-5f1e-4b51-9823-c3d76d816ed9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:44:51 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[677d4ce7-70ef-46e9-a48d-530a747ac238]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG os_brick.utils [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Updating existing volume attachment record: 11906354-7bbf-41c7-b49d-7f98b1f6d263 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG nova.compute.manager [req-a1f31c4b-339a-4d32-9950-60fa0beef2a0 req-f04d383d-0d4b-4d0b-aed7-83f48f110125 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received event network-vif-deleted-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:44:51 user nova-compute[73010]: INFO nova.compute.manager [req-a1f31c4b-339a-4d32-9950-60fa0beef2a0 req-f04d383d-0d4b-4d0b-aed7-83f48f110125 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Neutron deleted interface 5db62e1b-e013-4958-8470-da256258503d; detaching it from the instance and deleting it from the info cache
Aug 15 00:44:51 user nova-compute[73010]: DEBUG nova.network.neutron [req-a1f31c4b-339a-4d32-9950-60fa0beef2a0 req-f04d383d-0d4b-4d0b-aed7-83f48f110125 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:44:51 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Took 0.96 seconds to deallocate network for instance.
Aug 15 00:44:51 user nova-compute[73010]: DEBUG nova.compute.manager [req-a1f31c4b-339a-4d32-9950-60fa0beef2a0 req-f04d383d-0d4b-4d0b-aed7-83f48f110125 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Detach interface failed, port_id=5db62e1b-e013-4958-8470-da256258503d, reason: Instance f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 could not be found. {{(pid=73010) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4198d878-334c-44bd-9a2d-0491b6aa01c0 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4198d878-334c-44bd-9a2d-0491b6aa01c0 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:52 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-4198d878-334c-44bd-9a2d-0491b6aa01c0 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:44:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:52 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-4198d878-334c-44bd-9a2d-0491b6aa01c0 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:44:52 user nova-compute[73010]: DEBUG nova.compute.manager [req-4c145765-ff5a-4fd4-803c-c7506b70c59e req-dfb7b2c2-3152-4b06-99ef-866d942cd643 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received event network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:44:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4c145765-ff5a-4fd4-803c-c7506b70c59e req-dfb7b2c2-3152-4b06-99ef-866d942cd643 service nova] Acquiring lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:44:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4c145765-ff5a-4fd4-803c-c7506b70c59e req-dfb7b2c2-3152-4b06-99ef-866d942cd643 service nova] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:44:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4c145765-ff5a-4fd4-803c-c7506b70c59e req-dfb7b2c2-3152-4b06-99ef-866d942cd643 service nova] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:44:52 user nova-compute[73010]: DEBUG nova.compute.manager [req-4c145765-ff5a-4fd4-803c-c7506b70c59e req-dfb7b2c2-3152-4b06-99ef-866d942cd643 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] No waiting events found dispatching network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:44:52 user nova-compute[73010]: WARNING nova.compute.manager [req-4c145765-ff5a-4fd4-803c-c7506b70c59e req-dfb7b2c2-3152-4b06-99ef-866d942cd643 service nova] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Received unexpected event network-vif-plugged-5db62e1b-e013-4958-8470-da256258503d for instance with vm_state deleted and task_state None.
Aug 15 00:44:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4198d878-334c-44bd-9a2d-0491b6aa01c0 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.614s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:44:52 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-4198d878-334c-44bd-9a2d-0491b6aa01c0 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Deleted allocations for instance f22d29a4-26d1-4bfd-acf7-80dcdbc4d889
Aug 15 00:44:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:44:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:44:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4198d878-334c-44bd-9a2d-0491b6aa01c0 tempest-ServerStableDeviceRescueTest-1325761686 tempest-ServerStableDeviceRescueTest-1325761686-project-member] Lock "f22d29a4-26d1-4bfd-acf7-80dcdbc4d889" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.781s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:44:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b78b36ca-699c-4cac-a28a-61a6e684022f/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b78b36ca-699c-4cac-a28a-61a6e684022f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b78b36ca-699c-4cac-a28a-61a6e684022f/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b78b36ca-699c-4cac-a28a-61a6e684022f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:54 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Error from libvirt while getting description of instance-00000012: [Error Code 42] Domain not found: no domain with matching uuid 'f22d29a4-26d1-4bfd-acf7-80dcdbc4d889' (instance-00000012): libvirt.libvirtError: Domain not found: no domain with matching uuid 'f22d29a4-26d1-4bfd-acf7-80dcdbc4d889' (instance-00000012)
Aug 15 00:44:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:55 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:44:55 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:44:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=7273MB free_disk=25.551998138427734GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:44:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:44:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:44:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6dfc356b-953a-47b0-9da7-70cc59a80853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:44:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance eec545e8-eeda-443c-9892-980e19e7267a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:44:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4b489f97-c8d4-4a6a-8404-e1a05a990261 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:44:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 98fa0e64-cf36-4991-924d-ba4b713239d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:44:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4b5baaac-bb54-462c-b833-4f37de8f24dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:44:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:44:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance c844e062-d79e-4c50-a116-4e6a6661e1d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:44:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:44:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 009d9050-1720-45de-8bc9-16f404e65911 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:44:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance b78b36ca-699c-4cac-a28a-61a6e684022f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:44:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:44:55 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:44:56 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:44:56 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:44:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:44:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.520s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:44:56 user nova-compute[73010]: INFO nova.compute.manager [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Rescuing
Aug 15 00:44:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "refresh_cache-eec545e8-eeda-443c-9892-980e19e7267a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:44:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquired lock "refresh_cache-eec545e8-eeda-443c-9892-980e19e7267a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:44:56 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:44:57 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Updating instance_info_cache with network_info: [{"id": "65b5e7b6-01af-4239-9386-e7b14c83e766", "address": "fa:16:3e:88:de:ee", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b5e7b6-01", "ovs_interfaceid": "65b5e7b6-01af-4239-9386-e7b14c83e766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:44:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Releasing lock "refresh_cache-eec545e8-eeda-443c-9892-980e19e7267a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:44:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.compute.manager [req-faa5e229-8505-42d4-ba3d-2df31acbe1f6 req-2c91f27c-f043-4b1e-8501-f8dfd6bb4f41 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received event network-vif-unplugged-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-faa5e229-8505-42d4-ba3d-2df31acbe1f6 req-2c91f27c-f043-4b1e-8501-f8dfd6bb4f41 service nova] Acquiring lock "eec545e8-eeda-443c-9892-980e19e7267a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-faa5e229-8505-42d4-ba3d-2df31acbe1f6 req-2c91f27c-f043-4b1e-8501-f8dfd6bb4f41 service nova] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-faa5e229-8505-42d4-ba3d-2df31acbe1f6 req-2c91f27c-f043-4b1e-8501-f8dfd6bb4f41 service nova] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.compute.manager [req-faa5e229-8505-42d4-ba3d-2df31acbe1f6 req-2c91f27c-f043-4b1e-8501-f8dfd6bb4f41 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] No waiting events found dispatching network-vif-unplugged-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:44:58 user nova-compute[73010]: WARNING nova.compute.manager [req-faa5e229-8505-42d4-ba3d-2df31acbe1f6 req-2c91f27c-f043-4b1e-8501-f8dfd6bb4f41 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received unexpected event network-vif-unplugged-65b5e7b6-01af-4239-9386-e7b14c83e766 for instance with vm_state active and task_state rescuing.
Aug 15 00:44:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Instance destroyed successfully.
Aug 15 00:44:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Attempting rescue
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73010) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Instance directory exists: not creating {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 00:44:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Creating image(s)
Aug 15 00:44:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "/opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "/opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "/opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.objects.instance [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'trusted_certs' on Instance uuid eec545e8-eeda-443c-9892-980e19e7267a {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.233s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk.rescue {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk.rescue" returned: 0 in 0.069s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.objects.instance [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'migration_context' on Instance uuid eec545e8-eeda-443c-9892-980e19e7267a {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Start _get_guest_xml network_info=[{"id": "65b5e7b6-01af-4239-9386-e7b14c83e766", "address": "fa:16:3e:88:de:ee", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "vif_mac": "fa:16:3e:88:de:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b5e7b6-01", "ovs_interfaceid": "65b5e7b6-01af-4239-9386-e7b14c83e766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.objects.instance [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'resources' on Instance uuid eec545e8-eeda-443c-9892-980e19e7267a {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.objects.instance [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'numa_topology' on Instance uuid eec545e8-eeda-443c-9892-980e19e7267a {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:44:58 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:44:58 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.objects.instance [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'vcpu_model' on Instance uuid eec545e8-eeda-443c-9892-980e19e7267a {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:40:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1221562093',display_name='tempest-ServerRescueNegativeTestJSON-server-1221562093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1221562093',id=23,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:40:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a564ea15194c4e059746d2fc6e7e1a07',ramdisk_id='',reservation_id='r-dhvz0v5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-203744558',owner_user_name='tempest-ServerRescueNegativeTestJSON-203744558-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:40:18Z,user_data=None,user_id='b85ef05658d64f1fbd78e509e2a606d8',uuid=eec545e8-eeda-443c-9892-980e19e7267a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65b5e7b6-01af-4239-9386-e7b14c83e766", "address": "fa:16:3e:88:de:ee", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "vif_mac": "fa:16:3e:88:de:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b5e7b6-01", "ovs_interfaceid": "65b5e7b6-01af-4239-9386-e7b14c83e766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Converting VIF {"id": "65b5e7b6-01af-4239-9386-e7b14c83e766", "address": "fa:16:3e:88:de:ee", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "vif_mac": "fa:16:3e:88:de:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b5e7b6-01", "ovs_interfaceid": "65b5e7b6-01af-4239-9386-e7b14c83e766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:de:ee,bridge_name='br-int',has_traffic_filtering=True,id=65b5e7b6-01af-4239-9386-e7b14c83e766,network=Network(f4772ea6-9cb0-4ca8-b327-34f8dd08808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65b5e7b6-01') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.objects.instance [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'pci_devices' on Instance uuid eec545e8-eeda-443c-9892-980e19e7267a {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:44:58 user nova-compute[73010]:   <uuid>eec545e8-eeda-443c-9892-980e19e7267a</uuid>
Aug 15 00:44:58 user nova-compute[73010]:   <name>instance-00000017</name>
Aug 15 00:44:58 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:44:58 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:44:58 user nova-compute[73010]:   <metadata>
Aug 15 00:44:58 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:44:58 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:44:58 user nova-compute[73010]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1221562093</nova:name>
Aug 15 00:44:58 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:44:58</nova:creationTime>
Aug 15 00:44:58 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:44:58 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:44:58 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:44:58 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:44:58 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:44:58 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:44:58 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:44:58 user nova-compute[73010]:       <nova:owner>
Aug 15 00:44:58 user nova-compute[73010]:         <nova:user uuid="b85ef05658d64f1fbd78e509e2a606d8">tempest-ServerRescueNegativeTestJSON-203744558-project-member</nova:user>
Aug 15 00:44:58 user nova-compute[73010]:         <nova:project uuid="a564ea15194c4e059746d2fc6e7e1a07">tempest-ServerRescueNegativeTestJSON-203744558</nova:project>
Aug 15 00:44:58 user nova-compute[73010]:       </nova:owner>
Aug 15 00:44:58 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:44:58 user nova-compute[73010]:       <nova:ports>
Aug 15 00:44:58 user nova-compute[73010]:         <nova:port uuid="65b5e7b6-01af-4239-9386-e7b14c83e766">
Aug 15 00:44:58 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 00:44:58 user nova-compute[73010]:         </nova:port>
Aug 15 00:44:58 user nova-compute[73010]:       </nova:ports>
Aug 15 00:44:58 user nova-compute[73010]:     </nova:instance>
Aug 15 00:44:58 user nova-compute[73010]:   </metadata>
Aug 15 00:44:58 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:44:58 user nova-compute[73010]:     <system>
Aug 15 00:44:58 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:44:58 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:44:58 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:44:58 user nova-compute[73010]:       <entry name="serial">eec545e8-eeda-443c-9892-980e19e7267a</entry>
Aug 15 00:44:58 user nova-compute[73010]:       <entry name="uuid">eec545e8-eeda-443c-9892-980e19e7267a</entry>
Aug 15 00:44:58 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:44:58 user nova-compute[73010]:     </system>
Aug 15 00:44:58 user nova-compute[73010]:   </sysinfo>
Aug 15 00:44:58 user nova-compute[73010]:   <os>
Aug 15 00:44:58 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:44:58 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:44:58 user nova-compute[73010]:   </os>
Aug 15 00:44:58 user nova-compute[73010]:   <features>
Aug 15 00:44:58 user nova-compute[73010]:     <acpi/>
Aug 15 00:44:58 user nova-compute[73010]:     <apic/>
Aug 15 00:44:58 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:44:58 user nova-compute[73010]:   </features>
Aug 15 00:44:58 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:44:58 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:44:58 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:44:58 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:44:58 user nova-compute[73010]:   </clock>
Aug 15 00:44:58 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:44:58 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:44:58 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:44:58 user nova-compute[73010]:   </cpu>
Aug 15 00:44:58 user nova-compute[73010]:   <devices>
Aug 15 00:44:58 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:44:58 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:44:58 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk.rescue"/>
Aug 15 00:44:58 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:44:58 user nova-compute[73010]:     </disk>
Aug 15 00:44:58 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:44:58 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:44:58 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk"/>
Aug 15 00:44:58 user nova-compute[73010]:       <target dev="vdb" bus="virtio"/>
Aug 15 00:44:58 user nova-compute[73010]:     </disk>
Aug 15 00:44:58 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:44:58 user nova-compute[73010]:       <mac address="fa:16:3e:88:de:ee"/>
Aug 15 00:44:58 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:44:58 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:44:58 user nova-compute[73010]:       <target dev="tap65b5e7b6-01"/>
Aug 15 00:44:58 user nova-compute[73010]:     </interface>
Aug 15 00:44:58 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:44:58 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/console.log" append="off"/>
Aug 15 00:44:58 user nova-compute[73010]:     </serial>
Aug 15 00:44:58 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:44:58 user nova-compute[73010]:     <video>
Aug 15 00:44:58 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:44:58 user nova-compute[73010]:     </video>
Aug 15 00:44:58 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:44:58 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:44:58 user nova-compute[73010]:     </rng>
Aug 15 00:44:58 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:44:58 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:44:58 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:44:58 user nova-compute[73010]:     </memballoon>
Aug 15 00:44:58 user nova-compute[73010]:   </devices>
Aug 15 00:44:58 user nova-compute[73010]: </domain>
Aug 15 00:44:58 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:44:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Instance destroyed successfully.
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:44:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] No VIF found with MAC fa:16:3e:88:de:ee, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG nova.compute.manager [req-a436127e-171e-428d-beec-bfc5072f05c7 req-324f5064-8be8-4bf9-85e3-a175900efe87 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received event network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a436127e-171e-428d-beec-bfc5072f05c7 req-324f5064-8be8-4bf9-85e3-a175900efe87 service nova] Acquiring lock "eec545e8-eeda-443c-9892-980e19e7267a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a436127e-171e-428d-beec-bfc5072f05c7 req-324f5064-8be8-4bf9-85e3-a175900efe87 service nova] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a436127e-171e-428d-beec-bfc5072f05c7 req-324f5064-8be8-4bf9-85e3-a175900efe87 service nova] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG nova.compute.manager [req-a436127e-171e-428d-beec-bfc5072f05c7 req-324f5064-8be8-4bf9-85e3-a175900efe87 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] No waiting events found dispatching network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:45:00 user nova-compute[73010]: WARNING nova.compute.manager [req-a436127e-171e-428d-beec-bfc5072f05c7 req-324f5064-8be8-4bf9-85e3-a175900efe87 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received unexpected event network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 for instance with vm_state active and task_state rescuing.
Aug 15 00:45:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Updating instance_info_cache with network_info: [{"id": "96dadd50-12c8-430b-82ab-f113031f02d8", "address": "fa:16:3e:d4:06:17", "network": {"id": "935a0b3b-6f36-45b2-a8d0-4d4541cce103", "bridge": "br-int", "label": "tempest-TestShelveInstance-1947454102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c735a6d80a64492baf3346d0c96a872b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dadd50-12", "ovs_interfaceid": "96dadd50-12c8-430b-82ab-f113031f02d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "98fa0e64-cf36-4991-924d-ba4b713239d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG nova.objects.instance [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lazy-loading 'flavor' on Instance uuid 98fa0e64-cf36-4991-924d-ba4b713239d0 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "98fa0e64-cf36-4991-924d-ba4b713239d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:01 user nova-compute[73010]: INFO nova.compute.manager [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Attaching volume 063dbde5-38a1-4c62-b04d-d5d9e08c8b81 to /dev/vdb
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.utils [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5d237f-fa62-45b0-9f87-abac93cefc31]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[30458844-667c-433e-9a0f-898ec366f872]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c1cd07-1626-41f3-a2fd-5722d5c9a1c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5545d1ed-38bc-43fe-91a5-6314b744b9d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:45:01 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c127dddc-a8ef-4e07-8dae-7cf7172d61ad]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.utils [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Updating existing volume attachment record: fde688c2-41f2-488b-8fc5-ed2456586529 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ceBdPKJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:45:01 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:45:01 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:45:01 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfba2f9-8aa4-4f0d-b262-e94462ff0aa0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:45:01 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e55bb39-6cbf-4aa0-9b0a-d45b56149366]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87] added
Aug 15 00:45:01 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df763d4-07bd-4b58-8157-c47d7ec40b05]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe39778-3288-463f-880b-e2c90cd3c03a]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ceBdPKJH {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ceBdPKJH" returned: 0 in 0.029s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[366d026e-a63f-44e9-a22d-d083c5302865]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ceBdPKJH'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b18f66-bfcc-4da9-9bc5-be0786b8adb7]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d3a510-6908-4610-a0e6-9c26f8c547b9]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:45:01 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:45:01 user nova-compute[73010]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f (non-flash)
Aug 15 00:45:01 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:45:01 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:45:01 user nova-compute[73010]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f (non-flash)
Aug 15 00:45:01 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef295136-6fa3-4af3-b0c3-19ae664fab44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87, portal: 172.16.0.220,3260]
Aug 15 00:45:01 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87, portal: 172.16.0.220,3260] successful.
Aug 15 00:45:01 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2701fd-370a-4759-89ef-dcdcadeb6bac]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e379348f-633f-4729-88d2-4116895b0a65]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:45:01 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:45:01 user nova-compute[73010]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f (non-flash)
Aug 15 00:45:01 user nova-compute[73010]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 (non-flash)
Aug 15 00:45:01 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:45:01 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:45:01 user nova-compute[73010]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f (non-flash)
Aug 15 00:45:01 user nova-compute[73010]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 (non-flash)
Aug 15 00:45:01 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9e8437-1b87-46df-b561-7b9b109664e1]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:01 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: None {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:45:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-7931af23-5de8-4ea9-a0c7-2571cf9e601d req-d5199463-aa4e-4975-8fb5-7e7d7ca8916e service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received event network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:45:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7931af23-5de8-4ea9-a0c7-2571cf9e601d req-d5199463-aa4e-4975-8fb5-7e7d7ca8916e service nova] Acquiring lock "eec545e8-eeda-443c-9892-980e19e7267a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7931af23-5de8-4ea9-a0c7-2571cf9e601d req-d5199463-aa4e-4975-8fb5-7e7d7ca8916e service nova] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7931af23-5de8-4ea9-a0c7-2571cf9e601d req-d5199463-aa4e-4975-8fb5-7e7d7ca8916e service nova] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-7931af23-5de8-4ea9-a0c7-2571cf9e601d req-d5199463-aa4e-4975-8fb5-7e7d7ca8916e service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] No waiting events found dispatching network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:45:02 user nova-compute[73010]: WARNING nova.compute.manager [req-7931af23-5de8-4ea9-a0c7-2571cf9e601d req-d5199463-aa4e-4975-8fb5-7e7d7ca8916e service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received unexpected event network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 for instance with vm_state active and task_state rescuing.
Aug 15 00:45:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-7931af23-5de8-4ea9-a0c7-2571cf9e601d req-d5199463-aa4e-4975-8fb5-7e7d7ca8916e service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received event network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:45:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7931af23-5de8-4ea9-a0c7-2571cf9e601d req-d5199463-aa4e-4975-8fb5-7e7d7ca8916e service nova] Acquiring lock "eec545e8-eeda-443c-9892-980e19e7267a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7931af23-5de8-4ea9-a0c7-2571cf9e601d req-d5199463-aa4e-4975-8fb5-7e7d7ca8916e service nova] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7931af23-5de8-4ea9-a0c7-2571cf9e601d req-d5199463-aa4e-4975-8fb5-7e7d7ca8916e service nova] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-7931af23-5de8-4ea9-a0c7-2571cf9e601d req-d5199463-aa4e-4975-8fb5-7e7d7ca8916e service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] No waiting events found dispatching network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:45:02 user nova-compute[73010]: WARNING nova.compute.manager [req-7931af23-5de8-4ea9-a0c7-2571cf9e601d req-d5199463-aa4e-4975-8fb5-7e7d7ca8916e service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received unexpected event network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 for instance with vm_state active and task_state rescuing.
Aug 15 00:45:02 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:45:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Removed pending event for eec545e8-eeda-443c-9892-980e19e7267a due to event {{(pid=73010) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 00:45:02 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060302.7597039, eec545e8-eeda-443c-9892-980e19e7267a => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:45:02 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] VM Resumed (Lifecycle Event)
Aug 15 00:45:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c85768cd-46eb-4c35-893b-c2ec1e5a4506 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:45:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:45:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:45:02 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 00:45:02 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060302.7614508, eec545e8-eeda-443c-9892-980e19e7267a => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:45:02 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] VM Started (Lifecycle Event)
Aug 15 00:45:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:45:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:45:02 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:45:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ceBdPKJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:45:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:45:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26532363030346261', 'path': '/dev/sde'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:45:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532363030346261', 'path': '/dev/sde'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:45:02 user nova-compute[73010]: DEBUG nova.objects.instance [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'flavor' on Instance uuid c844e062-d79e-4c50-a116-4e6a6661e1d6 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:45:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:45:02 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:45:02 user nova-compute[73010]:   <source dev="/dev/sde"/>
Aug 15 00:45:02 user nova-compute[73010]:   <target dev="vdc" bus="virtio"/>
Aug 15 00:45:02 user nova-compute[73010]:   <serial>2a7657b4-02d5-444f-9957-77ba96ab8e87</serial>
Aug 15 00:45:02 user nova-compute[73010]: </disk>
Aug 15 00:45:02 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:45:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:45:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:45:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:45:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] No VIF found with MAC fa:16:3e:61:cc:e9, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:45:03 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:45:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-99ceaad0-85ab-4545-b97e-9485b1efd975 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.659s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "c844e062-d79e-4c50-a116-4e6a6661e1d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:04 user nova-compute[73010]: INFO nova.compute.manager [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Detaching volume 66a4c5a7-26fe-4c22-8c65-727b08364b9f
Aug 15 00:45:04 user nova-compute[73010]: INFO nova.virt.block_device [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Attempting to driver detach volume 66a4c5a7-26fe-4c22-8c65-727b08364b9f from mountpoint /dev/vdb
Aug 15 00:45:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Attempting to detach device vdb from instance c844e062-d79e-4c50-a116-4e6a6661e1d6 from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:45:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:45:04 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:45:04 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:45:04 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:45:04 user nova-compute[73010]:   <serial>66a4c5a7-26fe-4c22-8c65-727b08364b9f</serial>
Aug 15 00:45:04 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:45:04 user nova-compute[73010]: </disk>
Aug 15 00:45:04 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:45:04 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Successfully detached device vdb from instance c844e062-d79e-4c50-a116-4e6a6661e1d6 from the persistent domain config.
Aug 15 00:45:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c844e062-d79e-4c50-a116-4e6a6661e1d6 from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:45:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:45:04 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:45:04 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:45:04 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:45:04 user nova-compute[73010]:   <serial>66a4c5a7-26fe-4c22-8c65-727b08364b9f</serial>
Aug 15 00:45:04 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:45:04 user nova-compute[73010]: </disk>
Aug 15 00:45:04 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692060305.192332, c844e062-d79e-4c50-a116-4e6a6661e1d6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c844e062-d79e-4c50-a116-4e6a6661e1d6 {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:45:05 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Successfully detached device vdb from instance c844e062-d79e-4c50-a116-4e6a6661e1d6 from the live domain config.
Aug 15 00:45:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WHTGjzbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:45:05 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:45:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13fead1-0476-4948-bd3b-762a7a2c64ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6474fc7-1452-4db4-8b02-f092cc66df79]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:45:05 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:45:05 user nova-compute[73010]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f (non-flash)
Aug 15 00:45:05 user nova-compute[73010]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 (non-flash)
Aug 15 00:45:05 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:45:05 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:45:05 user nova-compute[73010]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f (non-flash)
Aug 15 00:45:05 user nova-compute[73010]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 (non-flash)
Aug 15 00:45:05 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec50456e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f'): ({'sdb'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Removing single pathed devices sdb {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13aebc0-ed99-47e2-b965-838af0879dc6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f552298-3545-4564-85d6-825575cf02a2]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Flushing IO for device /dev/sdb {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8ee556-e885-40f7-b7d1-36b7a47ba793]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[02910b16-95df-4cf2-ad93-32660d8521d9]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[adad6711-5ee7-4968-9c1b-e88655985915]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de99950-e68e-4831-9fb8-fa193d876a47]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f, portal: 172.16.0.220,3260]
Aug 15 00:45:05 user nova-compute[73010]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f, portal: 172.16.0.220,3260] successful.
Aug 15 00:45:05 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a4c5a7-26fe-4c22-8c65-727b08364b9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8159690-bb92-4ee3-8b58-c9040aa48b32]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] <== disconnect_volume: return (366ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060290.6852453, f22d29a4-26d1-4bfd-acf7-80dcdbc4d889 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:45:05 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] VM Stopped (Lifecycle Event)
Aug 15 00:45:05 user nova-compute[73010]: DEBUG nova.compute.manager [None req-17084a6f-b159-4229-a898-b63dbd8f0062 None None] [instance: f22d29a4-26d1-4bfd-acf7-80dcdbc4d889] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:45:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:06 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:45:06 user nova-compute[73010]: DEBUG nova.objects.instance [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'flavor' on Instance uuid c844e062-d79e-4c50-a116-4e6a6661e1d6 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:45:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ac30c509-a9f5-4606-a694-7af45e654ba8 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.104s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "c844e062-d79e-4c50-a116-4e6a6661e1d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:07 user nova-compute[73010]: INFO nova.compute.manager [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Detaching volume 2a7657b4-02d5-444f-9957-77ba96ab8e87
Aug 15 00:45:07 user nova-compute[73010]: INFO nova.virt.block_device [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Attempting to driver detach volume 2a7657b4-02d5-444f-9957-77ba96ab8e87 from mountpoint /dev/vdc
Aug 15 00:45:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Attempting to detach device vdc from instance c844e062-d79e-4c50-a116-4e6a6661e1d6 from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:45:07 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:45:07 user nova-compute[73010]:   <source dev="/dev/sde"/>
Aug 15 00:45:07 user nova-compute[73010]:   <target dev="vdc" bus="virtio"/>
Aug 15 00:45:07 user nova-compute[73010]:   <serial>2a7657b4-02d5-444f-9957-77ba96ab8e87</serial>
Aug 15 00:45:07 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 00:45:07 user nova-compute[73010]: </disk>
Aug 15 00:45:07 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:45:07 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Successfully detached device vdc from instance c844e062-d79e-4c50-a116-4e6a6661e1d6 from the persistent domain config.
Aug 15 00:45:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c844e062-d79e-4c50-a116-4e6a6661e1d6 from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:45:07 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:45:07 user nova-compute[73010]:   <source dev="/dev/sde"/>
Aug 15 00:45:07 user nova-compute[73010]:   <target dev="vdc" bus="virtio"/>
Aug 15 00:45:07 user nova-compute[73010]:   <serial>2a7657b4-02d5-444f-9957-77ba96ab8e87</serial>
Aug 15 00:45:07 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 00:45:07 user nova-compute[73010]: </disk>
Aug 15 00:45:07 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692060307.7504492, c844e062-d79e-4c50-a116-4e6a6661e1d6 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c844e062-d79e-4c50-a116-4e6a6661e1d6 {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:45:07 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Successfully detached device vdc from instance c844e062-d79e-4c50-a116-4e6a6661e1d6 from the live domain config.
Aug 15 00:45:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ceBdPKJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:45:07 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:45:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2b1c50-2ec3-46ad-81c0-6202ffb4dcf3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e0355e-f04f-40a9-aba9-abca4b2f0ef5]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:45:07 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:45:07 user nova-compute[73010]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 (non-flash)
Aug 15 00:45:07 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:45:07 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:45:07 user nova-compute[73010]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 (non-flash)
Aug 15 00:45:07 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec305a8b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87'): ({'sde'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Removing single pathed devices sde {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f00a7e4-7d1e-4386-82aa-0c43c687838c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f877b2a-3554-4504-8edb-cdc62a913cd9]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Flushing IO for device /dev/sde {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[229d3ae2-f922-4cd4-afc4-bef39c07cdc9]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.061s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6223ac-b514-47e1-8179-025fb444e58f]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:45:07 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] SCSI volumes sde have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:45:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:45:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e45f1c8-4398-4f50-8495-7522b40b5b49]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04ed487-6036-4325-b468-be820be7c24b]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87, portal: 172.16.0.220,3260]
Aug 15 00:45:08 user nova-compute[73010]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87, portal: 172.16.0.220,3260] successful.
Aug 15 00:45:08 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7657b4-02d5-444f-9957-77ba96ab8e87 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5be196c-e2b4-4c62-b60d-c1a443a7c14c]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:45:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] <== disconnect_volume: return (368ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:45:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:45:09 user nova-compute[73010]: DEBUG nova.objects.instance [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'flavor' on Instance uuid c844e062-d79e-4c50-a116-4e6a6661e1d6 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:45:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-353b44fe-6366-447a-be4e-f2f41125ed13 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.931s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fed80154-11db-4b7f-ac11-fc85a68a16d9 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "c844e062-d79e-4c50-a116-4e6a6661e1d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fed80154-11db-4b7f-ac11-fc85a68a16d9 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fed80154-11db-4b7f-ac11-fc85a68a16d9 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "c844e062-d79e-4c50-a116-4e6a6661e1d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fed80154-11db-4b7f-ac11-fc85a68a16d9 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fed80154-11db-4b7f-ac11-fc85a68a16d9 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:10 user nova-compute[73010]: INFO nova.compute.manager [None req-fed80154-11db-4b7f-ac11-fc85a68a16d9 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Terminating instance
Aug 15 00:45:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-fed80154-11db-4b7f-ac11-fc85a68a16d9 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:45:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:10 user nova-compute[73010]: DEBUG nova.compute.manager [req-eb694f29-1539-4dc7-90de-45e04e38649a req-278d4f5c-582a-4427-9c1a-b107379e2bc3 service nova] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Received event network-vif-unplugged-fa402f22-9164-478b-816a-1b63709fbe59 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:45:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-eb694f29-1539-4dc7-90de-45e04e38649a req-278d4f5c-582a-4427-9c1a-b107379e2bc3 service nova] Acquiring lock "c844e062-d79e-4c50-a116-4e6a6661e1d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-eb694f29-1539-4dc7-90de-45e04e38649a req-278d4f5c-582a-4427-9c1a-b107379e2bc3 service nova] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-eb694f29-1539-4dc7-90de-45e04e38649a req-278d4f5c-582a-4427-9c1a-b107379e2bc3 service nova] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:10 user nova-compute[73010]: DEBUG nova.compute.manager [req-eb694f29-1539-4dc7-90de-45e04e38649a req-278d4f5c-582a-4427-9c1a-b107379e2bc3 service nova] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] No waiting events found dispatching network-vif-unplugged-fa402f22-9164-478b-816a-1b63709fbe59 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:45:10 user nova-compute[73010]: DEBUG nova.compute.manager [req-eb694f29-1539-4dc7-90de-45e04e38649a req-278d4f5c-582a-4427-9c1a-b107379e2bc3 service nova] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Received event network-vif-unplugged-fa402f22-9164-478b-816a-1b63709fbe59 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:45:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:11 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Instance destroyed successfully.
Aug 15 00:45:11 user nova-compute[73010]: DEBUG nova.objects.instance [None req-fed80154-11db-4b7f-ac11-fc85a68a16d9 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lazy-loading 'resources' on Instance uuid c844e062-d79e-4c50-a116-4e6a6661e1d6 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:45:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-fed80154-11db-4b7f-ac11-fc85a68a16d9 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:42:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1214047890',display_name='tempest-AttachVolumeTestJSON-server-1214047890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1214047890',id=29,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLn4vMbR6w+hxE9VRvl3MqN3qRkIWnNg45D49WR2R5zEzcLfvAY0/rjZEh2U1Nd/ptkUVCA9uuyDO7xJUqtSDozWClMO4kBFgFesbi3byRnBamR4dc4JKesil0kATJDKw==',key_name='tempest-keypair-1941125271',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:42:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e50aaf528c8c4d4ba8d39b3b203b5a52',ramdisk_id='',reservation_id='r-970uy0r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-338922600',owner_user_name='tempest-AttachVolumeTestJSON-338922600-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:42:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53c8150819854d29b1d8c865da2642ca',uuid=c844e062-d79e-4c50-a116-4e6a6661e1d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa402f22-9164-478b-816a-1b63709fbe59", "address": "fa:16:3e:61:cc:e9", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa402f22-91", "ovs_interfaceid": "fa402f22-9164-478b-816a-1b63709fbe59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:45:11 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-fed80154-11db-4b7f-ac11-fc85a68a16d9 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Converting VIF {"id": "fa402f22-9164-478b-816a-1b63709fbe59", "address": "fa:16:3e:61:cc:e9", "network": {"id": "03e4c61d-0ae0-4d41-ab30-c95ea427184f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1481913041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50aaf528c8c4d4ba8d39b3b203b5a52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa402f22-91", "ovs_interfaceid": "fa402f22-9164-478b-816a-1b63709fbe59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:45:11 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-fed80154-11db-4b7f-ac11-fc85a68a16d9 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:cc:e9,bridge_name='br-int',has_traffic_filtering=True,id=fa402f22-9164-478b-816a-1b63709fbe59,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa402f22-91') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:45:11 user nova-compute[73010]: DEBUG os_vif [None req-fed80154-11db-4b7f-ac11-fc85a68a16d9 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:cc:e9,bridge_name='br-int',has_traffic_filtering=True,id=fa402f22-9164-478b-816a-1b63709fbe59,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa402f22-91') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:45:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa402f22-91, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:45:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:45:11 user nova-compute[73010]: INFO os_vif [None req-fed80154-11db-4b7f-ac11-fc85a68a16d9 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:cc:e9,bridge_name='br-int',has_traffic_filtering=True,id=fa402f22-9164-478b-816a-1b63709fbe59,network=Network(03e4c61d-0ae0-4d41-ab30-c95ea427184f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa402f22-91')
Aug 15 00:45:11 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-fed80154-11db-4b7f-ac11-fc85a68a16d9 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Deleting instance files /opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6_del
Aug 15 00:45:11 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-fed80154-11db-4b7f-ac11-fc85a68a16d9 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Deletion of /opt/stack/data/nova/instances/c844e062-d79e-4c50-a116-4e6a6661e1d6_del complete
Aug 15 00:45:11 user nova-compute[73010]: INFO nova.compute.manager [None req-fed80154-11db-4b7f-ac11-fc85a68a16d9 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 15 00:45:11 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-fed80154-11db-4b7f-ac11-fc85a68a16d9 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:45:11 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:45:11 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aAOPwvql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:45:12 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:45:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:45:12 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:45:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:45:12 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dcd3c4-4061-468c-bb6c-d9b975f67547]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:45:12 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75358b5-746e-4e6e-ba39-5d42834aedb8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81] added
Aug 15 00:45:12 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[db05fe6b-6037-4393-ba36-06bf1a827c97]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9600372-f2cb-4f62-aa9e-d24add1e4b87]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aAOPwvql {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aAOPwvql" returned: 0 in 0.032s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef01f59c-8fc5-4469-9bb5-355641b0a4dd]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aAOPwvql'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.048s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe1559b-7fe4-423e-86ee-5e6032bedb2a]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d0a1e0-03e7-4b1e-8bdc-133683cab8f3]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:45:12 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:45:12 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:45:12 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:45:12 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[692a1f77-3806-4d0b-aac1-3d9f9e00688c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81, portal: 172.16.0.220,3260]
Aug 15 00:45:12 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81, portal: 172.16.0.220,3260] successful.
Aug 15 00:45:12 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f613c0-477a-4c6c-be2e-297b23f683f9]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7cef6c-85d4-4df0-a3d9-0a05fdf76a63]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:45:12 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:45:12 user nova-compute[73010]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 (non-flash)
Aug 15 00:45:12 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:45:12 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:45:12 user nova-compute[73010]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 (non-flash)
Aug 15 00:45:12 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[968b315d-0f72-45be-ac32-e4067b481d70]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aAOPwvql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:45:12 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Took 1.35 seconds to deallocate network for instance.
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fed80154-11db-4b7f-ac11-fc85a68a16d9 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fed80154-11db-4b7f-ac11-fc85a68a16d9 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-eef1812c-4909-4db9-973e-dacea8dafc08 req-3d12afe2-a76f-4073-8e72-ba68f39eee90 service nova] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Received event network-vif-plugged-fa402f22-9164-478b-816a-1b63709fbe59 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-eef1812c-4909-4db9-973e-dacea8dafc08 req-3d12afe2-a76f-4073-8e72-ba68f39eee90 service nova] Acquiring lock "c844e062-d79e-4c50-a116-4e6a6661e1d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-eef1812c-4909-4db9-973e-dacea8dafc08 req-3d12afe2-a76f-4073-8e72-ba68f39eee90 service nova] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-eef1812c-4909-4db9-973e-dacea8dafc08 req-3d12afe2-a76f-4073-8e72-ba68f39eee90 service nova] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-eef1812c-4909-4db9-973e-dacea8dafc08 req-3d12afe2-a76f-4073-8e72-ba68f39eee90 service nova] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] No waiting events found dispatching network-vif-plugged-fa402f22-9164-478b-816a-1b63709fbe59 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:45:12 user nova-compute[73010]: WARNING nova.compute.manager [req-eef1812c-4909-4db9-973e-dacea8dafc08 req-3d12afe2-a76f-4073-8e72-ba68f39eee90 service nova] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Received unexpected event network-vif-plugged-fa402f22-9164-478b-816a-1b63709fbe59 for instance with vm_state deleted and task_state None.
Aug 15 00:45:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-eef1812c-4909-4db9-973e-dacea8dafc08 req-3d12afe2-a76f-4073-8e72-ba68f39eee90 service nova] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Received event network-vif-deleted-fa402f22-9164-478b-816a-1b63709fbe59 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-fed80154-11db-4b7f-ac11-fc85a68a16d9 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:45:12 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-fed80154-11db-4b7f-ac11-fc85a68a16d9 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:45:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fed80154-11db-4b7f-ac11-fc85a68a16d9 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:13 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-fed80154-11db-4b7f-ac11-fc85a68a16d9 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Deleted allocations for instance c844e062-d79e-4c50-a116-4e6a6661e1d6
Aug 15 00:45:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fed80154-11db-4b7f-ac11-fc85a68a16d9 tempest-AttachVolumeTestJSON-338922600 tempest-AttachVolumeTestJSON-338922600-project-member] Lock "c844e062-d79e-4c50-a116-4e6a6661e1d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.781s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.435s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:45:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] <== connect_volume: return (1436ms) {'type': 'block', 'scsi_wwn': '23432306564343634', 'path': '/dev/sdb'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:45:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432306564343634', 'path': '/dev/sdb'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:45:13 user nova-compute[73010]: DEBUG nova.objects.instance [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lazy-loading 'flavor' on Instance uuid 98fa0e64-cf36-4991-924d-ba4b713239d0 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:45:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:45:13 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:45:13 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:45:13 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:45:13 user nova-compute[73010]:   <serial>063dbde5-38a1-4c62-b04d-d5d9e08c8b81</serial>
Aug 15 00:45:13 user nova-compute[73010]: </disk>
Aug 15 00:45:13 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:45:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:45:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:45:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] No VIF found with MAC fa:16:3e:1d:6a:3d, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:45:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e14b51ce-1013-4e15-9a7b-76e5f85e11c6 tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.956s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "98fa0e64-cf36-4991-924d-ba4b713239d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:15 user nova-compute[73010]: INFO nova.compute.manager [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Detaching volume 063dbde5-38a1-4c62-b04d-d5d9e08c8b81
Aug 15 00:45:15 user nova-compute[73010]: INFO nova.virt.block_device [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Attempting to driver detach volume 063dbde5-38a1-4c62-b04d-d5d9e08c8b81 from mountpoint /dev/vdb
Aug 15 00:45:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Attempting to detach device vdb from instance 98fa0e64-cf36-4991-924d-ba4b713239d0 from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:45:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:45:15 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:45:15 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:45:15 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:45:15 user nova-compute[73010]:   <serial>063dbde5-38a1-4c62-b04d-d5d9e08c8b81</serial>
Aug 15 00:45:15 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:45:15 user nova-compute[73010]: </disk>
Aug 15 00:45:15 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:45:15 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Successfully detached device vdb from instance 98fa0e64-cf36-4991-924d-ba4b713239d0 from the persistent domain config.
Aug 15 00:45:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 98fa0e64-cf36-4991-924d-ba4b713239d0 from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:45:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:45:15 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:45:15 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:45:15 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:45:15 user nova-compute[73010]:   <serial>063dbde5-38a1-4c62-b04d-d5d9e08c8b81</serial>
Aug 15 00:45:15 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:45:15 user nova-compute[73010]: </disk>
Aug 15 00:45:15 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692060316.4400766, 98fa0e64-cf36-4991-924d-ba4b713239d0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 98fa0e64-cf36-4991-924d-ba4b713239d0 {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:45:16 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Successfully detached device vdb from instance 98fa0e64-cf36-4991-924d-ba4b713239d0 from the live domain config.
Aug 15 00:45:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aAOPwvql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:45:16 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:45:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadae1d4-8cc1-4216-9fcd-7b1ff94e3897]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[193b6d0b-9a32-40b6-961a-4b9a18bc7774]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:45:16 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:45:16 user nova-compute[73010]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 (non-flash)
Aug 15 00:45:16 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:45:16 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:45:16 user nova-compute[73010]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 (non-flash)
Aug 15 00:45:16 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec30607f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81'): ({'sdb'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Removing single pathed devices sdb {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c61a2e-76a8-4048-9e5e-8c9b5be81079]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fea3a56-5332-4741-b739-a94a7ba02260]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Flushing IO for device /dev/sdb {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b4b2cf-d51d-496a-a264-8f9014ef30a4]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a656939-d61c-46f3-be67-4e28fe4a0c18]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b774eb-2d8b-4a22-9168-47a7483baa1a]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac444424-8829-427f-9da5-930a580fec30]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81, portal: 172.16.0.220,3260]
Aug 15 00:45:16 user nova-compute[73010]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81, portal: 172.16.0.220,3260] successful.
Aug 15 00:45:16 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:063dbde5-38a1-4c62-b04d-d5d9e08c8b81 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a177782-cacc-4321-a9ba-3ad62d2391e8]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] <== disconnect_volume: return (290ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:45:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:45:17 user nova-compute[73010]: DEBUG nova.objects.instance [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lazy-loading 'flavor' on Instance uuid 98fa0e64-cf36-4991-924d-ba4b713239d0 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:45:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-16aa86c3-9cbb-4569-a5e7-e7897aa6c0df tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.700s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:26 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060311.16208, c844e062-d79e-4c50-a116-4e6a6661e1d6 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:45:26 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] VM Stopped (Lifecycle Event)
Aug 15 00:45:26 user nova-compute[73010]: DEBUG nova.compute.manager [None req-7be0cead-d2f4-4c49-a2a5-8599393fcdd4 None None] [instance: c844e062-d79e-4c50-a116-4e6a6661e1d6] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:45:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:26 user nova-compute[73010]: DEBUG nova.compute.manager [req-a9ccfbfb-10b6-4be8-a9e2-3a86c6fbcead req-0411f853-4c9f-4cb7-b9b1-d5836d2724cf service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Received event network-changed-96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:45:26 user nova-compute[73010]: DEBUG nova.compute.manager [req-a9ccfbfb-10b6-4be8-a9e2-3a86c6fbcead req-0411f853-4c9f-4cb7-b9b1-d5836d2724cf service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Refreshing instance network info cache due to event network-changed-96dadd50-12c8-430b-82ab-f113031f02d8. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:45:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a9ccfbfb-10b6-4be8-a9e2-3a86c6fbcead req-0411f853-4c9f-4cb7-b9b1-d5836d2724cf service nova] Acquiring lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:45:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a9ccfbfb-10b6-4be8-a9e2-3a86c6fbcead req-0411f853-4c9f-4cb7-b9b1-d5836d2724cf service nova] Acquired lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:45:26 user nova-compute[73010]: DEBUG nova.network.neutron [req-a9ccfbfb-10b6-4be8-a9e2-3a86c6fbcead req-0411f853-4c9f-4cb7-b9b1-d5836d2724cf service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Refreshing network info cache for port 96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:45:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Acquiring lock "009d9050-1720-45de-8bc9-16f404e65911" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "009d9050-1720-45de-8bc9-16f404e65911" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Acquiring lock "009d9050-1720-45de-8bc9-16f404e65911-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "009d9050-1720-45de-8bc9-16f404e65911-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "009d9050-1720-45de-8bc9-16f404e65911-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:26 user nova-compute[73010]: INFO nova.compute.manager [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Terminating instance
Aug 15 00:45:26 user nova-compute[73010]: DEBUG nova.compute.manager [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:45:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG nova.network.neutron [req-a9ccfbfb-10b6-4be8-a9e2-3a86c6fbcead req-0411f853-4c9f-4cb7-b9b1-d5836d2724cf service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Updated VIF entry in instance network info cache for port 96dadd50-12c8-430b-82ab-f113031f02d8. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG nova.network.neutron [req-a9ccfbfb-10b6-4be8-a9e2-3a86c6fbcead req-0411f853-4c9f-4cb7-b9b1-d5836d2724cf service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Updating instance_info_cache with network_info: [{"id": "96dadd50-12c8-430b-82ab-f113031f02d8", "address": "fa:16:3e:d4:06:17", "network": {"id": "935a0b3b-6f36-45b2-a8d0-4d4541cce103", "bridge": "br-int", "label": "tempest-TestShelveInstance-1947454102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c735a6d80a64492baf3346d0c96a872b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dadd50-12", "ovs_interfaceid": "96dadd50-12c8-430b-82ab-f113031f02d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a9ccfbfb-10b6-4be8-a9e2-3a86c6fbcead req-0411f853-4c9f-4cb7-b9b1-d5836d2724cf service nova] Releasing lock "refresh_cache-009d9050-1720-45de-8bc9-16f404e65911" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:45:27 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Instance destroyed successfully.
Aug 15 00:45:27 user nova-compute[73010]: DEBUG nova.objects.instance [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lazy-loading 'resources' on Instance uuid 009d9050-1720-45de-8bc9-16f404e65911 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T00:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1795734941',display_name='tempest-TestShelveInstance-server-1795734941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1795734941',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcvum5u9XWkffPgr3kUCPUYgZKMK4EupdMldEf//XaPrSY8IDVMu6jeGwbDvE83LEBISDSMbAk9hvyN1POk9rP39devk3OdD2ie6iQLoFJW3VpXHZj4RZst+OeJaRlMbw==',key_name='tempest-TestShelveInstance-1964489724',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:43:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c735a6d80a64492baf3346d0c96a872b',ramdisk_id='',reservation_id='r-ganojssg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1217563266',owner_user_name='tempest-TestShelveInstance-1217563266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:43:55Z,user_data=None,user_id='9c8c404d2a364ce6be183c14da241836',uuid=009d9050-1720-45de-8bc9-16f404e65911,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96dadd50-12c8-430b-82ab-f113031f02d8", "address": "fa:16:3e:d4:06:17", "network": {"id": "935a0b3b-6f36-45b2-a8d0-4d4541cce103", "bridge": "br-int", "label": "tempest-TestShelveInstance-1947454102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c735a6d80a64492baf3346d0c96a872b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dadd50-12", "ovs_interfaceid": "96dadd50-12c8-430b-82ab-f113031f02d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Converting VIF {"id": "96dadd50-12c8-430b-82ab-f113031f02d8", "address": "fa:16:3e:d4:06:17", "network": {"id": "935a0b3b-6f36-45b2-a8d0-4d4541cce103", "bridge": "br-int", "label": "tempest-TestShelveInstance-1947454102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c735a6d80a64492baf3346d0c96a872b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dadd50-12", "ovs_interfaceid": "96dadd50-12c8-430b-82ab-f113031f02d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:06:17,bridge_name='br-int',has_traffic_filtering=True,id=96dadd50-12c8-430b-82ab-f113031f02d8,network=Network(935a0b3b-6f36-45b2-a8d0-4d4541cce103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96dadd50-12') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG os_vif [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:06:17,bridge_name='br-int',has_traffic_filtering=True,id=96dadd50-12c8-430b-82ab-f113031f02d8,network=Network(935a0b3b-6f36-45b2-a8d0-4d4541cce103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96dadd50-12') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96dadd50-12, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:45:27 user nova-compute[73010]: INFO os_vif [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:06:17,bridge_name='br-int',has_traffic_filtering=True,id=96dadd50-12c8-430b-82ab-f113031f02d8,network=Network(935a0b3b-6f36-45b2-a8d0-4d4541cce103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96dadd50-12')
Aug 15 00:45:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfoiFbEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:45:27 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:45:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddf5d30-d8da-4e97-b698-80dd12da272f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f12f09d-975b-4ae4-863f-4b2a8866da67]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:45:27 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:45:27 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:45:27 user nova-compute[73010]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 (non-flash)
Aug 15 00:45:27 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec3042e5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6'): ({'sdc'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Removing single pathed devices sdc {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8031cd46-4acc-440e-8c66-09712bf59592]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1408f230-a873-4ac2-9f79-6565679d8e75]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Flushing IO for device /dev/sdc {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b35410d-fdb3-4311-8599-6e557c2e0cfc]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[010b4216-9070-46da-8a5b-ab669aef5031]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] SCSI volumes sdc have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_523347f3', '/dev/disk/by-id/scsi-1SCST_BIO523347f3-e4da6523dd6eeec8', '/dev/disk/by-id/scsi-26534646136353233') {{(pid=84080) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cef6a7-5500-4739-a2c4-04455639ddcc]: (4, None) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[118e602b-caa9-434b-b385-1fb7135bb315]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[905d478c-aa83-4d9a-8af7-b66b92a345ff]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6, portal: 172.16.0.220,3260]
Aug 15 00:45:27 user nova-compute[73010]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6, portal: 172.16.0.220,3260] successful.
Aug 15 00:45:27 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f87474-057f-402d-883f-be3d848431a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ccd0fe-eb8f-4790-96bd-4cf85eeefedd]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] <== disconnect_volume: return (325ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:45:27 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Deleting instance files /opt/stack/data/nova/instances/009d9050-1720-45de-8bc9-16f404e65911_del
Aug 15 00:45:27 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Deletion of /opt/stack/data/nova/instances/009d9050-1720-45de-8bc9-16f404e65911_del complete
Aug 15 00:45:27 user nova-compute[73010]: INFO nova.compute.manager [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 15 00:45:27 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:45:27 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 009d9050-1720-45de-8bc9-16f404e65911] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:45:28 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:45:28 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Took 0.56 seconds to deallocate network for instance.
Aug 15 00:45:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-9bc34fdf-5382-42f3-8c04-507ce7215ae7 req-27c74538-3e12-4413-9a1b-df47c882b987 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Received event network-vif-deleted-96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:45:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-0af24b9b-cdd2-4cf2-b63f-8effef88af99 req-c4d3c5a7-2478-4749-ae5f-005a8fe17e55 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Received event network-vif-unplugged-96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:45:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0af24b9b-cdd2-4cf2-b63f-8effef88af99 req-c4d3c5a7-2478-4749-ae5f-005a8fe17e55 service nova] Acquiring lock "009d9050-1720-45de-8bc9-16f404e65911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0af24b9b-cdd2-4cf2-b63f-8effef88af99 req-c4d3c5a7-2478-4749-ae5f-005a8fe17e55 service nova] Lock "009d9050-1720-45de-8bc9-16f404e65911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0af24b9b-cdd2-4cf2-b63f-8effef88af99 req-c4d3c5a7-2478-4749-ae5f-005a8fe17e55 service nova] Lock "009d9050-1720-45de-8bc9-16f404e65911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-0af24b9b-cdd2-4cf2-b63f-8effef88af99 req-c4d3c5a7-2478-4749-ae5f-005a8fe17e55 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] No waiting events found dispatching network-vif-unplugged-96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:45:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-0af24b9b-cdd2-4cf2-b63f-8effef88af99 req-c4d3c5a7-2478-4749-ae5f-005a8fe17e55 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Received event network-vif-unplugged-96dadd50-12c8-430b-82ab-f113031f02d8 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:45:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-0af24b9b-cdd2-4cf2-b63f-8effef88af99 req-c4d3c5a7-2478-4749-ae5f-005a8fe17e55 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Received event network-vif-plugged-96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:45:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0af24b9b-cdd2-4cf2-b63f-8effef88af99 req-c4d3c5a7-2478-4749-ae5f-005a8fe17e55 service nova] Acquiring lock "009d9050-1720-45de-8bc9-16f404e65911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0af24b9b-cdd2-4cf2-b63f-8effef88af99 req-c4d3c5a7-2478-4749-ae5f-005a8fe17e55 service nova] Lock "009d9050-1720-45de-8bc9-16f404e65911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0af24b9b-cdd2-4cf2-b63f-8effef88af99 req-c4d3c5a7-2478-4749-ae5f-005a8fe17e55 service nova] Lock "009d9050-1720-45de-8bc9-16f404e65911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-0af24b9b-cdd2-4cf2-b63f-8effef88af99 req-c4d3c5a7-2478-4749-ae5f-005a8fe17e55 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] No waiting events found dispatching network-vif-plugged-96dadd50-12c8-430b-82ab-f113031f02d8 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:45:28 user nova-compute[73010]: WARNING nova.compute.manager [req-0af24b9b-cdd2-4cf2-b63f-8effef88af99 req-c4d3c5a7-2478-4749-ae5f-005a8fe17e55 service nova] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Received unexpected event network-vif-plugged-96dadd50-12c8-430b-82ab-f113031f02d8 for instance with vm_state active and task_state deleting.
Aug 15 00:45:29 user nova-compute[73010]: INFO nova.compute.manager [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Took 0.81 seconds to detach 1 volumes for instance.
Aug 15 00:45:29 user nova-compute[73010]: DEBUG nova.compute.manager [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Deleting volume: 72f87474-057f-402d-883f-be3d848431a6 {{(pid=73010) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 00:45:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:29 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:45:29 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:45:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:29 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Deleted allocations for instance 009d9050-1720-45de-8bc9-16f404e65911
Aug 15 00:45:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-292c7ecd-a0e1-4327-9d34-469193ecddc9 tempest-TestShelveInstance-1217563266 tempest-TestShelveInstance-1217563266-project-member] Lock "009d9050-1720-45de-8bc9-16f404e65911" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.064s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fdc9cfbd-5268-4fac-aea2-9359f8931948 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fdc9cfbd-5268-4fac-aea2-9359f8931948 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fdc9cfbd-5268-4fac-aea2-9359f8931948 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fdc9cfbd-5268-4fac-aea2-9359f8931948 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fdc9cfbd-5268-4fac-aea2-9359f8931948 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:38 user nova-compute[73010]: INFO nova.compute.manager [None req-fdc9cfbd-5268-4fac-aea2-9359f8931948 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Terminating instance
Aug 15 00:45:38 user nova-compute[73010]: DEBUG nova.compute.manager [None req-fdc9cfbd-5268-4fac-aea2-9359f8931948 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:45:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:39 user nova-compute[73010]: DEBUG nova.compute.manager [req-ec16440f-a4b8-44c5-9552-0fc976391a78 req-989d0e69-37d7-4551-9d56-fc747746c2cc service nova] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Received event network-vif-unplugged-b7c4cb21-45d7-4383-8716-d9b5f6de9000 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:45:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ec16440f-a4b8-44c5-9552-0fc976391a78 req-989d0e69-37d7-4551-9d56-fc747746c2cc service nova] Acquiring lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ec16440f-a4b8-44c5-9552-0fc976391a78 req-989d0e69-37d7-4551-9d56-fc747746c2cc service nova] Lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ec16440f-a4b8-44c5-9552-0fc976391a78 req-989d0e69-37d7-4551-9d56-fc747746c2cc service nova] Lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:39 user nova-compute[73010]: DEBUG nova.compute.manager [req-ec16440f-a4b8-44c5-9552-0fc976391a78 req-989d0e69-37d7-4551-9d56-fc747746c2cc service nova] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] No waiting events found dispatching network-vif-unplugged-b7c4cb21-45d7-4383-8716-d9b5f6de9000 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:45:39 user nova-compute[73010]: DEBUG nova.compute.manager [req-ec16440f-a4b8-44c5-9552-0fc976391a78 req-989d0e69-37d7-4551-9d56-fc747746c2cc service nova] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Received event network-vif-unplugged-b7c4cb21-45d7-4383-8716-d9b5f6de9000 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:45:39 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Instance destroyed successfully.
Aug 15 00:45:39 user nova-compute[73010]: DEBUG nova.objects.instance [None req-fdc9cfbd-5268-4fac-aea2-9359f8931948 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lazy-loading 'resources' on Instance uuid 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:45:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-fdc9cfbd-5268-4fac-aea2-9359f8931948 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:42:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1531298251',display_name='tempest-AttachVolumeNegativeTest-server-1531298251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1531298251',id=30,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5/hNasas6vAGBh55ekwBkNfiwtmdTuxogu286OghwqdxVOoTqsWI/yqUUuU1U2kvuLPMyUs/C5pFb+SHXzPk6HmvBSKXQIatqgXkG4iYrhi7Ynu5yA3q4gaft3eEfhZw==',key_name='tempest-keypair-1426278430',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:42:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e962745e3a554f2b8f42d97434173a7a',ramdisk_id='',reservation_id='r-lyvivsr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-865469153',owner_user_name='tempest-AttachVolumeNegativeTest-865469153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:42:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928ab235d55d4bfc86de82f2387c9d06',uuid=5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7c4cb21-45d7-4383-8716-d9b5f6de9000", "address": "fa:16:3e:86:b7:e1", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c4cb21-45", "ovs_interfaceid": "b7c4cb21-45d7-4383-8716-d9b5f6de9000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:45:39 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-fdc9cfbd-5268-4fac-aea2-9359f8931948 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Converting VIF {"id": "b7c4cb21-45d7-4383-8716-d9b5f6de9000", "address": "fa:16:3e:86:b7:e1", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c4cb21-45", "ovs_interfaceid": "b7c4cb21-45d7-4383-8716-d9b5f6de9000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:45:39 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-fdc9cfbd-5268-4fac-aea2-9359f8931948 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:b7:e1,bridge_name='br-int',has_traffic_filtering=True,id=b7c4cb21-45d7-4383-8716-d9b5f6de9000,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c4cb21-45') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:45:39 user nova-compute[73010]: DEBUG os_vif [None req-fdc9cfbd-5268-4fac-aea2-9359f8931948 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:b7:e1,bridge_name='br-int',has_traffic_filtering=True,id=b7c4cb21-45d7-4383-8716-d9b5f6de9000,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c4cb21-45') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:45:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7c4cb21-45, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:45:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:45:39 user nova-compute[73010]: INFO os_vif [None req-fdc9cfbd-5268-4fac-aea2-9359f8931948 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:b7:e1,bridge_name='br-int',has_traffic_filtering=True,id=b7c4cb21-45d7-4383-8716-d9b5f6de9000,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c4cb21-45')
Aug 15 00:45:39 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-fdc9cfbd-5268-4fac-aea2-9359f8931948 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Deleting instance files /opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4_del
Aug 15 00:45:39 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-fdc9cfbd-5268-4fac-aea2-9359f8931948 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Deletion of /opt/stack/data/nova/instances/5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4_del complete
Aug 15 00:45:39 user nova-compute[73010]: INFO nova.compute.manager [None req-fdc9cfbd-5268-4fac-aea2-9359f8931948 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 15 00:45:39 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-fdc9cfbd-5268-4fac-aea2-9359f8931948 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:45:39 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:45:39 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:45:40 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:45:40 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Took 0.99 seconds to deallocate network for instance.
Aug 15 00:45:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fdc9cfbd-5268-4fac-aea2-9359f8931948 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fdc9cfbd-5268-4fac-aea2-9359f8931948 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:41 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-fdc9cfbd-5268-4fac-aea2-9359f8931948 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:45:41 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-fdc9cfbd-5268-4fac-aea2-9359f8931948 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:45:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fdc9cfbd-5268-4fac-aea2-9359f8931948 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:41 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-fdc9cfbd-5268-4fac-aea2-9359f8931948 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Deleted allocations for instance 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4
Aug 15 00:45:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fdc9cfbd-5268-4fac-aea2-9359f8931948 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.318s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-4a607745-f907-48e7-952d-8e77d8100350 req-8a3ac8cf-35d2-4b4d-ad1b-334c0898832a service nova] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Received event network-vif-plugged-b7c4cb21-45d7-4383-8716-d9b5f6de9000 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:45:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4a607745-f907-48e7-952d-8e77d8100350 req-8a3ac8cf-35d2-4b4d-ad1b-334c0898832a service nova] Acquiring lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4a607745-f907-48e7-952d-8e77d8100350 req-8a3ac8cf-35d2-4b4d-ad1b-334c0898832a service nova] Lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4a607745-f907-48e7-952d-8e77d8100350 req-8a3ac8cf-35d2-4b4d-ad1b-334c0898832a service nova] Lock "5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-4a607745-f907-48e7-952d-8e77d8100350 req-8a3ac8cf-35d2-4b4d-ad1b-334c0898832a service nova] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] No waiting events found dispatching network-vif-plugged-b7c4cb21-45d7-4383-8716-d9b5f6de9000 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:45:41 user nova-compute[73010]: WARNING nova.compute.manager [req-4a607745-f907-48e7-952d-8e77d8100350 req-8a3ac8cf-35d2-4b4d-ad1b-334c0898832a service nova] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Received unexpected event network-vif-plugged-b7c4cb21-45d7-4383-8716-d9b5f6de9000 for instance with vm_state deleted and task_state None.
Aug 15 00:45:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-4a607745-f907-48e7-952d-8e77d8100350 req-8a3ac8cf-35d2-4b4d-ad1b-334c0898832a service nova] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Received event network-vif-deleted-b7c4cb21-45d7-4383-8716-d9b5f6de9000 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "4b5baaac-bb54-462c-b833-4f37de8f24dc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:42 user nova-compute[73010]: INFO nova.compute.manager [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Detaching volume 81943610-47b7-4bd7-8c92-e9c1f1d115b3
Aug 15 00:45:42 user nova-compute[73010]: INFO nova.virt.block_device [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Attempting to driver detach volume 81943610-47b7-4bd7-8c92-e9c1f1d115b3 from mountpoint /dev/vdb
Aug 15 00:45:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Attempting to detach device vdb from instance 4b5baaac-bb54-462c-b833-4f37de8f24dc from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:45:42 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:45:42 user nova-compute[73010]:   <source dev="/dev/sdd"/>
Aug 15 00:45:42 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:45:42 user nova-compute[73010]:   <serial>81943610-47b7-4bd7-8c92-e9c1f1d115b3</serial>
Aug 15 00:45:42 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 00:45:42 user nova-compute[73010]: </disk>
Aug 15 00:45:42 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:45:42 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Successfully detached device vdb from instance 4b5baaac-bb54-462c-b833-4f37de8f24dc from the persistent domain config.
Aug 15 00:45:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4b5baaac-bb54-462c-b833-4f37de8f24dc from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:45:42 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:45:42 user nova-compute[73010]:   <source dev="/dev/sdd"/>
Aug 15 00:45:42 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:45:42 user nova-compute[73010]:   <serial>81943610-47b7-4bd7-8c92-e9c1f1d115b3</serial>
Aug 15 00:45:42 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 00:45:42 user nova-compute[73010]: </disk>
Aug 15 00:45:42 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060327.4633265, 009d9050-1720-45de-8bc9-16f404e65911 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:45:42 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 009d9050-1720-45de-8bc9-16f404e65911] VM Stopped (Lifecycle Event)
Aug 15 00:45:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-7b9d80b9-d080-4f4c-b237-dda69892b034 None None] [instance: 009d9050-1720-45de-8bc9-16f404e65911] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692060342.8321922, 4b5baaac-bb54-462c-b833-4f37de8f24dc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4b5baaac-bb54-462c-b833-4f37de8f24dc {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:45:42 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Successfully detached device vdb from instance 4b5baaac-bb54-462c-b833-4f37de8f24dc from the live domain config.
Aug 15 00:45:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMnGUXuE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:45:42 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:45:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[325fb01d-0333-4d0b-a12e-729e32f39876]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddf30aa-3125-445d-a09b-0ec0bf2ffa83]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:45:42 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 (non-flash)
Aug 15 00:45:42 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec50551cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3'): ({'sdd'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Removing single pathed devices sdd {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a57bab-5204-47f3-80f9-bd64ef46ee8a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3594a8-509e-4663-9a3c-f30501d8268c]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Flushing IO for device /dev/sdd {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7aeae63-995a-4f5d-8ac3-a0ede3eccdca]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:45:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd54938d-d4d8-470c-8c45-741d8c5809cd]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] SCSI volumes sdd have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[946577a7-72ec-4186-ab42-d1755a8eed16]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd806241-1c96-43d0-90cb-c76e29a3ceca]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3, portal: 172.16.0.220,3260]
Aug 15 00:45:43 user nova-compute[73010]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3, portal: 172.16.0.220,3260] successful.
Aug 15 00:45:43 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81943610-47b7-4bd7-8c92-e9c1f1d115b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[510d2f7c-94dd-418b-9c59-ba76a0188f3d]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] <== disconnect_volume: return (268ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-77679ffb-59d0-49b6-a266-a26804f7c2fa tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Acquiring lock "b78b36ca-699c-4cac-a28a-61a6e684022f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-77679ffb-59d0-49b6-a266-a26804f7c2fa tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "b78b36ca-699c-4cac-a28a-61a6e684022f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-77679ffb-59d0-49b6-a266-a26804f7c2fa tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Acquiring lock "b78b36ca-699c-4cac-a28a-61a6e684022f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-77679ffb-59d0-49b6-a266-a26804f7c2fa tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "b78b36ca-699c-4cac-a28a-61a6e684022f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-77679ffb-59d0-49b6-a266-a26804f7c2fa tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "b78b36ca-699c-4cac-a28a-61a6e684022f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:43 user nova-compute[73010]: INFO nova.compute.manager [None req-77679ffb-59d0-49b6-a266-a26804f7c2fa tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Terminating instance
Aug 15 00:45:43 user nova-compute[73010]: DEBUG nova.compute.manager [None req-77679ffb-59d0-49b6-a266-a26804f7c2fa tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG nova.compute.manager [req-175523f5-0b73-4065-ae5f-3729b480199b req-8bf5dced-8c3a-471e-a55d-b2899580a239 service nova] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Received event network-vif-unplugged-80c40092-db14-49f0-95b6-e56d82db8d44 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-175523f5-0b73-4065-ae5f-3729b480199b req-8bf5dced-8c3a-471e-a55d-b2899580a239 service nova] Acquiring lock "b78b36ca-699c-4cac-a28a-61a6e684022f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-175523f5-0b73-4065-ae5f-3729b480199b req-8bf5dced-8c3a-471e-a55d-b2899580a239 service nova] Lock "b78b36ca-699c-4cac-a28a-61a6e684022f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-175523f5-0b73-4065-ae5f-3729b480199b req-8bf5dced-8c3a-471e-a55d-b2899580a239 service nova] Lock "b78b36ca-699c-4cac-a28a-61a6e684022f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG nova.compute.manager [req-175523f5-0b73-4065-ae5f-3729b480199b req-8bf5dced-8c3a-471e-a55d-b2899580a239 service nova] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] No waiting events found dispatching network-vif-unplugged-80c40092-db14-49f0-95b6-e56d82db8d44 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG nova.compute.manager [req-175523f5-0b73-4065-ae5f-3729b480199b req-8bf5dced-8c3a-471e-a55d-b2899580a239 service nova] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Received event network-vif-unplugged-80c40092-db14-49f0-95b6-e56d82db8d44 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:43 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Instance destroyed successfully.
Aug 15 00:45:43 user nova-compute[73010]: DEBUG nova.objects.instance [None req-77679ffb-59d0-49b6-a266-a26804f7c2fa tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lazy-loading 'resources' on Instance uuid b78b36ca-699c-4cac-a28a-61a6e684022f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-77679ffb-59d0-49b6-a266-a26804f7c2fa tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:43:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-863199853',display_name='tempest-ServersNegativeTestJSON-server-863199853',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-863199853',id=31,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:44:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09136fc9ddd9408892ac461a306a1618',ramdisk_id='',reservation_id='r-yqt9llj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-590131230',owner_user_name='tempest-ServersNegativeTestJSON-590131230-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:44:01Z,user_data=None,user_id='9515da5654394bf7b5175d74e7350a42',uuid=b78b36ca-699c-4cac-a28a-61a6e684022f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80c40092-db14-49f0-95b6-e56d82db8d44", "address": "fa:16:3e:4b:e9:91", "network": {"id": "2f9cb7ad-5cb3-4458-993a-780ab047d4e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-145440789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09136fc9ddd9408892ac461a306a1618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c40092-db", "ovs_interfaceid": "80c40092-db14-49f0-95b6-e56d82db8d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-77679ffb-59d0-49b6-a266-a26804f7c2fa tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Converting VIF {"id": "80c40092-db14-49f0-95b6-e56d82db8d44", "address": "fa:16:3e:4b:e9:91", "network": {"id": "2f9cb7ad-5cb3-4458-993a-780ab047d4e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-145440789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09136fc9ddd9408892ac461a306a1618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c40092-db", "ovs_interfaceid": "80c40092-db14-49f0-95b6-e56d82db8d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-77679ffb-59d0-49b6-a266-a26804f7c2fa tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:e9:91,bridge_name='br-int',has_traffic_filtering=True,id=80c40092-db14-49f0-95b6-e56d82db8d44,network=Network(2f9cb7ad-5cb3-4458-993a-780ab047d4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c40092-db') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG os_vif [None req-77679ffb-59d0-49b6-a266-a26804f7c2fa tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:e9:91,bridge_name='br-int',has_traffic_filtering=True,id=80c40092-db14-49f0-95b6-e56d82db8d44,network=Network(2f9cb7ad-5cb3-4458-993a-780ab047d4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c40092-db') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80c40092-db, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:45:43 user nova-compute[73010]: INFO os_vif [None req-77679ffb-59d0-49b6-a266-a26804f7c2fa tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:e9:91,bridge_name='br-int',has_traffic_filtering=True,id=80c40092-db14-49f0-95b6-e56d82db8d44,network=Network(2f9cb7ad-5cb3-4458-993a-780ab047d4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c40092-db')
Aug 15 00:45:43 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-77679ffb-59d0-49b6-a266-a26804f7c2fa tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Deleting instance files /opt/stack/data/nova/instances/b78b36ca-699c-4cac-a28a-61a6e684022f_del
Aug 15 00:45:43 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-77679ffb-59d0-49b6-a266-a26804f7c2fa tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Deletion of /opt/stack/data/nova/instances/b78b36ca-699c-4cac-a28a-61a6e684022f_del complete
Aug 15 00:45:43 user nova-compute[73010]: INFO nova.compute.manager [None req-77679ffb-59d0-49b6-a266-a26804f7c2fa tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 15 00:45:43 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-77679ffb-59d0-49b6-a266-a26804f7c2fa tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:45:43 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:45:44 user nova-compute[73010]: DEBUG nova.objects.instance [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lazy-loading 'flavor' on Instance uuid 4b5baaac-bb54-462c-b833-4f37de8f24dc {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:45:44 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:45:44 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Took 0.71 seconds to deallocate network for instance.
Aug 15 00:45:44 user nova-compute[73010]: DEBUG nova.compute.manager [req-429c864c-6fe9-43cf-8a5e-17ef28bd42ef req-837b878d-2f24-49f1-9aca-7583ea745322 service nova] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Received event network-vif-deleted-80c40092-db14-49f0-95b6-e56d82db8d44 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:45:44 user nova-compute[73010]: INFO nova.compute.manager [req-429c864c-6fe9-43cf-8a5e-17ef28bd42ef req-837b878d-2f24-49f1-9aca-7583ea745322 service nova] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Neutron deleted interface 80c40092-db14-49f0-95b6-e56d82db8d44; detaching it from the instance and deleting it from the info cache
Aug 15 00:45:44 user nova-compute[73010]: DEBUG nova.network.neutron [req-429c864c-6fe9-43cf-8a5e-17ef28bd42ef req-837b878d-2f24-49f1-9aca-7583ea745322 service nova] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:45:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-71e06639-c90d-4692-b65f-e0924e03f69b tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.265s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:44 user nova-compute[73010]: DEBUG nova.compute.manager [req-429c864c-6fe9-43cf-8a5e-17ef28bd42ef req-837b878d-2f24-49f1-9aca-7583ea745322 service nova] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Detach interface failed, port_id=80c40092-db14-49f0-95b6-e56d82db8d44, reason: Instance b78b36ca-699c-4cac-a28a-61a6e684022f could not be found. {{(pid=73010) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 00:45:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-77679ffb-59d0-49b6-a266-a26804f7c2fa tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-77679ffb-59d0-49b6-a266-a26804f7c2fa tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:44 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-77679ffb-59d0-49b6-a266-a26804f7c2fa tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:45:44 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-77679ffb-59d0-49b6-a266-a26804f7c2fa tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:45:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-77679ffb-59d0-49b6-a266-a26804f7c2fa tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:44 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-77679ffb-59d0-49b6-a266-a26804f7c2fa tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Deleted allocations for instance b78b36ca-699c-4cac-a28a-61a6e684022f
Aug 15 00:45:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-77679ffb-59d0-49b6-a266-a26804f7c2fa tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "b78b36ca-699c-4cac-a28a-61a6e684022f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.863s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:45 user nova-compute[73010]: DEBUG nova.compute.manager [req-57d988b9-0d8a-4133-ae62-a66d1fe98c9f req-6308ded5-151c-4bcf-ac61-ffac8df7d418 service nova] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Received event network-vif-plugged-80c40092-db14-49f0-95b6-e56d82db8d44 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:45:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-57d988b9-0d8a-4133-ae62-a66d1fe98c9f req-6308ded5-151c-4bcf-ac61-ffac8df7d418 service nova] Acquiring lock "b78b36ca-699c-4cac-a28a-61a6e684022f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-57d988b9-0d8a-4133-ae62-a66d1fe98c9f req-6308ded5-151c-4bcf-ac61-ffac8df7d418 service nova] Lock "b78b36ca-699c-4cac-a28a-61a6e684022f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-57d988b9-0d8a-4133-ae62-a66d1fe98c9f req-6308ded5-151c-4bcf-ac61-ffac8df7d418 service nova] Lock "b78b36ca-699c-4cac-a28a-61a6e684022f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:45 user nova-compute[73010]: DEBUG nova.compute.manager [req-57d988b9-0d8a-4133-ae62-a66d1fe98c9f req-6308ded5-151c-4bcf-ac61-ffac8df7d418 service nova] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] No waiting events found dispatching network-vif-plugged-80c40092-db14-49f0-95b6-e56d82db8d44 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:45:45 user nova-compute[73010]: WARNING nova.compute.manager [req-57d988b9-0d8a-4133-ae62-a66d1fe98c9f req-6308ded5-151c-4bcf-ac61-ffac8df7d418 service nova] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Received unexpected event network-vif-plugged-80c40092-db14-49f0-95b6-e56d82db8d44 for instance with vm_state deleted and task_state None.
Aug 15 00:45:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:52 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:45:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:52 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:45:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:45:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:54 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060339.7124817, 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:45:54 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] VM Stopped (Lifecycle Event)
Aug 15 00:45:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-d7f24c97-50ea-472c-b528-7d3370ba7be1 None None] [instance: 5a62d0e9-601d-4c8f-aa8b-50ccfcf53fb4] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:45:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:45:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:45:56 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:45:56 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:45:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=7923MB free_disk=25.65066909790039GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:45:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:45:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:45:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6dfc356b-953a-47b0-9da7-70cc59a80853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:45:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance eec545e8-eeda-443c-9892-980e19e7267a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:45:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4b489f97-c8d4-4a6a-8404-e1a05a990261 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:45:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 98fa0e64-cf36-4991-924d-ba4b713239d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:45:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4b5baaac-bb54-462c-b833-4f37de8f24dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:45:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:45:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:45:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:45:56 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:45:56 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:45:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:45:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:45:58 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060343.7090728, b78b36ca-699c-4cac-a28a-61a6e684022f => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:45:58 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] VM Stopped (Lifecycle Event)
Aug 15 00:45:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c96f784a-9ce0-47f0-93d7-68e0097ea4f3 None None] [instance: b78b36ca-699c-4cac-a28a-61a6e684022f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:45:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:00 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:46:00 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:46:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:46:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-eec545e8-eeda-443c-9892-980e19e7267a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:46:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-eec545e8-eeda-443c-9892-980e19e7267a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:46:00 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 00:46:00 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Updating instance_info_cache with network_info: [{"id": "65b5e7b6-01af-4239-9386-e7b14c83e766", "address": "fa:16:3e:88:de:ee", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b5e7b6-01", "ovs_interfaceid": "65b5e7b6-01af-4239-9386-e7b14c83e766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:46:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-eec545e8-eeda-443c-9892-980e19e7267a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:46:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 00:46:00 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:46:01 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:46:01 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:46:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:46:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:46:04 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:46:04 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:46:06 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:46:08 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:46:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "98fa0e64-cf36-4991-924d-ba4b713239d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG nova.objects.instance [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lazy-loading 'flavor' on Instance uuid 98fa0e64-cf36-4991-924d-ba4b713239d0 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "98fa0e64-cf36-4991-924d-ba4b713239d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:46:10 user nova-compute[73010]: INFO nova.compute.manager [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Attaching volume 6714f104-7efd-4963-be6e-e3ccbffc760d to /dev/vdb
Aug 15 00:46:10 user nova-compute[73010]: DEBUG os_brick.utils [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4dba5f-dde7-4b22-bc8d-d0b2371b90d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9cac75-2f5f-4620-8324-9ca0f15cfb3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d2f88f-8e10-44d0-9eff-106bb3e259db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b99027e-169e-402f-ae84-4de912c21261]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:46:10 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:46:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[011084ad-020a-4d92-8a0f-6f60fcb84d51]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG os_brick.utils [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:46:10 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Updating existing volume attachment record: 716d1cec-5475-4c58-929c-0ae8b067b0c0 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:46:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:46:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eIQNgncl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:46:19 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:46:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:46:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:46:19 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:46:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:46:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:46:19 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:46:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23e43a6-c47d-498d-971e-58522426bb18]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:46:19 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1c17cd-115e-4021-b476-5ab90161269d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d] added
Aug 15 00:46:20 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8b3a25-978f-40eb-8f4b-c00346bfb5c2]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f5fe52-3343-4431-b498-26ffff4e5e9e]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eIQNgncl {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eIQNgncl" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e697eb1f-d92a-4456-8f02-9982a749a52e]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eIQNgncl'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bba2cf-17ef-4ede-8eca-d2d516cd244d]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad00637b-da08-4847-b5db-49f4da42f178]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 00:46:20 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 00:46:20 user nova-compute[73010]:  {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:46:20 user nova-compute[73010]: WARNING os_brick.initiator.connectors.iscsi [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 00:46:20 user nova-compute[73010]: 
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba229318-3bb7-47b3-94e3-0693aef4726e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d, portal: 172.16.0.220,3260]
Aug 15 00:46:20 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d, portal: 172.16.0.220,3260] successful.
Aug 15 00:46:20 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3933aafb-fce2-4d88-b7dd-50a2731db3b0]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0174190-af2a-4347-8bd4-a79be8099467]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d (non-flash)
Aug 15 00:46:20 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d (non-flash)
Aug 15 00:46:20 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a97636-7f3c-4d8f-b78b-347eac753ac3]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eIQNgncl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:46:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:21 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:46:21 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23931323866333562', 'path': '/dev/sdb'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:46:21 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931323866333562', 'path': '/dev/sdb'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:46:21 user nova-compute[73010]: DEBUG nova.objects.instance [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lazy-loading 'flavor' on Instance uuid 98fa0e64-cf36-4991-924d-ba4b713239d0 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:46:21 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:46:21 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:46:21 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:46:21 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:46:21 user nova-compute[73010]:   <serial>6714f104-7efd-4963-be6e-e3ccbffc760d</serial>
Aug 15 00:46:21 user nova-compute[73010]: </disk>
Aug 15 00:46:21 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:46:21 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:46:21 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:46:21 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] No VIF found with MAC fa:16:3e:1d:6a:3d, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:46:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d6db8763-41e7-4d0f-a25a-90e1647ad91e tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.352s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:46:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "98fa0e64-cf36-4991-924d-ba4b713239d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:46:24 user nova-compute[73010]: INFO nova.compute.manager [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Detaching volume 6714f104-7efd-4963-be6e-e3ccbffc760d
Aug 15 00:46:24 user nova-compute[73010]: INFO nova.virt.block_device [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Attempting to driver detach volume 6714f104-7efd-4963-be6e-e3ccbffc760d from mountpoint /dev/vdb
Aug 15 00:46:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Attempting to detach device vdb from instance 98fa0e64-cf36-4991-924d-ba4b713239d0 from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:46:24 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:46:24 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:46:24 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:46:24 user nova-compute[73010]:   <serial>6714f104-7efd-4963-be6e-e3ccbffc760d</serial>
Aug 15 00:46:24 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:46:24 user nova-compute[73010]: </disk>
Aug 15 00:46:24 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:46:24 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Successfully detached device vdb from instance 98fa0e64-cf36-4991-924d-ba4b713239d0 from the persistent domain config.
Aug 15 00:46:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 98fa0e64-cf36-4991-924d-ba4b713239d0 from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:46:24 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:46:24 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:46:24 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:46:24 user nova-compute[73010]:   <serial>6714f104-7efd-4963-be6e-e3ccbffc760d</serial>
Aug 15 00:46:24 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:46:24 user nova-compute[73010]: </disk>
Aug 15 00:46:24 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692060384.8416457, 98fa0e64-cf36-4991-924d-ba4b713239d0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 98fa0e64-cf36-4991-924d-ba4b713239d0 {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:46:24 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Successfully detached device vdb from instance 98fa0e64-cf36-4991-924d-ba4b713239d0 from the live domain config.
Aug 15 00:46:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eIQNgncl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:46:24 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:46:24 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1839e011-1fa3-4b75-95b5-4616728108ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4fbe6c-750c-4152-9acd-17afe3e75b09]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d (non-flash)
Aug 15 00:46:24 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d (non-flash)
Aug 15 00:46:24 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec303c8dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d'): ({'sdb'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Removing single pathed devices sdb {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8440b404-6280-4b8b-ad5d-3e9df34aab29]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bf234c-c427-4818-93e0-79f0bb1d729e]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Flushing IO for device /dev/sdb {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:46:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:25 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ae8ae8-a185-411b-a6f1-df8f3e875523]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:25 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:46:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:25 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7f580c-a3e5-45c2-9db9-a625a3e84205]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:25 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:46:25 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:46:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:46:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:25 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9cc3e9-618d-4231-bd4e-2b5e057e04b1]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:46:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:25 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0178033-3398-4b98-96a3-6796e78a5933]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d, portal: 172.16.0.220,3260]
Aug 15 00:46:25 user nova-compute[73010]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d, portal: 172.16.0.220,3260] successful.
Aug 15 00:46:25 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:46:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6714f104-7efd-4963-be6e-e3ccbffc760d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:25 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[861f5434-b5b3-4c31-afb7-f4fa29eb8b80]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:46:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:46:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:46:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] <== disconnect_volume: return (314ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:46:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:46:26 user nova-compute[73010]: DEBUG nova.objects.instance [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lazy-loading 'flavor' on Instance uuid 98fa0e64-cf36-4991-924d-ba4b713239d0 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:46:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7bebb500-0f03-45f7-977e-8a380a9e4aad tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.861s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:46:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-82908e67-741f-471f-a491-c5c0eeed9111 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "4b5baaac-bb54-462c-b833-4f37de8f24dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:46:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-82908e67-741f-471f-a491-c5c0eeed9111 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:46:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-82908e67-741f-471f-a491-c5c0eeed9111 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:46:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-82908e67-741f-471f-a491-c5c0eeed9111 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:46:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-82908e67-741f-471f-a491-c5c0eeed9111 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:46:32 user nova-compute[73010]: INFO nova.compute.manager [None req-82908e67-741f-471f-a491-c5c0eeed9111 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Terminating instance
Aug 15 00:46:32 user nova-compute[73010]: DEBUG nova.compute.manager [None req-82908e67-741f-471f-a491-c5c0eeed9111 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:46:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:33 user nova-compute[73010]: DEBUG nova.compute.manager [req-82272b30-3e98-4fdd-8d27-b9df4cdd0055 req-23aa98e8-20a4-4152-a673-89161bfc09f9 service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Received event network-vif-unplugged-bf9a1845-c225-4c08-bc5a-929ebdceda57 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:46:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-82272b30-3e98-4fdd-8d27-b9df4cdd0055 req-23aa98e8-20a4-4152-a673-89161bfc09f9 service nova] Acquiring lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:46:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-82272b30-3e98-4fdd-8d27-b9df4cdd0055 req-23aa98e8-20a4-4152-a673-89161bfc09f9 service nova] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:46:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-82272b30-3e98-4fdd-8d27-b9df4cdd0055 req-23aa98e8-20a4-4152-a673-89161bfc09f9 service nova] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:46:33 user nova-compute[73010]: DEBUG nova.compute.manager [req-82272b30-3e98-4fdd-8d27-b9df4cdd0055 req-23aa98e8-20a4-4152-a673-89161bfc09f9 service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] No waiting events found dispatching network-vif-unplugged-bf9a1845-c225-4c08-bc5a-929ebdceda57 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:46:33 user nova-compute[73010]: DEBUG nova.compute.manager [req-82272b30-3e98-4fdd-8d27-b9df4cdd0055 req-23aa98e8-20a4-4152-a673-89161bfc09f9 service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Received event network-vif-unplugged-bf9a1845-c225-4c08-bc5a-929ebdceda57 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:46:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:33 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Instance destroyed successfully.
Aug 15 00:46:33 user nova-compute[73010]: DEBUG nova.objects.instance [None req-82908e67-741f-471f-a491-c5c0eeed9111 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lazy-loading 'resources' on Instance uuid 4b5baaac-bb54-462c-b833-4f37de8f24dc {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:46:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-82908e67-741f-471f-a491-c5c0eeed9111 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T00:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-943819205',display_name='tempest-ServerActionsTestOtherA-server-1706685852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-943819205',id=27,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz9vv0hqGajePOZ+2oXviFPXzQK2KEcWfvP3fM07mI8g1goyyeZFkU5ISIVRZy9AWkrpm4V0CqGkVIurRbtfDkxSjm0VLFyN90TKUeEwHZdHfqNj3wkXYudQjaCa9ggDg==',key_name='tempest-keypair-1595777815',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:43:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13115a64ccc24df68bdfda1fc72399c4',ramdisk_id='',reservation_id='r-2xbqlkxi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-671712537',owner_user_name='tempest-ServerActionsTestOtherA-671712537-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:43:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0e48e71bb404f26926ac7a8176e04bb',uuid=4b5baaac-bb54-462c-b833-4f37de8f24dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "address": "fa:16:3e:ec:63:2a", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9a1845-c2", "ovs_interfaceid": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:46:33 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-82908e67-741f-471f-a491-c5c0eeed9111 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converting VIF {"id": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "address": "fa:16:3e:ec:63:2a", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9a1845-c2", "ovs_interfaceid": "bf9a1845-c225-4c08-bc5a-929ebdceda57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:46:33 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-82908e67-741f-471f-a491-c5c0eeed9111 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:63:2a,bridge_name='br-int',has_traffic_filtering=True,id=bf9a1845-c225-4c08-bc5a-929ebdceda57,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9a1845-c2') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:46:33 user nova-compute[73010]: DEBUG os_vif [None req-82908e67-741f-471f-a491-c5c0eeed9111 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:63:2a,bridge_name='br-int',has_traffic_filtering=True,id=bf9a1845-c225-4c08-bc5a-929ebdceda57,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9a1845-c2') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:46:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf9a1845-c2, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:46:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:46:33 user nova-compute[73010]: INFO os_vif [None req-82908e67-741f-471f-a491-c5c0eeed9111 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:63:2a,bridge_name='br-int',has_traffic_filtering=True,id=bf9a1845-c225-4c08-bc5a-929ebdceda57,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9a1845-c2')
Aug 15 00:46:33 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-82908e67-741f-471f-a491-c5c0eeed9111 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Deleting instance files /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc_del
Aug 15 00:46:33 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-82908e67-741f-471f-a491-c5c0eeed9111 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Deletion of /opt/stack/data/nova/instances/4b5baaac-bb54-462c-b833-4f37de8f24dc_del complete
Aug 15 00:46:33 user nova-compute[73010]: INFO nova.compute.manager [None req-82908e67-741f-471f-a491-c5c0eeed9111 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 15 00:46:33 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-82908e67-741f-471f-a491-c5c0eeed9111 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:46:33 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:46:33 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:46:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "5df2a7ef-16c7-4e37-9534-41d95d96af41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:46:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "5df2a7ef-16c7-4e37-9534-41d95d96af41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:46:34 user nova-compute[73010]: DEBUG nova.compute.manager [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:46:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:46:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:46:34 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:46:34 user nova-compute[73010]: INFO nova.compute.claims [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Claim successful on node user
Aug 15 00:46:34 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:46:34 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:46:34 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:46:34 user nova-compute[73010]: DEBUG nova.compute.manager [req-685c709e-35f2-41e9-8f7a-238d11de1397 req-07185897-8984-441d-a978-82c9d6858e0c service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Received event network-vif-deleted-bf9a1845-c225-4c08-bc5a-929ebdceda57 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:46:34 user nova-compute[73010]: INFO nova.compute.manager [req-685c709e-35f2-41e9-8f7a-238d11de1397 req-07185897-8984-441d-a978-82c9d6858e0c service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Neutron deleted interface bf9a1845-c225-4c08-bc5a-929ebdceda57; detaching it from the instance and deleting it from the info cache
Aug 15 00:46:34 user nova-compute[73010]: DEBUG nova.network.neutron [req-685c709e-35f2-41e9-8f7a-238d11de1397 req-07185897-8984-441d-a978-82c9d6858e0c service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:46:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:46:34 user nova-compute[73010]: DEBUG nova.compute.manager [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:46:34 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Took 1.22 seconds to deallocate network for instance.
Aug 15 00:46:34 user nova-compute[73010]: DEBUG nova.compute.manager [req-685c709e-35f2-41e9-8f7a-238d11de1397 req-07185897-8984-441d-a978-82c9d6858e0c service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Detach interface failed, port_id=bf9a1845-c225-4c08-bc5a-929ebdceda57, reason: Instance 4b5baaac-bb54-462c-b833-4f37de8f24dc could not be found. {{(pid=73010) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 00:46:34 user nova-compute[73010]: DEBUG nova.compute.manager [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:46:34 user nova-compute[73010]: DEBUG nova.network.neutron [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:46:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-82908e67-741f-471f-a491-c5c0eeed9111 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:46:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-82908e67-741f-471f-a491-c5c0eeed9111 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:46:34 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:46:35 user nova-compute[73010]: DEBUG nova.compute.manager [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG nova.policy [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '928ab235d55d4bfc86de82f2387c9d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e962745e3a554f2b8f42d97434173a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG nova.compute.manager [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:46:35 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Creating image(s)
Aug 15 00:46:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "/opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "/opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "/opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-82908e67-741f-471f-a491-c5c0eeed9111 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-82908e67-741f-471f-a491-c5c0eeed9111 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG nova.compute.manager [req-3bb8fdc3-de79-4cde-8918-420660b4ce87 req-28e8ff96-d189-4dcd-9c11-88797a8d7d32 service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Received event network-vif-plugged-bf9a1845-c225-4c08-bc5a-929ebdceda57 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3bb8fdc3-de79-4cde-8918-420660b4ce87 req-28e8ff96-d189-4dcd-9c11-88797a8d7d32 service nova] Acquiring lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3bb8fdc3-de79-4cde-8918-420660b4ce87 req-28e8ff96-d189-4dcd-9c11-88797a8d7d32 service nova] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3bb8fdc3-de79-4cde-8918-420660b4ce87 req-28e8ff96-d189-4dcd-9c11-88797a8d7d32 service nova] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG nova.compute.manager [req-3bb8fdc3-de79-4cde-8918-420660b4ce87 req-28e8ff96-d189-4dcd-9c11-88797a8d7d32 service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] No waiting events found dispatching network-vif-plugged-bf9a1845-c225-4c08-bc5a-929ebdceda57 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:46:35 user nova-compute[73010]: WARNING nova.compute.manager [req-3bb8fdc3-de79-4cde-8918-420660b4ce87 req-28e8ff96-d189-4dcd-9c11-88797a8d7d32 service nova] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Received unexpected event network-vif-plugged-bf9a1845-c225-4c08-bc5a-929ebdceda57 for instance with vm_state deleted and task_state None.
Aug 15 00:46:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-82908e67-741f-471f-a491-c5c0eeed9111 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.440s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.272s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:35 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-82908e67-741f-471f-a491-c5c0eeed9111 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Deleted allocations for instance 4b5baaac-bb54-462c-b833-4f37de8f24dc
Aug 15 00:46:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-82908e67-741f-471f-a491-c5c0eeed9111 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "4b5baaac-bb54-462c-b833-4f37de8f24dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.929s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.226s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41/disk 1073741824" returned: 0 in 0.065s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.194s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:46:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:36 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Cannot resize image /opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:46:36 user nova-compute[73010]: DEBUG nova.objects.instance [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lazy-loading 'migration_context' on Instance uuid 5df2a7ef-16c7-4e37-9534-41d95d96af41 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:46:36 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:46:36 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Ensure instance console log exists: /opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:46:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:46:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:46:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:46:36 user nova-compute[73010]: DEBUG nova.network.neutron [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Successfully created port: 7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.network.neutron [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Successfully updated port: 7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "refresh_cache-5df2a7ef-16c7-4e37-9534-41d95d96af41" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquired lock "refresh_cache-5df2a7ef-16c7-4e37-9534-41d95d96af41" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.network.neutron [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.compute.manager [req-b651a213-a6fd-453f-b865-d80d532afbb8 req-dd9f63e7-039b-4959-b50e-671b5178c495 service nova] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Received event network-changed-7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.compute.manager [req-b651a213-a6fd-453f-b865-d80d532afbb8 req-dd9f63e7-039b-4959-b50e-671b5178c495 service nova] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Refreshing instance network info cache due to event network-changed-7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b651a213-a6fd-453f-b865-d80d532afbb8 req-dd9f63e7-039b-4959-b50e-671b5178c495 service nova] Acquiring lock "refresh_cache-5df2a7ef-16c7-4e37-9534-41d95d96af41" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.network.neutron [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.network.neutron [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Updating instance_info_cache with network_info: [{"id": "7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9", "address": "fa:16:3e:fd:5a:8b", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edc2bb1-66", "ovs_interfaceid": "7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Releasing lock "refresh_cache-5df2a7ef-16c7-4e37-9534-41d95d96af41" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Instance network_info: |[{"id": "7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9", "address": "fa:16:3e:fd:5a:8b", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edc2bb1-66", "ovs_interfaceid": "7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b651a213-a6fd-453f-b865-d80d532afbb8 req-dd9f63e7-039b-4959-b50e-671b5178c495 service nova] Acquired lock "refresh_cache-5df2a7ef-16c7-4e37-9534-41d95d96af41" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.network.neutron [req-b651a213-a6fd-453f-b865-d80d532afbb8 req-dd9f63e7-039b-4959-b50e-671b5178c495 service nova] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Refreshing network info cache for port 7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Start _get_guest_xml network_info=[{"id": "7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9", "address": "fa:16:3e:fd:5a:8b", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edc2bb1-66", "ovs_interfaceid": "7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:46:37 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:46:37 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:46:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-521405778',display_name='tempest-AttachVolumeNegativeTest-server-521405778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-521405778',id=32,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCp3mQO2pKPYHExfn3C4RDIB4GPL4PgIYiuJ9s6QsdMmGnx7v9KEzpUUPMzCDr2GK5xdmqUJfV+dYSIrTeJC52HzghlzN0Zda5HbRCDvX7Dr+75bdu6BXUrUqlsv1Lnqfg==',key_name='tempest-keypair-290987230',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e962745e3a554f2b8f42d97434173a7a',ramdisk_id='',reservation_id='r-cn6dnc2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-865469153',owner_user_name='tempest-AttachVolumeNegativeTest-865469153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:46:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928ab235d55d4bfc86de82f2387c9d06',uuid=5df2a7ef-16c7-4e37-9534-41d95d96af41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9", "address": "fa:16:3e:fd:5a:8b", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edc2bb1-66", "ovs_interfaceid": "7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Converting VIF {"id": "7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9", "address": "fa:16:3e:fd:5a:8b", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edc2bb1-66", "ovs_interfaceid": "7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:5a:8b,bridge_name='br-int',has_traffic_filtering=True,id=7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7edc2bb1-66') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.objects.instance [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lazy-loading 'pci_devices' on Instance uuid 5df2a7ef-16c7-4e37-9534-41d95d96af41 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:46:37 user nova-compute[73010]:   <uuid>5df2a7ef-16c7-4e37-9534-41d95d96af41</uuid>
Aug 15 00:46:37 user nova-compute[73010]:   <name>instance-00000020</name>
Aug 15 00:46:37 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:46:37 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:46:37 user nova-compute[73010]:   <metadata>
Aug 15 00:46:37 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:46:37 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:46:37 user nova-compute[73010]:       <nova:name>tempest-AttachVolumeNegativeTest-server-521405778</nova:name>
Aug 15 00:46:37 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:46:37</nova:creationTime>
Aug 15 00:46:37 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:46:37 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:46:37 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:46:37 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:46:37 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:46:37 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:46:37 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:46:37 user nova-compute[73010]:       <nova:owner>
Aug 15 00:46:37 user nova-compute[73010]:         <nova:user uuid="928ab235d55d4bfc86de82f2387c9d06">tempest-AttachVolumeNegativeTest-865469153-project-member</nova:user>
Aug 15 00:46:37 user nova-compute[73010]:         <nova:project uuid="e962745e3a554f2b8f42d97434173a7a">tempest-AttachVolumeNegativeTest-865469153</nova:project>
Aug 15 00:46:37 user nova-compute[73010]:       </nova:owner>
Aug 15 00:46:37 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:46:37 user nova-compute[73010]:       <nova:ports>
Aug 15 00:46:37 user nova-compute[73010]:         <nova:port uuid="7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9">
Aug 15 00:46:37 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 00:46:37 user nova-compute[73010]:         </nova:port>
Aug 15 00:46:37 user nova-compute[73010]:       </nova:ports>
Aug 15 00:46:37 user nova-compute[73010]:     </nova:instance>
Aug 15 00:46:37 user nova-compute[73010]:   </metadata>
Aug 15 00:46:37 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:46:37 user nova-compute[73010]:     <system>
Aug 15 00:46:37 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:46:37 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:46:37 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:46:37 user nova-compute[73010]:       <entry name="serial">5df2a7ef-16c7-4e37-9534-41d95d96af41</entry>
Aug 15 00:46:37 user nova-compute[73010]:       <entry name="uuid">5df2a7ef-16c7-4e37-9534-41d95d96af41</entry>
Aug 15 00:46:37 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:46:37 user nova-compute[73010]:     </system>
Aug 15 00:46:37 user nova-compute[73010]:   </sysinfo>
Aug 15 00:46:37 user nova-compute[73010]:   <os>
Aug 15 00:46:37 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:46:37 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:46:37 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:46:37 user nova-compute[73010]:   </os>
Aug 15 00:46:37 user nova-compute[73010]:   <features>
Aug 15 00:46:37 user nova-compute[73010]:     <acpi/>
Aug 15 00:46:37 user nova-compute[73010]:     <apic/>
Aug 15 00:46:37 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:46:37 user nova-compute[73010]:   </features>
Aug 15 00:46:37 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:46:37 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:46:37 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:46:37 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:46:37 user nova-compute[73010]:   </clock>
Aug 15 00:46:37 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:46:37 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:46:37 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:46:37 user nova-compute[73010]:   </cpu>
Aug 15 00:46:37 user nova-compute[73010]:   <devices>
Aug 15 00:46:37 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:46:37 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:46:37 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41/disk"/>
Aug 15 00:46:37 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:46:37 user nova-compute[73010]:     </disk>
Aug 15 00:46:37 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:46:37 user nova-compute[73010]:       <mac address="fa:16:3e:fd:5a:8b"/>
Aug 15 00:46:37 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:46:37 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:46:37 user nova-compute[73010]:       <target dev="tap7edc2bb1-66"/>
Aug 15 00:46:37 user nova-compute[73010]:     </interface>
Aug 15 00:46:37 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:46:37 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41/console.log" append="off"/>
Aug 15 00:46:37 user nova-compute[73010]:     </serial>
Aug 15 00:46:37 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:46:37 user nova-compute[73010]:     <video>
Aug 15 00:46:37 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:46:37 user nova-compute[73010]:     </video>
Aug 15 00:46:37 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:46:37 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:46:37 user nova-compute[73010]:     </rng>
Aug 15 00:46:37 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:46:37 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:46:37 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:46:37 user nova-compute[73010]:     </memballoon>
Aug 15 00:46:37 user nova-compute[73010]:   </devices>
Aug 15 00:46:37 user nova-compute[73010]: </domain>
Aug 15 00:46:37 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:46:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-521405778',display_name='tempest-AttachVolumeNegativeTest-server-521405778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-521405778',id=32,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCp3mQO2pKPYHExfn3C4RDIB4GPL4PgIYiuJ9s6QsdMmGnx7v9KEzpUUPMzCDr2GK5xdmqUJfV+dYSIrTeJC52HzghlzN0Zda5HbRCDvX7Dr+75bdu6BXUrUqlsv1Lnqfg==',key_name='tempest-keypair-290987230',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e962745e3a554f2b8f42d97434173a7a',ramdisk_id='',reservation_id='r-cn6dnc2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-865469153',owner_user_name='tempest-AttachVolumeNegativeTest-865469153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:46:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928ab235d55d4bfc86de82f2387c9d06',uuid=5df2a7ef-16c7-4e37-9534-41d95d96af41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9", "address": "fa:16:3e:fd:5a:8b", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edc2bb1-66", "ovs_interfaceid": "7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Converting VIF {"id": "7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9", "address": "fa:16:3e:fd:5a:8b", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edc2bb1-66", "ovs_interfaceid": "7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:5a:8b,bridge_name='br-int',has_traffic_filtering=True,id=7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7edc2bb1-66') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG os_vif [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:5a:8b,bridge_name='br-int',has_traffic_filtering=True,id=7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7edc2bb1-66') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7edc2bb1-66, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7edc2bb1-66, col_values=(('external_ids', {'iface-id': '7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:5a:8b', 'vm-uuid': '5df2a7ef-16c7-4e37-9534-41d95d96af41'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:37 user nova-compute[73010]: INFO os_vif [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:5a:8b,bridge_name='br-int',has_traffic_filtering=True,id=7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7edc2bb1-66')
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:46:37 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] No VIF found with MAC fa:16:3e:fd:5a:8b, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:46:38 user nova-compute[73010]: DEBUG nova.network.neutron [req-b651a213-a6fd-453f-b865-d80d532afbb8 req-dd9f63e7-039b-4959-b50e-671b5178c495 service nova] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Updated VIF entry in instance network info cache for port 7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:46:38 user nova-compute[73010]: DEBUG nova.network.neutron [req-b651a213-a6fd-453f-b865-d80d532afbb8 req-dd9f63e7-039b-4959-b50e-671b5178c495 service nova] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Updating instance_info_cache with network_info: [{"id": "7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9", "address": "fa:16:3e:fd:5a:8b", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edc2bb1-66", "ovs_interfaceid": "7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:46:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b651a213-a6fd-453f-b865-d80d532afbb8 req-dd9f63e7-039b-4959-b50e-671b5178c495 service nova] Releasing lock "refresh_cache-5df2a7ef-16c7-4e37-9534-41d95d96af41" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:46:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:39 user nova-compute[73010]: DEBUG nova.compute.manager [req-3ae966a7-cddf-4e1d-a709-df7eaa36e141 req-78fd1c4f-9b3e-4546-bcff-d98b3319e068 service nova] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Received event network-vif-plugged-7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:46:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3ae966a7-cddf-4e1d-a709-df7eaa36e141 req-78fd1c4f-9b3e-4546-bcff-d98b3319e068 service nova] Acquiring lock "5df2a7ef-16c7-4e37-9534-41d95d96af41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:46:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3ae966a7-cddf-4e1d-a709-df7eaa36e141 req-78fd1c4f-9b3e-4546-bcff-d98b3319e068 service nova] Lock "5df2a7ef-16c7-4e37-9534-41d95d96af41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:46:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3ae966a7-cddf-4e1d-a709-df7eaa36e141 req-78fd1c4f-9b3e-4546-bcff-d98b3319e068 service nova] Lock "5df2a7ef-16c7-4e37-9534-41d95d96af41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:46:39 user nova-compute[73010]: DEBUG nova.compute.manager [req-3ae966a7-cddf-4e1d-a709-df7eaa36e141 req-78fd1c4f-9b3e-4546-bcff-d98b3319e068 service nova] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] No waiting events found dispatching network-vif-plugged-7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:46:39 user nova-compute[73010]: WARNING nova.compute.manager [req-3ae966a7-cddf-4e1d-a709-df7eaa36e141 req-78fd1c4f-9b3e-4546-bcff-d98b3319e068 service nova] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Received unexpected event network-vif-plugged-7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9 for instance with vm_state building and task_state spawning.
Aug 15 00:46:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:41 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060401.4779425, 5df2a7ef-16c7-4e37-9534-41d95d96af41 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:46:41 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] VM Resumed (Lifecycle Event)
Aug 15 00:46:41 user nova-compute[73010]: DEBUG nova.compute.manager [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:46:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:46:41 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Instance spawned successfully.
Aug 15 00:46:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:46:41 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:46:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-3cdf865d-77aa-4c12-a0a0-ece7386f032d req-d403fd26-f940-4846-8b3d-78b21c92cb5f service nova] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Received event network-vif-plugged-7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:46:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3cdf865d-77aa-4c12-a0a0-ece7386f032d req-d403fd26-f940-4846-8b3d-78b21c92cb5f service nova] Acquiring lock "5df2a7ef-16c7-4e37-9534-41d95d96af41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:46:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3cdf865d-77aa-4c12-a0a0-ece7386f032d req-d403fd26-f940-4846-8b3d-78b21c92cb5f service nova] Lock "5df2a7ef-16c7-4e37-9534-41d95d96af41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:46:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3cdf865d-77aa-4c12-a0a0-ece7386f032d req-d403fd26-f940-4846-8b3d-78b21c92cb5f service nova] Lock "5df2a7ef-16c7-4e37-9534-41d95d96af41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:46:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-3cdf865d-77aa-4c12-a0a0-ece7386f032d req-d403fd26-f940-4846-8b3d-78b21c92cb5f service nova] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] No waiting events found dispatching network-vif-plugged-7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:46:41 user nova-compute[73010]: WARNING nova.compute.manager [req-3cdf865d-77aa-4c12-a0a0-ece7386f032d req-d403fd26-f940-4846-8b3d-78b21c92cb5f service nova] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Received unexpected event network-vif-plugged-7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9 for instance with vm_state building and task_state spawning.
Aug 15 00:46:41 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:46:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:46:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:46:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:46:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:46:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:46:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:46:41 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:46:41 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060401.4802303, 5df2a7ef-16c7-4e37-9534-41d95d96af41 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:46:41 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] VM Started (Lifecycle Event)
Aug 15 00:46:41 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:46:41 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:46:41 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:46:41 user nova-compute[73010]: INFO nova.compute.manager [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Took 6.49 seconds to spawn the instance on the hypervisor.
Aug 15 00:46:41 user nova-compute[73010]: DEBUG nova.compute.manager [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:46:41 user nova-compute[73010]: INFO nova.compute.manager [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Took 7.32 seconds to build instance.
Aug 15 00:46:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61c173d0-74c5-44c2-9388-9fa9ded86bcb tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "5df2a7ef-16c7-4e37-9534-41d95d96af41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.463s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:46:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:48 user nova-compute[73010]: INFO nova.compute.manager [None req-bba110df-51c5-4334-bc8f-418f56c1c442 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Unrescuing
Aug 15 00:46:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-bba110df-51c5-4334-bc8f-418f56c1c442 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "refresh_cache-eec545e8-eeda-443c-9892-980e19e7267a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:46:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-bba110df-51c5-4334-bc8f-418f56c1c442 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquired lock "refresh_cache-eec545e8-eeda-443c-9892-980e19e7267a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:46:48 user nova-compute[73010]: DEBUG nova.network.neutron [None req-bba110df-51c5-4334-bc8f-418f56c1c442 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:46:48 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060393.513643, 4b5baaac-bb54-462c-b833-4f37de8f24dc => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:46:48 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] VM Stopped (Lifecycle Event)
Aug 15 00:46:48 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f614d2dc-041e-47bb-b1a9-1f91560a9d38 None None] [instance: 4b5baaac-bb54-462c-b833-4f37de8f24dc] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:46:48 user nova-compute[73010]: DEBUG nova.network.neutron [None req-bba110df-51c5-4334-bc8f-418f56c1c442 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Updating instance_info_cache with network_info: [{"id": "65b5e7b6-01af-4239-9386-e7b14c83e766", "address": "fa:16:3e:88:de:ee", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b5e7b6-01", "ovs_interfaceid": "65b5e7b6-01af-4239-9386-e7b14c83e766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:46:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-bba110df-51c5-4334-bc8f-418f56c1c442 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Releasing lock "refresh_cache-eec545e8-eeda-443c-9892-980e19e7267a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:46:48 user nova-compute[73010]: DEBUG nova.objects.instance [None req-bba110df-51c5-4334-bc8f-418f56c1c442 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'flavor' on Instance uuid eec545e8-eeda-443c-9892-980e19e7267a {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:46:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:49 user nova-compute[73010]: DEBUG nova.compute.manager [req-4a7bbd75-a0fa-4402-9367-81af482124d2 req-d13d8fc8-e4bd-458f-a9eb-bf32b766068d service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received event network-vif-unplugged-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:46:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4a7bbd75-a0fa-4402-9367-81af482124d2 req-d13d8fc8-e4bd-458f-a9eb-bf32b766068d service nova] Acquiring lock "eec545e8-eeda-443c-9892-980e19e7267a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:46:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4a7bbd75-a0fa-4402-9367-81af482124d2 req-d13d8fc8-e4bd-458f-a9eb-bf32b766068d service nova] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:46:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4a7bbd75-a0fa-4402-9367-81af482124d2 req-d13d8fc8-e4bd-458f-a9eb-bf32b766068d service nova] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:46:49 user nova-compute[73010]: DEBUG nova.compute.manager [req-4a7bbd75-a0fa-4402-9367-81af482124d2 req-d13d8fc8-e4bd-458f-a9eb-bf32b766068d service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] No waiting events found dispatching network-vif-unplugged-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:46:49 user nova-compute[73010]: WARNING nova.compute.manager [req-4a7bbd75-a0fa-4402-9367-81af482124d2 req-d13d8fc8-e4bd-458f-a9eb-bf32b766068d service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received unexpected event network-vif-unplugged-65b5e7b6-01af-4239-9386-e7b14c83e766 for instance with vm_state rescued and task_state unrescuing.
Aug 15 00:46:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:49 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Instance destroyed successfully.
Aug 15 00:46:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:51 user nova-compute[73010]: DEBUG nova.compute.manager [req-96fbd0d0-cbec-4a95-b287-770476125acd req-850297c2-f681-4ece-897c-190a84e96504 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received event network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:46:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-96fbd0d0-cbec-4a95-b287-770476125acd req-850297c2-f681-4ece-897c-190a84e96504 service nova] Acquiring lock "eec545e8-eeda-443c-9892-980e19e7267a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:46:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-96fbd0d0-cbec-4a95-b287-770476125acd req-850297c2-f681-4ece-897c-190a84e96504 service nova] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:46:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-96fbd0d0-cbec-4a95-b287-770476125acd req-850297c2-f681-4ece-897c-190a84e96504 service nova] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:46:51 user nova-compute[73010]: DEBUG nova.compute.manager [req-96fbd0d0-cbec-4a95-b287-770476125acd req-850297c2-f681-4ece-897c-190a84e96504 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] No waiting events found dispatching network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:46:51 user nova-compute[73010]: WARNING nova.compute.manager [req-96fbd0d0-cbec-4a95-b287-770476125acd req-850297c2-f681-4ece-897c-190a84e96504 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received unexpected event network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 for instance with vm_state rescued and task_state unrescuing.
Aug 15 00:46:51 user nova-compute[73010]: DEBUG nova.compute.manager [req-96fbd0d0-cbec-4a95-b287-770476125acd req-850297c2-f681-4ece-897c-190a84e96504 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received event network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:46:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-96fbd0d0-cbec-4a95-b287-770476125acd req-850297c2-f681-4ece-897c-190a84e96504 service nova] Acquiring lock "eec545e8-eeda-443c-9892-980e19e7267a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:46:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-96fbd0d0-cbec-4a95-b287-770476125acd req-850297c2-f681-4ece-897c-190a84e96504 service nova] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:46:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-96fbd0d0-cbec-4a95-b287-770476125acd req-850297c2-f681-4ece-897c-190a84e96504 service nova] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:46:51 user nova-compute[73010]: DEBUG nova.compute.manager [req-96fbd0d0-cbec-4a95-b287-770476125acd req-850297c2-f681-4ece-897c-190a84e96504 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] No waiting events found dispatching network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:46:51 user nova-compute[73010]: WARNING nova.compute.manager [req-96fbd0d0-cbec-4a95-b287-770476125acd req-850297c2-f681-4ece-897c-190a84e96504 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received unexpected event network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 for instance with vm_state rescued and task_state unrescuing.
Aug 15 00:46:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Removed pending event for eec545e8-eeda-443c-9892-980e19e7267a due to event {{(pid=73010) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 00:46:53 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060413.2295184, eec545e8-eeda-443c-9892-980e19e7267a => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:46:53 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] VM Resumed (Lifecycle Event)
Aug 15 00:46:53 user nova-compute[73010]: DEBUG nova.compute.manager [None req-bba110df-51c5-4334-bc8f-418f56c1c442 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:46:53 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:46:53 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:46:53 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 00:46:53 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060413.2331667, eec545e8-eeda-443c-9892-980e19e7267a => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:46:53 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] VM Started (Lifecycle Event)
Aug 15 00:46:53 user nova-compute[73010]: DEBUG nova.compute.manager [req-f75ed2f0-6fd1-4bd8-806c-50b33549c60b req-cce23ff1-69f9-49e2-aea6-8aeebc5c5eb9 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received event network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:46:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f75ed2f0-6fd1-4bd8-806c-50b33549c60b req-cce23ff1-69f9-49e2-aea6-8aeebc5c5eb9 service nova] Acquiring lock "eec545e8-eeda-443c-9892-980e19e7267a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:46:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f75ed2f0-6fd1-4bd8-806c-50b33549c60b req-cce23ff1-69f9-49e2-aea6-8aeebc5c5eb9 service nova] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:46:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f75ed2f0-6fd1-4bd8-806c-50b33549c60b req-cce23ff1-69f9-49e2-aea6-8aeebc5c5eb9 service nova] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:46:53 user nova-compute[73010]: DEBUG nova.compute.manager [req-f75ed2f0-6fd1-4bd8-806c-50b33549c60b req-cce23ff1-69f9-49e2-aea6-8aeebc5c5eb9 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] No waiting events found dispatching network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:46:53 user nova-compute[73010]: WARNING nova.compute.manager [req-f75ed2f0-6fd1-4bd8-806c-50b33549c60b req-cce23ff1-69f9-49e2-aea6-8aeebc5c5eb9 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received unexpected event network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 for instance with vm_state rescued and task_state unrescuing.
Aug 15 00:46:53 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:46:53 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:46:54 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:46:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:46:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:46:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:46:54 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:46:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.268s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:46:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:46:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:46:58 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:46:58 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:46:58 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=7971MB free_disk=25.662017822265625GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:46:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:46:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:46:58 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6dfc356b-953a-47b0-9da7-70cc59a80853 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:46:58 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance eec545e8-eeda-443c-9892-980e19e7267a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:46:58 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4b489f97-c8d4-4a6a-8404-e1a05a990261 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:46:58 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 98fa0e64-cf36-4991-924d-ba4b713239d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:46:58 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:46:58 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 5df2a7ef-16c7-4e37-9534-41d95d96af41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:46:58 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:46:58 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:46:58 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:46:58 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:46:58 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:46:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.489s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:47:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:02 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:47:02 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:47:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:47:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-4b489f97-c8d4-4a6a-8404-e1a05a990261" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:47:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-4b489f97-c8d4-4a6a-8404-e1a05a990261" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:47:03 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 00:47:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:03 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Updating instance_info_cache with network_info: [{"id": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "address": "fa:16:3e:31:6a:22", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da1cffd-22", "ovs_interfaceid": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:47:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-4b489f97-c8d4-4a6a-8404-e1a05a990261" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:47:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 00:47:03 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:47:03 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:47:03 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:47:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:47:04 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:47:05 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:47:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:08 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:47:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:56 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:47:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:47:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:47:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:47:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:47:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:47:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:47:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:47:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:47:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:47:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:47:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:47:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:47:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:47:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:47:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:47:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:47:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:47:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5702296d-3330-48c4-be37-86bc0d1ba5fa tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "98fa0e64-cf36-4991-924d-ba4b713239d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:47:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5702296d-3330-48c4-be37-86bc0d1ba5fa tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:47:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5702296d-3330-48c4-be37-86bc0d1ba5fa tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "98fa0e64-cf36-4991-924d-ba4b713239d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:47:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5702296d-3330-48c4-be37-86bc0d1ba5fa tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:47:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5702296d-3330-48c4-be37-86bc0d1ba5fa tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:47:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:47:57 user nova-compute[73010]: INFO nova.compute.manager [None req-5702296d-3330-48c4-be37-86bc0d1ba5fa tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Terminating instance
Aug 15 00:47:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-5702296d-3330-48c4-be37-86bc0d1ba5fa tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:47:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Instance destroyed successfully.
Aug 15 00:47:58 user nova-compute[73010]: DEBUG nova.objects.instance [None req-5702296d-3330-48c4-be37-86bc0d1ba5fa tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lazy-loading 'resources' on Instance uuid 98fa0e64-cf36-4991-924d-ba4b713239d0 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-5702296d-3330-48c4-be37-86bc0d1ba5fa tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:40:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-304817032',display_name='tempest-SnapshotDataIntegrityTests-server-304817032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-304817032',id=25,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY54/EgYt4W0qvyeF/aN/F8rqDS+ylE79NBq8EcYzK6Hmlas8ouy0yhXyZDr8lRactFtWwAxEA3NTeLXfjOKaJtoZGFr7rbjM8SotRYfIl14kMUCRYhVgskN7H5bNugkA==',key_name='tempest-keypair-556569916',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:40:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a5a9782c512458e971f2bdf28a579c1',ramdisk_id='',reservation_id='r-jnh6gc0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-293008731',owner_user_name='tempest-SnapshotDataIntegrityTests-293008731-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:40:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61790feda8a743949f630b35d9a48935',uuid=98fa0e64-cf36-4991-924d-ba4b713239d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db655edd-5181-47db-ba3c-4a79af26528e", "address": "fa:16:3e:1d:6a:3d", "network": {"id": "536a7c12-166a-4d44-b705-ea1ac348601d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-841639308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5a9782c512458e971f2bdf28a579c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb655edd-51", "ovs_interfaceid": "db655edd-5181-47db-ba3c-4a79af26528e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-5702296d-3330-48c4-be37-86bc0d1ba5fa tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Converting VIF {"id": "db655edd-5181-47db-ba3c-4a79af26528e", "address": "fa:16:3e:1d:6a:3d", "network": {"id": "536a7c12-166a-4d44-b705-ea1ac348601d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-841639308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5a9782c512458e971f2bdf28a579c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb655edd-51", "ovs_interfaceid": "db655edd-5181-47db-ba3c-4a79af26528e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-5702296d-3330-48c4-be37-86bc0d1ba5fa tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:6a:3d,bridge_name='br-int',has_traffic_filtering=True,id=db655edd-5181-47db-ba3c-4a79af26528e,network=Network(536a7c12-166a-4d44-b705-ea1ac348601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb655edd-51') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG os_vif [None req-5702296d-3330-48c4-be37-86bc0d1ba5fa tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:6a:3d,bridge_name='br-int',has_traffic_filtering=True,id=db655edd-5181-47db-ba3c-4a79af26528e,network=Network(536a7c12-166a-4d44-b705-ea1ac348601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb655edd-51') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb655edd-51, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:58 user nova-compute[73010]: INFO os_vif [None req-5702296d-3330-48c4-be37-86bc0d1ba5fa tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:6a:3d,bridge_name='br-int',has_traffic_filtering=True,id=db655edd-5181-47db-ba3c-4a79af26528e,network=Network(536a7c12-166a-4d44-b705-ea1ac348601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb655edd-51')
Aug 15 00:47:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-5702296d-3330-48c4-be37-86bc0d1ba5fa tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Deleting instance files /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0_del
Aug 15 00:47:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-5702296d-3330-48c4-be37-86bc0d1ba5fa tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Deletion of /opt/stack/data/nova/instances/98fa0e64-cf36-4991-924d-ba4b713239d0_del complete
Aug 15 00:47:58 user nova-compute[73010]: DEBUG nova.compute.manager [req-592e91e1-5f38-490d-a763-a93092705946 req-16cd549d-3374-431e-941d-f7c7b6407a89 service nova] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Received event network-vif-unplugged-db655edd-5181-47db-ba3c-4a79af26528e {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-592e91e1-5f38-490d-a763-a93092705946 req-16cd549d-3374-431e-941d-f7c7b6407a89 service nova] Acquiring lock "98fa0e64-cf36-4991-924d-ba4b713239d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-592e91e1-5f38-490d-a763-a93092705946 req-16cd549d-3374-431e-941d-f7c7b6407a89 service nova] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-592e91e1-5f38-490d-a763-a93092705946 req-16cd549d-3374-431e-941d-f7c7b6407a89 service nova] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG nova.compute.manager [req-592e91e1-5f38-490d-a763-a93092705946 req-16cd549d-3374-431e-941d-f7c7b6407a89 service nova] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] No waiting events found dispatching network-vif-unplugged-db655edd-5181-47db-ba3c-4a79af26528e {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG nova.compute.manager [req-592e91e1-5f38-490d-a763-a93092705946 req-16cd549d-3374-431e-941d-f7c7b6407a89 service nova] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Received event network-vif-unplugged-db655edd-5181-47db-ba3c-4a79af26528e for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:47:58 user nova-compute[73010]: INFO nova.compute.manager [None req-5702296d-3330-48c4-be37-86bc0d1ba5fa tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 15 00:47:58 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-5702296d-3330-48c4-be37-86bc0d1ba5fa tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:47:58 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:47:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:47:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:47:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:47:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:47:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:47:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:47:59 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:47:59 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:47:59 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=7993MB free_disk=25.612152099609375GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:47:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:47:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:47:59 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6dfc356b-953a-47b0-9da7-70cc59a80853 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:48:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance eec545e8-eeda-443c-9892-980e19e7267a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:48:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4b489f97-c8d4-4a6a-8404-e1a05a990261 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:48:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 98fa0e64-cf36-4991-924d-ba4b713239d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:48:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:48:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 5df2a7ef-16c7-4e37-9534-41d95d96af41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:48:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:48:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:48:00 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:48:00 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Took 1.17 seconds to deallocate network for instance.
Aug 15 00:48:00 user nova-compute[73010]: DEBUG nova.compute.manager [req-f582205b-526a-49af-aa77-6c481ce93892 req-ba3edb0a-f99a-4e95-89ff-5fbddf18c5ea service nova] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Received event network-vif-deleted-db655edd-5181-47db-ba3c-4a79af26528e {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:48:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5702296d-3330-48c4-be37-86bc0d1ba5fa tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:00 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:48:00 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:48:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:48:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5702296d-3330-48c4-be37-86bc0d1ba5fa tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.129s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:00 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-5702296d-3330-48c4-be37-86bc0d1ba5fa tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:48:00 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-5702296d-3330-48c4-be37-86bc0d1ba5fa tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:48:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5702296d-3330-48c4-be37-86bc0d1ba5fa tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:00 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-5702296d-3330-48c4-be37-86bc0d1ba5fa tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Deleted allocations for instance 98fa0e64-cf36-4991-924d-ba4b713239d0
Aug 15 00:48:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5702296d-3330-48c4-be37-86bc0d1ba5fa tempest-SnapshotDataIntegrityTests-293008731 tempest-SnapshotDataIntegrityTests-293008731-project-member] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.772s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:00 user nova-compute[73010]: DEBUG nova.compute.manager [req-e111b004-bace-4d51-981c-892161e340e7 req-21d48352-77a5-4f38-a23c-ccb73fdcc897 service nova] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Received event network-vif-plugged-db655edd-5181-47db-ba3c-4a79af26528e {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:48:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e111b004-bace-4d51-981c-892161e340e7 req-21d48352-77a5-4f38-a23c-ccb73fdcc897 service nova] Acquiring lock "98fa0e64-cf36-4991-924d-ba4b713239d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e111b004-bace-4d51-981c-892161e340e7 req-21d48352-77a5-4f38-a23c-ccb73fdcc897 service nova] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e111b004-bace-4d51-981c-892161e340e7 req-21d48352-77a5-4f38-a23c-ccb73fdcc897 service nova] Lock "98fa0e64-cf36-4991-924d-ba4b713239d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:00 user nova-compute[73010]: DEBUG nova.compute.manager [req-e111b004-bace-4d51-981c-892161e340e7 req-21d48352-77a5-4f38-a23c-ccb73fdcc897 service nova] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] No waiting events found dispatching network-vif-plugged-db655edd-5181-47db-ba3c-4a79af26528e {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:48:00 user nova-compute[73010]: WARNING nova.compute.manager [req-e111b004-bace-4d51-981c-892161e340e7 req-21d48352-77a5-4f38-a23c-ccb73fdcc897 service nova] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Received unexpected event network-vif-plugged-db655edd-5181-47db-ba3c-4a79af26528e for instance with vm_state deleted and task_state None.
Aug 15 00:48:01 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:48:01 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:48:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:48:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:48:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:48:01 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 00:48:03 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Updating instance_info_cache with network_info: [{"id": "80cc26e3-8a79-465a-9976-59be5d7eeb72", "address": "fa:16:3e:5d:1f:42", "network": {"id": "2f9cb7ad-5cb3-4458-993a-780ab047d4e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-145440789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09136fc9ddd9408892ac461a306a1618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cc26e3-8a", "ovs_interfaceid": "80cc26e3-8a79-465a-9976-59be5d7eeb72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:48:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "31f8bcac-6874-4619-928a-a04a3a94ffa5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "31f8bcac-6874-4619-928a-a04a3a94ffa5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:48:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 00:48:03 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:48:03 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:48:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:48:03 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:48:03 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:48:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:48:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:48:03 user nova-compute[73010]: INFO nova.compute.claims [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Claim successful on node user
Aug 15 00:48:03 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:48:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:03 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:48:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:48:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:48:03 user nova-compute[73010]: DEBUG nova.network.neutron [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:48:03 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:48:04 user nova-compute[73010]: DEBUG nova.compute.manager [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:48:04 user nova-compute[73010]: INFO nova.virt.block_device [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Booting with volume snapshot 11ced550-c945-4a4b-9977-be39094e3ba6 at /dev/vda
Aug 15 00:48:04 user nova-compute[73010]: DEBUG nova.policy [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'daa4eb788f724a6fbf908b029315a02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67d1031d3cb4c8fb66342a7888ca1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:48:04 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:48:04 user nova-compute[73010]: DEBUG nova.network.neutron [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Successfully created port: d62f7ba0-c61b-48e3-9013-5ad445d717d3 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:48:05 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:48:05 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:48:05 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Cleaning up deleted instances {{(pid=73010) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 00:48:05 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] There are 0 instances to clean {{(pid=73010) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 00:48:05 user nova-compute[73010]: DEBUG nova.network.neutron [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Successfully updated port: d62f7ba0-c61b-48e3-9013-5ad445d717d3 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:48:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "refresh_cache-31f8bcac-6874-4619-928a-a04a3a94ffa5" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:48:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquired lock "refresh_cache-31f8bcac-6874-4619-928a-a04a3a94ffa5" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:48:05 user nova-compute[73010]: DEBUG nova.network.neutron [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:48:05 user nova-compute[73010]: DEBUG nova.compute.manager [req-67894f5e-3576-41d8-8e2e-facd9a145b37 req-96ab1e12-27c4-458a-84d6-dcfce1c7aa58 service nova] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Received event network-changed-d62f7ba0-c61b-48e3-9013-5ad445d717d3 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:48:05 user nova-compute[73010]: DEBUG nova.compute.manager [req-67894f5e-3576-41d8-8e2e-facd9a145b37 req-96ab1e12-27c4-458a-84d6-dcfce1c7aa58 service nova] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Refreshing instance network info cache due to event network-changed-d62f7ba0-c61b-48e3-9013-5ad445d717d3. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:48:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-67894f5e-3576-41d8-8e2e-facd9a145b37 req-96ab1e12-27c4-458a-84d6-dcfce1c7aa58 service nova] Acquiring lock "refresh_cache-31f8bcac-6874-4619-928a-a04a3a94ffa5" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:48:05 user nova-compute[73010]: DEBUG nova.network.neutron [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:48:06 user nova-compute[73010]: DEBUG nova.network.neutron [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Updating instance_info_cache with network_info: [{"id": "d62f7ba0-c61b-48e3-9013-5ad445d717d3", "address": "fa:16:3e:5c:27:02", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62f7ba0-c6", "ovs_interfaceid": "d62f7ba0-c61b-48e3-9013-5ad445d717d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:48:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Releasing lock "refresh_cache-31f8bcac-6874-4619-928a-a04a3a94ffa5" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:48:06 user nova-compute[73010]: DEBUG nova.compute.manager [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Instance network_info: |[{"id": "d62f7ba0-c61b-48e3-9013-5ad445d717d3", "address": "fa:16:3e:5c:27:02", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62f7ba0-c6", "ovs_interfaceid": "d62f7ba0-c61b-48e3-9013-5ad445d717d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:48:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-67894f5e-3576-41d8-8e2e-facd9a145b37 req-96ab1e12-27c4-458a-84d6-dcfce1c7aa58 service nova] Acquired lock "refresh_cache-31f8bcac-6874-4619-928a-a04a3a94ffa5" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:48:06 user nova-compute[73010]: DEBUG nova.network.neutron [req-67894f5e-3576-41d8-8e2e-facd9a145b37 req-96ab1e12-27c4-458a-84d6-dcfce1c7aa58 service nova] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Refreshing network info cache for port d62f7ba0-c61b-48e3-9013-5ad445d717d3 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:48:06 user nova-compute[73010]: DEBUG nova.network.neutron [req-67894f5e-3576-41d8-8e2e-facd9a145b37 req-96ab1e12-27c4-458a-84d6-dcfce1c7aa58 service nova] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Updated VIF entry in instance network info cache for port d62f7ba0-c61b-48e3-9013-5ad445d717d3. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:48:06 user nova-compute[73010]: DEBUG nova.network.neutron [req-67894f5e-3576-41d8-8e2e-facd9a145b37 req-96ab1e12-27c4-458a-84d6-dcfce1c7aa58 service nova] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Updating instance_info_cache with network_info: [{"id": "d62f7ba0-c61b-48e3-9013-5ad445d717d3", "address": "fa:16:3e:5c:27:02", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62f7ba0-c6", "ovs_interfaceid": "d62f7ba0-c61b-48e3-9013-5ad445d717d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:48:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-67894f5e-3576-41d8-8e2e-facd9a145b37 req-96ab1e12-27c4-458a-84d6-dcfce1c7aa58 service nova] Releasing lock "refresh_cache-31f8bcac-6874-4619-928a-a04a3a94ffa5" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:48:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:09 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:48:09 user nova-compute[73010]: DEBUG os_brick.utils [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:48:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b812b3-d431-4fc3-a66f-d527cabb9b07]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[626ca816-b8b3-406c-b0fb-a6cbe6d51477]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e462de1-355b-4ea0-a019-58ac590a4a69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c7a7ed-06a6-4fc5-a0f4-3427c009c708]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:48:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:48:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:48:10 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:48:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ca2390-0533-4044-91fe-da6d9b0f5d65]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:48:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:48:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:48:10 user nova-compute[73010]: DEBUG os_brick.utils [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:48:10 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Updating existing volume attachment record: 6de8afbc-bab0-4113-887e-f531d1aa8102 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_power_states {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:48:13 user nova-compute[73010]: WARNING nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] While synchronizing instance power states, found 6 instances in the database and 5 instances on the hypervisor.
Aug 15 00:48:13 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid 6dfc356b-953a-47b0-9da7-70cc59a80853 {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid eec545e8-eeda-443c-9892-980e19e7267a {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid 4b489f97-c8d4-4a6a-8404-e1a05a990261 {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09 {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid 5df2a7ef-16c7-4e37-9534-41d95d96af41 {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid 31f8bcac-6874-4619-928a-a04a3a94ffa5 {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "6dfc356b-953a-47b0-9da7-70cc59a80853" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "6dfc356b-953a-47b0-9da7-70cc59a80853" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "eec545e8-eeda-443c-9892-980e19e7267a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "eec545e8-eeda-443c-9892-980e19e7267a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "4b489f97-c8d4-4a6a-8404-e1a05a990261" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "4b489f97-c8d4-4a6a-8404-e1a05a990261" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "5df2a7ef-16c7-4e37-9534-41d95d96af41" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "5df2a7ef-16c7-4e37-9534-41d95d96af41" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "31f8bcac-6874-4619-928a-a04a3a94ffa5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "4b489f97-c8d4-4a6a-8404-e1a05a990261" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "6dfc356b-953a-47b0-9da7-70cc59a80853" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "eec545e8-eeda-443c-9892-980e19e7267a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "5df2a7ef-16c7-4e37-9534-41d95d96af41" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060478.7835019, 98fa0e64-cf36-4991-924d-ba4b713239d0 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:48:13 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] VM Stopped (Lifecycle Event)
Aug 15 00:48:13 user nova-compute[73010]: DEBUG nova.compute.manager [None req-417870d1-6c68-41a7-a2b1-2e613e5e3516 None None] [instance: 98fa0e64-cf36-4991-924d-ba4b713239d0] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:48:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:48:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:17 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:48:17 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73010) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 00:48:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:48:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:48:18 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Creating image(s)
Aug 15 00:48:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Did not create local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 00:48:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Ensure instance console log exists: /opt/stack/data/nova/instances/31f8bcac-6874-4619-928a-a04a3a94ffa5/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:48:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Start _get_guest_xml network_info=[{"id": "d62f7ba0-c61b-48e3-9013-5ad445d717d3", "address": "fa:16:3e:5c:27:02", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62f7ba0-c6", "ovs_interfaceid": "d62f7ba0-c61b-48e3-9013-5ad445d717d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mdSDOaNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '31f8bcac-6874-4619-928a-a04a3a94ffa5', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4738138-3d55-46c1-8050-9c3fd62e42f5', 'serial': 'b4738138-3d55-46c1-8050-9c3fd62e42f5'}, 'disk_bus': 'virtio', 'attachment_id': '6de8afbc-bab0-4113-887e-f531d1aa8102', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:48:18 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:48:18 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:48:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:48:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:48:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:48:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:48:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:48:18 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:48:18 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:48:18 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:48:18 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:48:18 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:48:18 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:48:18 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:48:18 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:48:18 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:48:18 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:48:18 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mdSDOaNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:48:19 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:48:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:48:19 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:48:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:48:19 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8c3396-6b4c-4265-8617-80b26c1cce0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:48:19 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda8e932-7436-4075-9c19-cc09d721899a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5] added
Aug 15 00:48:19 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ba1cd7-0280-4fd2-957a-48d652d51fd2]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[127d11d6-adb7-424b-8767-394dd027ea82]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mdSDOaNK {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mdSDOaNK" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[924594bd-265c-4575-9baf-7b5581bf4e2f]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mdSDOaNK'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d57fd32-75a4-49bf-b836-107f1cf5f1ec]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf9b441-b0e9-4d22-8679-1cbdf33f2383]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 00:48:19 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 00:48:19 user nova-compute[73010]:  {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:48:19 user nova-compute[73010]: WARNING os_brick.initiator.connectors.iscsi [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 00:48:19 user nova-compute[73010]: 
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cffa76-c33f-483f-8e4d-5731f0d22232]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5, portal: 172.16.0.220,3260]
Aug 15 00:48:19 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5, portal: 172.16.0.220,3260] successful.
Aug 15 00:48:19 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1926f379-b3f0-411f-89c4-cdec1e92ff52]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5640f278-9c58-4979-96b2-470860a4c795]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 (non-flash)
Aug 15 00:48:19 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 (non-flash)
Aug 15 00:48:19 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[11093379-f3d6-453d-a70e-a6c0b2e9070f]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:19 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:48:20 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:48:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mdSDOaNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:48:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:48:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26461346339376163', 'path': '/dev/sdb'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:48:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461346339376163', 'path': '/dev/sdb'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:48:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:48:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-14755846',display_name='tempest-TestVolumeBootPattern-server-14755846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-14755846',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f67d1031d3cb4c8fb66342a7888ca1c4',ramdisk_id='',reservation_id='r-zmtad059',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1953358779',owner_user_name='tempest-TestVolumeBootPattern-1953358779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:48:04Z,user_data=None,user_id='daa4eb788f724a6fbf908b029315a02b',uuid=31f8bcac-6874-4619-928a-a04a3a94ffa5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d62f7ba0-c61b-48e3-9013-5ad445d717d3", "address": "fa:16:3e:5c:27:02", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62f7ba0-c6", "ovs_interfaceid": "d62f7ba0-c61b-48e3-9013-5ad445d717d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:48:20 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converting VIF {"id": "d62f7ba0-c61b-48e3-9013-5ad445d717d3", "address": "fa:16:3e:5c:27:02", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62f7ba0-c6", "ovs_interfaceid": "d62f7ba0-c61b-48e3-9013-5ad445d717d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:48:20 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:27:02,bridge_name='br-int',has_traffic_filtering=True,id=d62f7ba0-c61b-48e3-9013-5ad445d717d3,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd62f7ba0-c6') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:48:20 user nova-compute[73010]: DEBUG nova.objects.instance [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lazy-loading 'pci_devices' on Instance uuid 31f8bcac-6874-4619-928a-a04a3a94ffa5 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:48:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:48:20 user nova-compute[73010]:   <uuid>31f8bcac-6874-4619-928a-a04a3a94ffa5</uuid>
Aug 15 00:48:20 user nova-compute[73010]:   <name>instance-00000021</name>
Aug 15 00:48:20 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:48:20 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:48:20 user nova-compute[73010]:   <metadata>
Aug 15 00:48:20 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:48:20 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:48:20 user nova-compute[73010]:       <nova:name>tempest-TestVolumeBootPattern-server-14755846</nova:name>
Aug 15 00:48:20 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:48:18</nova:creationTime>
Aug 15 00:48:20 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:48:20 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:48:20 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:48:20 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:48:20 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:48:20 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:48:20 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:48:20 user nova-compute[73010]:       <nova:owner>
Aug 15 00:48:20 user nova-compute[73010]:         <nova:user uuid="daa4eb788f724a6fbf908b029315a02b">tempest-TestVolumeBootPattern-1953358779-project-member</nova:user>
Aug 15 00:48:20 user nova-compute[73010]:         <nova:project uuid="f67d1031d3cb4c8fb66342a7888ca1c4">tempest-TestVolumeBootPattern-1953358779</nova:project>
Aug 15 00:48:20 user nova-compute[73010]:       </nova:owner>
Aug 15 00:48:20 user nova-compute[73010]:       <nova:ports>
Aug 15 00:48:20 user nova-compute[73010]:         <nova:port uuid="d62f7ba0-c61b-48e3-9013-5ad445d717d3">
Aug 15 00:48:20 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 00:48:20 user nova-compute[73010]:         </nova:port>
Aug 15 00:48:20 user nova-compute[73010]:       </nova:ports>
Aug 15 00:48:20 user nova-compute[73010]:     </nova:instance>
Aug 15 00:48:20 user nova-compute[73010]:   </metadata>
Aug 15 00:48:20 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:48:20 user nova-compute[73010]:     <system>
Aug 15 00:48:20 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:48:20 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:48:20 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:48:20 user nova-compute[73010]:       <entry name="serial">31f8bcac-6874-4619-928a-a04a3a94ffa5</entry>
Aug 15 00:48:20 user nova-compute[73010]:       <entry name="uuid">31f8bcac-6874-4619-928a-a04a3a94ffa5</entry>
Aug 15 00:48:20 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:48:20 user nova-compute[73010]:     </system>
Aug 15 00:48:20 user nova-compute[73010]:   </sysinfo>
Aug 15 00:48:20 user nova-compute[73010]:   <os>
Aug 15 00:48:20 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:48:20 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:48:20 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:48:20 user nova-compute[73010]:   </os>
Aug 15 00:48:20 user nova-compute[73010]:   <features>
Aug 15 00:48:20 user nova-compute[73010]:     <acpi/>
Aug 15 00:48:20 user nova-compute[73010]:     <apic/>
Aug 15 00:48:20 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:48:20 user nova-compute[73010]:   </features>
Aug 15 00:48:20 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:48:20 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:48:20 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:48:20 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:48:20 user nova-compute[73010]:   </clock>
Aug 15 00:48:20 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:48:20 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:48:20 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:48:20 user nova-compute[73010]:   </cpu>
Aug 15 00:48:20 user nova-compute[73010]:   <devices>
Aug 15 00:48:20 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 00:48:20 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:48:20 user nova-compute[73010]:       <source dev="/dev/sdb"/>
Aug 15 00:48:20 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:48:20 user nova-compute[73010]:       <serial>b4738138-3d55-46c1-8050-9c3fd62e42f5</serial>
Aug 15 00:48:20 user nova-compute[73010]:     </disk>
Aug 15 00:48:20 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:48:20 user nova-compute[73010]:       <mac address="fa:16:3e:5c:27:02"/>
Aug 15 00:48:20 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:48:20 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:48:20 user nova-compute[73010]:       <target dev="tapd62f7ba0-c6"/>
Aug 15 00:48:20 user nova-compute[73010]:     </interface>
Aug 15 00:48:20 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:48:20 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/31f8bcac-6874-4619-928a-a04a3a94ffa5/console.log" append="off"/>
Aug 15 00:48:20 user nova-compute[73010]:     </serial>
Aug 15 00:48:20 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:48:20 user nova-compute[73010]:     <video>
Aug 15 00:48:20 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:48:20 user nova-compute[73010]:     </video>
Aug 15 00:48:20 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:48:20 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:48:20 user nova-compute[73010]:     </rng>
Aug 15 00:48:20 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:48:20 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:48:20 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:48:20 user nova-compute[73010]:     </memballoon>
Aug 15 00:48:20 user nova-compute[73010]:   </devices>
Aug 15 00:48:20 user nova-compute[73010]: </domain>
Aug 15 00:48:20 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:48:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:48:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-14755846',display_name='tempest-TestVolumeBootPattern-server-14755846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-14755846',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f67d1031d3cb4c8fb66342a7888ca1c4',ramdisk_id='',reservation_id='r-zmtad059',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1953358779',owner_user_name='tempest-TestVolumeBootPattern-1953358779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:48:04Z,user_data=None,user_id='daa4eb788f724a6fbf908b029315a02b',uuid=31f8bcac-6874-4619-928a-a04a3a94ffa5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d62f7ba0-c61b-48e3-9013-5ad445d717d3", "address": "fa:16:3e:5c:27:02", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62f7ba0-c6", "ovs_interfaceid": "d62f7ba0-c61b-48e3-9013-5ad445d717d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:48:20 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converting VIF {"id": "d62f7ba0-c61b-48e3-9013-5ad445d717d3", "address": "fa:16:3e:5c:27:02", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62f7ba0-c6", "ovs_interfaceid": "d62f7ba0-c61b-48e3-9013-5ad445d717d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:48:20 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:27:02,bridge_name='br-int',has_traffic_filtering=True,id=d62f7ba0-c61b-48e3-9013-5ad445d717d3,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd62f7ba0-c6') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:48:20 user nova-compute[73010]: DEBUG os_vif [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:27:02,bridge_name='br-int',has_traffic_filtering=True,id=d62f7ba0-c61b-48e3-9013-5ad445d717d3,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd62f7ba0-c6') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:48:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:48:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:48:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd62f7ba0-c6, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:48:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd62f7ba0-c6, col_values=(('external_ids', {'iface-id': 'd62f7ba0-c61b-48e3-9013-5ad445d717d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:27:02', 'vm-uuid': '31f8bcac-6874-4619-928a-a04a3a94ffa5'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:48:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:48:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:20 user nova-compute[73010]: INFO os_vif [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:27:02,bridge_name='br-int',has_traffic_filtering=True,id=d62f7ba0-c61b-48e3-9013-5ad445d717d3,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd62f7ba0-c6')
Aug 15 00:48:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:48:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] No VIF found with MAC fa:16:3e:5c:27:02, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:48:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:22 user nova-compute[73010]: DEBUG nova.compute.manager [req-6403f26e-07b6-4108-89b2-aa54fadf30a2 req-bdbd746d-9eb8-4567-a92d-8a6fd96f11fe service nova] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Received event network-vif-plugged-d62f7ba0-c61b-48e3-9013-5ad445d717d3 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:48:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6403f26e-07b6-4108-89b2-aa54fadf30a2 req-bdbd746d-9eb8-4567-a92d-8a6fd96f11fe service nova] Acquiring lock "31f8bcac-6874-4619-928a-a04a3a94ffa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6403f26e-07b6-4108-89b2-aa54fadf30a2 req-bdbd746d-9eb8-4567-a92d-8a6fd96f11fe service nova] Lock "31f8bcac-6874-4619-928a-a04a3a94ffa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6403f26e-07b6-4108-89b2-aa54fadf30a2 req-bdbd746d-9eb8-4567-a92d-8a6fd96f11fe service nova] Lock "31f8bcac-6874-4619-928a-a04a3a94ffa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:22 user nova-compute[73010]: DEBUG nova.compute.manager [req-6403f26e-07b6-4108-89b2-aa54fadf30a2 req-bdbd746d-9eb8-4567-a92d-8a6fd96f11fe service nova] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] No waiting events found dispatching network-vif-plugged-d62f7ba0-c61b-48e3-9013-5ad445d717d3 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:48:22 user nova-compute[73010]: WARNING nova.compute.manager [req-6403f26e-07b6-4108-89b2-aa54fadf30a2 req-bdbd746d-9eb8-4567-a92d-8a6fd96f11fe service nova] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Received unexpected event network-vif-plugged-d62f7ba0-c61b-48e3-9013-5ad445d717d3 for instance with vm_state building and task_state spawning.
Aug 15 00:48:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:24 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060504.066607, 31f8bcac-6874-4619-928a-a04a3a94ffa5 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:48:24 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] VM Resumed (Lifecycle Event)
Aug 15 00:48:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:48:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:48:24 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Instance spawned successfully.
Aug 15 00:48:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:48:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:48:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:48:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:48:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:48:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:48:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:48:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:48:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:48:24 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:48:24 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060504.0721502, 31f8bcac-6874-4619-928a-a04a3a94ffa5 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:48:24 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] VM Started (Lifecycle Event)
Aug 15 00:48:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:48:24 user nova-compute[73010]: INFO nova.compute.manager [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Took 5.25 seconds to spawn the instance on the hypervisor.
Aug 15 00:48:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:48:24 user nova-compute[73010]: DEBUG nova.compute.manager [req-954c82cd-c4bd-47f8-ac2f-0d03f6f55b9a req-5914b3bc-038b-43f6-93e6-4af2be351305 service nova] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Received event network-vif-plugged-d62f7ba0-c61b-48e3-9013-5ad445d717d3 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:48:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-954c82cd-c4bd-47f8-ac2f-0d03f6f55b9a req-5914b3bc-038b-43f6-93e6-4af2be351305 service nova] Acquiring lock "31f8bcac-6874-4619-928a-a04a3a94ffa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-954c82cd-c4bd-47f8-ac2f-0d03f6f55b9a req-5914b3bc-038b-43f6-93e6-4af2be351305 service nova] Lock "31f8bcac-6874-4619-928a-a04a3a94ffa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-954c82cd-c4bd-47f8-ac2f-0d03f6f55b9a req-5914b3bc-038b-43f6-93e6-4af2be351305 service nova] Lock "31f8bcac-6874-4619-928a-a04a3a94ffa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:24 user nova-compute[73010]: DEBUG nova.compute.manager [req-954c82cd-c4bd-47f8-ac2f-0d03f6f55b9a req-5914b3bc-038b-43f6-93e6-4af2be351305 service nova] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] No waiting events found dispatching network-vif-plugged-d62f7ba0-c61b-48e3-9013-5ad445d717d3 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:48:24 user nova-compute[73010]: WARNING nova.compute.manager [req-954c82cd-c4bd-47f8-ac2f-0d03f6f55b9a req-5914b3bc-038b-43f6-93e6-4af2be351305 service nova] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Received unexpected event network-vif-plugged-d62f7ba0-c61b-48e3-9013-5ad445d717d3 for instance with vm_state building and task_state spawning.
Aug 15 00:48:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:48:24 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:48:24 user nova-compute[73010]: INFO nova.compute.manager [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Took 20.74 seconds to build instance.
Aug 15 00:48:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-956af990-e542-4029-992a-a6125dcf159e tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "31f8bcac-6874-4619-928a-a04a3a94ffa5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.999s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "31f8bcac-6874-4619-928a-a04a3a94ffa5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 10.751s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:24 user nova-compute[73010]: INFO nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 15 00:48:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "31f8bcac-6874-4619-928a-a04a3a94ffa5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:25 user nova-compute[73010]: DEBUG nova.compute.manager [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:48:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:25 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:48:25 user nova-compute[73010]: INFO nova.compute.claims [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Claim successful on node user
Aug 15 00:48:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:25 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:48:25 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:48:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:25 user nova-compute[73010]: DEBUG nova.compute.manager [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:48:25 user nova-compute[73010]: DEBUG nova.compute.manager [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:48:25 user nova-compute[73010]: DEBUG nova.network.neutron [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:48:25 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:48:25 user nova-compute[73010]: DEBUG nova.compute.manager [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:48:25 user nova-compute[73010]: DEBUG nova.compute.manager [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:48:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:48:25 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Creating image(s)
Aug 15 00:48:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "/opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "/opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "/opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.190s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG nova.policy [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd89d0afcfdc549b391c4c37c04b54b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4dad0b4fa44c61b6cae2227e6b77d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.333s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01/disk 1073741824" returned: 0 in 0.058s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.397s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.189s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG nova.compute.manager [req-00e11a4f-bf6f-4f42-97d1-a0916a3f8b02 req-98916825-f947-4540-b720-4af1a867445d service nova] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Received event network-changed-7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG nova.compute.manager [req-00e11a4f-bf6f-4f42-97d1-a0916a3f8b02 req-98916825-f947-4540-b720-4af1a867445d service nova] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Refreshing instance network info cache due to event network-changed-7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-00e11a4f-bf6f-4f42-97d1-a0916a3f8b02 req-98916825-f947-4540-b720-4af1a867445d service nova] Acquiring lock "refresh_cache-5df2a7ef-16c7-4e37-9534-41d95d96af41" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-00e11a4f-bf6f-4f42-97d1-a0916a3f8b02 req-98916825-f947-4540-b720-4af1a867445d service nova] Acquired lock "refresh_cache-5df2a7ef-16c7-4e37-9534-41d95d96af41" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG nova.network.neutron [req-00e11a4f-bf6f-4f42-97d1-a0916a3f8b02 req-98916825-f947-4540-b720-4af1a867445d service nova] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Refreshing network info cache for port 7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Cannot resize image /opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG nova.objects.instance [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lazy-loading 'migration_context' on Instance uuid 9105f21a-ae71-43de-9ec7-2911ed2f5a01 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Ensure instance console log exists: /opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:27 user nova-compute[73010]: DEBUG nova.network.neutron [req-00e11a4f-bf6f-4f42-97d1-a0916a3f8b02 req-98916825-f947-4540-b720-4af1a867445d service nova] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Updated VIF entry in instance network info cache for port 7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:48:27 user nova-compute[73010]: DEBUG nova.network.neutron [req-00e11a4f-bf6f-4f42-97d1-a0916a3f8b02 req-98916825-f947-4540-b720-4af1a867445d service nova] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Updating instance_info_cache with network_info: [{"id": "7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9", "address": "fa:16:3e:fd:5a:8b", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edc2bb1-66", "ovs_interfaceid": "7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:48:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-00e11a4f-bf6f-4f42-97d1-a0916a3f8b02 req-98916825-f947-4540-b720-4af1a867445d service nova] Releasing lock "refresh_cache-5df2a7ef-16c7-4e37-9534-41d95d96af41" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:48:27 user nova-compute[73010]: DEBUG nova.network.neutron [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Successfully created port: a0b20ef5-895b-4455-a38d-a8cca288213f {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:48:28 user nova-compute[73010]: DEBUG nova.network.neutron [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Successfully updated port: a0b20ef5-895b-4455-a38d-a8cca288213f {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:48:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "refresh_cache-9105f21a-ae71-43de-9ec7-2911ed2f5a01" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:48:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquired lock "refresh_cache-9105f21a-ae71-43de-9ec7-2911ed2f5a01" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:48:28 user nova-compute[73010]: DEBUG nova.network.neutron [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:48:28 user nova-compute[73010]: DEBUG nova.network.neutron [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:48:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-83075bc3-983a-45fe-b767-ffe9225f02c0 req-40425945-198d-4ad3-a1d6-e0d57e41959a service nova] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Received event network-changed-a0b20ef5-895b-4455-a38d-a8cca288213f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:48:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-83075bc3-983a-45fe-b767-ffe9225f02c0 req-40425945-198d-4ad3-a1d6-e0d57e41959a service nova] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Refreshing instance network info cache due to event network-changed-a0b20ef5-895b-4455-a38d-a8cca288213f. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:48:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-83075bc3-983a-45fe-b767-ffe9225f02c0 req-40425945-198d-4ad3-a1d6-e0d57e41959a service nova] Acquiring lock "refresh_cache-9105f21a-ae71-43de-9ec7-2911ed2f5a01" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.network.neutron [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Updating instance_info_cache with network_info: [{"id": "a0b20ef5-895b-4455-a38d-a8cca288213f", "address": "fa:16:3e:ac:d2:eb", "network": {"id": "97be784b-67e7-46e9-949a-510d7c526338", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207062863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4dad0b4fa44c61b6cae2227e6b77d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b20ef5-89", "ovs_interfaceid": "a0b20ef5-895b-4455-a38d-a8cca288213f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Releasing lock "refresh_cache-9105f21a-ae71-43de-9ec7-2911ed2f5a01" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.compute.manager [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Instance network_info: |[{"id": "a0b20ef5-895b-4455-a38d-a8cca288213f", "address": "fa:16:3e:ac:d2:eb", "network": {"id": "97be784b-67e7-46e9-949a-510d7c526338", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207062863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4dad0b4fa44c61b6cae2227e6b77d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b20ef5-89", "ovs_interfaceid": "a0b20ef5-895b-4455-a38d-a8cca288213f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-83075bc3-983a-45fe-b767-ffe9225f02c0 req-40425945-198d-4ad3-a1d6-e0d57e41959a service nova] Acquired lock "refresh_cache-9105f21a-ae71-43de-9ec7-2911ed2f5a01" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.network.neutron [req-83075bc3-983a-45fe-b767-ffe9225f02c0 req-40425945-198d-4ad3-a1d6-e0d57e41959a service nova] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Refreshing network info cache for port a0b20ef5-895b-4455-a38d-a8cca288213f {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Start _get_guest_xml network_info=[{"id": "a0b20ef5-895b-4455-a38d-a8cca288213f", "address": "fa:16:3e:ac:d2:eb", "network": {"id": "97be784b-67e7-46e9-949a-510d7c526338", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207062863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4dad0b4fa44c61b6cae2227e6b77d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b20ef5-89", "ovs_interfaceid": "a0b20ef5-895b-4455-a38d-a8cca288213f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:48:29 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:48:29 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:48:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1436139801',display_name='tempest-VolumesSnapshotTestJSON-instance-1436139801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1436139801',id=34,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3qRKJiwD5suiltPFSjmuMOjbPJfLxy+UTEDxxYvoy6dZaPruh3b2TcYfEuikJsSQPaOvmX3JxRvSCEpCxH0CBxUeYsvauuRdA2PLoeZaUzTJOI0yH0Q7kPz90irlm4og==',key_name='tempest-keypair-1576826465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca4dad0b4fa44c61b6cae2227e6b77d0',ramdisk_id='',reservation_id='r-yl57jn14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1973403028',owner_user_name='tempest-VolumesSnapshotTestJSON-1973403028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:48:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d89d0afcfdc549b391c4c37c04b54b91',uuid=9105f21a-ae71-43de-9ec7-2911ed2f5a01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0b20ef5-895b-4455-a38d-a8cca288213f", "address": "fa:16:3e:ac:d2:eb", "network": {"id": "97be784b-67e7-46e9-949a-510d7c526338", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207062863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4dad0b4fa44c61b6cae2227e6b77d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b20ef5-89", "ovs_interfaceid": "a0b20ef5-895b-4455-a38d-a8cca288213f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Converting VIF {"id": "a0b20ef5-895b-4455-a38d-a8cca288213f", "address": "fa:16:3e:ac:d2:eb", "network": {"id": "97be784b-67e7-46e9-949a-510d7c526338", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207062863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4dad0b4fa44c61b6cae2227e6b77d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b20ef5-89", "ovs_interfaceid": "a0b20ef5-895b-4455-a38d-a8cca288213f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:d2:eb,bridge_name='br-int',has_traffic_filtering=True,id=a0b20ef5-895b-4455-a38d-a8cca288213f,network=Network(97be784b-67e7-46e9-949a-510d7c526338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b20ef5-89') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.objects.instance [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lazy-loading 'pci_devices' on Instance uuid 9105f21a-ae71-43de-9ec7-2911ed2f5a01 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:48:29 user nova-compute[73010]:   <uuid>9105f21a-ae71-43de-9ec7-2911ed2f5a01</uuid>
Aug 15 00:48:29 user nova-compute[73010]:   <name>instance-00000022</name>
Aug 15 00:48:29 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:48:29 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:48:29 user nova-compute[73010]:   <metadata>
Aug 15 00:48:29 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:48:29 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:48:29 user nova-compute[73010]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1436139801</nova:name>
Aug 15 00:48:29 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:48:29</nova:creationTime>
Aug 15 00:48:29 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:48:29 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:48:29 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:48:29 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:48:29 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:48:29 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:48:29 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:48:29 user nova-compute[73010]:       <nova:owner>
Aug 15 00:48:29 user nova-compute[73010]:         <nova:user uuid="d89d0afcfdc549b391c4c37c04b54b91">tempest-VolumesSnapshotTestJSON-1973403028-project-member</nova:user>
Aug 15 00:48:29 user nova-compute[73010]:         <nova:project uuid="ca4dad0b4fa44c61b6cae2227e6b77d0">tempest-VolumesSnapshotTestJSON-1973403028</nova:project>
Aug 15 00:48:29 user nova-compute[73010]:       </nova:owner>
Aug 15 00:48:29 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:48:29 user nova-compute[73010]:       <nova:ports>
Aug 15 00:48:29 user nova-compute[73010]:         <nova:port uuid="a0b20ef5-895b-4455-a38d-a8cca288213f">
Aug 15 00:48:29 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 00:48:29 user nova-compute[73010]:         </nova:port>
Aug 15 00:48:29 user nova-compute[73010]:       </nova:ports>
Aug 15 00:48:29 user nova-compute[73010]:     </nova:instance>
Aug 15 00:48:29 user nova-compute[73010]:   </metadata>
Aug 15 00:48:29 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:48:29 user nova-compute[73010]:     <system>
Aug 15 00:48:29 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:48:29 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:48:29 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:48:29 user nova-compute[73010]:       <entry name="serial">9105f21a-ae71-43de-9ec7-2911ed2f5a01</entry>
Aug 15 00:48:29 user nova-compute[73010]:       <entry name="uuid">9105f21a-ae71-43de-9ec7-2911ed2f5a01</entry>
Aug 15 00:48:29 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:48:29 user nova-compute[73010]:     </system>
Aug 15 00:48:29 user nova-compute[73010]:   </sysinfo>
Aug 15 00:48:29 user nova-compute[73010]:   <os>
Aug 15 00:48:29 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:48:29 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:48:29 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:48:29 user nova-compute[73010]:   </os>
Aug 15 00:48:29 user nova-compute[73010]:   <features>
Aug 15 00:48:29 user nova-compute[73010]:     <acpi/>
Aug 15 00:48:29 user nova-compute[73010]:     <apic/>
Aug 15 00:48:29 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:48:29 user nova-compute[73010]:   </features>
Aug 15 00:48:29 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:48:29 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:48:29 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:48:29 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:48:29 user nova-compute[73010]:   </clock>
Aug 15 00:48:29 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:48:29 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:48:29 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:48:29 user nova-compute[73010]:   </cpu>
Aug 15 00:48:29 user nova-compute[73010]:   <devices>
Aug 15 00:48:29 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:48:29 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:48:29 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01/disk"/>
Aug 15 00:48:29 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:48:29 user nova-compute[73010]:     </disk>
Aug 15 00:48:29 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:48:29 user nova-compute[73010]:       <mac address="fa:16:3e:ac:d2:eb"/>
Aug 15 00:48:29 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:48:29 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:48:29 user nova-compute[73010]:       <target dev="tapa0b20ef5-89"/>
Aug 15 00:48:29 user nova-compute[73010]:     </interface>
Aug 15 00:48:29 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:48:29 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01/console.log" append="off"/>
Aug 15 00:48:29 user nova-compute[73010]:     </serial>
Aug 15 00:48:29 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:48:29 user nova-compute[73010]:     <video>
Aug 15 00:48:29 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:48:29 user nova-compute[73010]:     </video>
Aug 15 00:48:29 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:48:29 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:48:29 user nova-compute[73010]:     </rng>
Aug 15 00:48:29 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:48:29 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:48:29 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:48:29 user nova-compute[73010]:     </memballoon>
Aug 15 00:48:29 user nova-compute[73010]:   </devices>
Aug 15 00:48:29 user nova-compute[73010]: </domain>
Aug 15 00:48:29 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:48:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1436139801',display_name='tempest-VolumesSnapshotTestJSON-instance-1436139801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1436139801',id=34,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3qRKJiwD5suiltPFSjmuMOjbPJfLxy+UTEDxxYvoy6dZaPruh3b2TcYfEuikJsSQPaOvmX3JxRvSCEpCxH0CBxUeYsvauuRdA2PLoeZaUzTJOI0yH0Q7kPz90irlm4og==',key_name='tempest-keypair-1576826465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca4dad0b4fa44c61b6cae2227e6b77d0',ramdisk_id='',reservation_id='r-yl57jn14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1973403028',owner_user_name='tempest-VolumesSnapshotTestJSON-1973403028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:48:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d89d0afcfdc549b391c4c37c04b54b91',uuid=9105f21a-ae71-43de-9ec7-2911ed2f5a01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0b20ef5-895b-4455-a38d-a8cca288213f", "address": "fa:16:3e:ac:d2:eb", "network": {"id": "97be784b-67e7-46e9-949a-510d7c526338", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207062863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4dad0b4fa44c61b6cae2227e6b77d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b20ef5-89", "ovs_interfaceid": "a0b20ef5-895b-4455-a38d-a8cca288213f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Converting VIF {"id": "a0b20ef5-895b-4455-a38d-a8cca288213f", "address": "fa:16:3e:ac:d2:eb", "network": {"id": "97be784b-67e7-46e9-949a-510d7c526338", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207062863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4dad0b4fa44c61b6cae2227e6b77d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b20ef5-89", "ovs_interfaceid": "a0b20ef5-895b-4455-a38d-a8cca288213f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:d2:eb,bridge_name='br-int',has_traffic_filtering=True,id=a0b20ef5-895b-4455-a38d-a8cca288213f,network=Network(97be784b-67e7-46e9-949a-510d7c526338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b20ef5-89') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG os_vif [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:d2:eb,bridge_name='br-int',has_traffic_filtering=True,id=a0b20ef5-895b-4455-a38d-a8cca288213f,network=Network(97be784b-67e7-46e9-949a-510d7c526338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b20ef5-89') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0b20ef5-89, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa0b20ef5-89, col_values=(('external_ids', {'iface-id': 'a0b20ef5-895b-4455-a38d-a8cca288213f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:d2:eb', 'vm-uuid': '9105f21a-ae71-43de-9ec7-2911ed2f5a01'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:29 user nova-compute[73010]: INFO os_vif [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:d2:eb,bridge_name='br-int',has_traffic_filtering=True,id=a0b20ef5-895b-4455-a38d-a8cca288213f,network=Network(97be784b-67e7-46e9-949a-510d7c526338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b20ef5-89')
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] No VIF found with MAC fa:16:3e:ac:d2:eb, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.network.neutron [req-83075bc3-983a-45fe-b767-ffe9225f02c0 req-40425945-198d-4ad3-a1d6-e0d57e41959a service nova] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Updated VIF entry in instance network info cache for port a0b20ef5-895b-4455-a38d-a8cca288213f. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG nova.network.neutron [req-83075bc3-983a-45fe-b767-ffe9225f02c0 req-40425945-198d-4ad3-a1d6-e0d57e41959a service nova] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Updating instance_info_cache with network_info: [{"id": "a0b20ef5-895b-4455-a38d-a8cca288213f", "address": "fa:16:3e:ac:d2:eb", "network": {"id": "97be784b-67e7-46e9-949a-510d7c526338", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207062863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4dad0b4fa44c61b6cae2227e6b77d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b20ef5-89", "ovs_interfaceid": "a0b20ef5-895b-4455-a38d-a8cca288213f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:48:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-83075bc3-983a-45fe-b767-ffe9225f02c0 req-40425945-198d-4ad3-a1d6-e0d57e41959a service nova] Releasing lock "refresh_cache-9105f21a-ae71-43de-9ec7-2911ed2f5a01" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:48:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:31 user nova-compute[73010]: DEBUG nova.compute.manager [req-020601c6-36e8-4de3-8938-be187e8efe06 req-088e3a9e-26d8-4a90-a892-47b70b2b7c43 service nova] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Received event network-vif-plugged-a0b20ef5-895b-4455-a38d-a8cca288213f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:48:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-020601c6-36e8-4de3-8938-be187e8efe06 req-088e3a9e-26d8-4a90-a892-47b70b2b7c43 service nova] Acquiring lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-020601c6-36e8-4de3-8938-be187e8efe06 req-088e3a9e-26d8-4a90-a892-47b70b2b7c43 service nova] Lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-020601c6-36e8-4de3-8938-be187e8efe06 req-088e3a9e-26d8-4a90-a892-47b70b2b7c43 service nova] Lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:31 user nova-compute[73010]: DEBUG nova.compute.manager [req-020601c6-36e8-4de3-8938-be187e8efe06 req-088e3a9e-26d8-4a90-a892-47b70b2b7c43 service nova] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] No waiting events found dispatching network-vif-plugged-a0b20ef5-895b-4455-a38d-a8cca288213f {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:48:31 user nova-compute[73010]: WARNING nova.compute.manager [req-020601c6-36e8-4de3-8938-be187e8efe06 req-088e3a9e-26d8-4a90-a892-47b70b2b7c43 service nova] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Received unexpected event network-vif-plugged-a0b20ef5-895b-4455-a38d-a8cca288213f for instance with vm_state building and task_state spawning.
Aug 15 00:48:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "5df2a7ef-16c7-4e37-9534-41d95d96af41" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "5df2a7ef-16c7-4e37-9534-41d95d96af41" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:31 user nova-compute[73010]: DEBUG nova.objects.instance [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lazy-loading 'flavor' on Instance uuid 5df2a7ef-16c7-4e37-9534-41d95d96af41 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:48:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "5df2a7ef-16c7-4e37-9534-41d95d96af41" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "5df2a7ef-16c7-4e37-9534-41d95d96af41" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "5df2a7ef-16c7-4e37-9534-41d95d96af41" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:31 user nova-compute[73010]: INFO nova.compute.manager [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Attaching volume cb3b75ad-faef-4be0-b217-25d15f197051 to /dev/vdb
Aug 15 00:48:31 user nova-compute[73010]: DEBUG os_brick.utils [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:48:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[740481ba-0707-4768-8672-2715cf3f7fcb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbe4e18-a182-46b6-960b-49ba2a3a8742]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77dcaad-7032-444f-95c3-08cab3bdc287]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab2b269-e920-421e-96c3-6d3751d6c918]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:48:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:48:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:48:32 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:48:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5739415e-6fed-4be1-8872-8dd6a2fb1e42]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:48:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:48:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:48:32 user nova-compute[73010]: DEBUG os_brick.utils [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:48:32 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Updating existing volume attachment record: 4779f7a0-578e-4817-94bf-f343f57c15b9 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:48:33 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060513.1075473, 9105f21a-ae71-43de-9ec7-2911ed2f5a01 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:48:33 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] VM Resumed (Lifecycle Event)
Aug 15 00:48:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:48:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:48:33 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Instance spawned successfully.
Aug 15 00:48:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:48:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:48:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:48:33 user nova-compute[73010]: DEBUG nova.compute.manager [req-9a27e820-eb26-4736-ae94-69723554eb95 req-c34220d8-51ed-4214-ba5f-15a33bb58a40 service nova] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Received event network-vif-plugged-a0b20ef5-895b-4455-a38d-a8cca288213f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:48:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9a27e820-eb26-4736-ae94-69723554eb95 req-c34220d8-51ed-4214-ba5f-15a33bb58a40 service nova] Acquiring lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9a27e820-eb26-4736-ae94-69723554eb95 req-c34220d8-51ed-4214-ba5f-15a33bb58a40 service nova] Lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9a27e820-eb26-4736-ae94-69723554eb95 req-c34220d8-51ed-4214-ba5f-15a33bb58a40 service nova] Lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:33 user nova-compute[73010]: DEBUG nova.compute.manager [req-9a27e820-eb26-4736-ae94-69723554eb95 req-c34220d8-51ed-4214-ba5f-15a33bb58a40 service nova] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] No waiting events found dispatching network-vif-plugged-a0b20ef5-895b-4455-a38d-a8cca288213f {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:48:33 user nova-compute[73010]: WARNING nova.compute.manager [req-9a27e820-eb26-4736-ae94-69723554eb95 req-c34220d8-51ed-4214-ba5f-15a33bb58a40 service nova] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Received unexpected event network-vif-plugged-a0b20ef5-895b-4455-a38d-a8cca288213f for instance with vm_state building and task_state spawning.
Aug 15 00:48:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:48:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:48:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:48:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:48:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:48:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:48:33 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:48:33 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060513.1148145, 9105f21a-ae71-43de-9ec7-2911ed2f5a01 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:48:33 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] VM Started (Lifecycle Event)
Aug 15 00:48:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:48:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:48:33 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:48:33 user nova-compute[73010]: INFO nova.compute.manager [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Took 7.34 seconds to spawn the instance on the hypervisor.
Aug 15 00:48:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:48:33 user nova-compute[73010]: INFO nova.compute.manager [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Took 8.20 seconds to build instance.
Aug 15 00:48:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-26a714b9-29b1-4f42-a344-df512ffc20b6 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.311s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "f08393c9-17c8-40c0-b8de-e8b8237e9109" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:48:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:37 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:48:37 user nova-compute[73010]: INFO nova.compute.claims [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Claim successful on node user
Aug 15 00:48:38 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Refreshing inventories for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Updating ProviderTree inventory for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Updating inventory in ProviderTree for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Refreshing aggregate associations for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e, aggregates: None {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Refreshing trait associations for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.678s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG nova.compute.manager [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG nova.compute.manager [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG nova.network.neutron [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:48:38 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:48:38 user nova-compute[73010]: DEBUG nova.compute.manager [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:48:38 user nova-compute[73010]: INFO nova.virt.block_device [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Booting with volume 1f9498e6-7b0b-40c5-92cf-66016737f2e7 at /dev/vda
Aug 15 00:48:38 user nova-compute[73010]: DEBUG nova.policy [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0e48e71bb404f26926ac7a8176e04bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13115a64ccc24df68bdfda1fc72399c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG os_brick.utils [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c31936-98ac-4ce9-8c2c-875553626a71]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[135fb28c-7fe9-4d8f-9e00-9d795edb1393]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eee2d03-a745-4673-af4f-141c467ea53c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5d064e-0e7d-4db7-b7ed-ad76d6e0e55b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:48:38 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:48:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8020a3-938b-442b-b199-8bb95611cccb]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:48:38 user nova-compute[73010]: DEBUG os_brick.utils [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:48:39 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Updating existing volume attachment record: f765fb76-f1f8-4e86-8c56-4be8e36b7e92 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:48:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:39 user nova-compute[73010]: DEBUG nova.network.neutron [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Successfully created port: 03999c5a-8fca-4ceb-a7c4-f2361192421c {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:48:40 user nova-compute[73010]: DEBUG nova.network.neutron [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Successfully updated port: 03999c5a-8fca-4ceb-a7c4-f2361192421c {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:48:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "refresh_cache-f08393c9-17c8-40c0-b8de-e8b8237e9109" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:48:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquired lock "refresh_cache-f08393c9-17c8-40c0-b8de-e8b8237e9109" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:48:40 user nova-compute[73010]: DEBUG nova.network.neutron [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:48:40 user nova-compute[73010]: DEBUG nova.compute.manager [req-a321d2cb-55a9-4e21-9cae-adf46683b051 req-19503d7c-4baa-435b-8e53-3cc93a89fd66 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Received event network-changed-03999c5a-8fca-4ceb-a7c4-f2361192421c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:48:40 user nova-compute[73010]: DEBUG nova.compute.manager [req-a321d2cb-55a9-4e21-9cae-adf46683b051 req-19503d7c-4baa-435b-8e53-3cc93a89fd66 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Refreshing instance network info cache due to event network-changed-03999c5a-8fca-4ceb-a7c4-f2361192421c. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:48:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a321d2cb-55a9-4e21-9cae-adf46683b051 req-19503d7c-4baa-435b-8e53-3cc93a89fd66 service nova] Acquiring lock "refresh_cache-f08393c9-17c8-40c0-b8de-e8b8237e9109" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:48:40 user nova-compute[73010]: DEBUG nova.network.neutron [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG nova.network.neutron [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Updating instance_info_cache with network_info: [{"id": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "address": "fa:16:3e:57:45:d7", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03999c5a-8f", "ovs_interfaceid": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Releasing lock "refresh_cache-f08393c9-17c8-40c0-b8de-e8b8237e9109" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG nova.compute.manager [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Instance network_info: |[{"id": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "address": "fa:16:3e:57:45:d7", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03999c5a-8f", "ovs_interfaceid": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a321d2cb-55a9-4e21-9cae-adf46683b051 req-19503d7c-4baa-435b-8e53-3cc93a89fd66 service nova] Acquired lock "refresh_cache-f08393c9-17c8-40c0-b8de-e8b8237e9109" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG nova.network.neutron [req-a321d2cb-55a9-4e21-9cae-adf46683b051 req-19503d7c-4baa-435b-8e53-3cc93a89fd66 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Refreshing network info cache for port 03999c5a-8fca-4ceb-a7c4-f2361192421c {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG nova.network.neutron [req-a321d2cb-55a9-4e21-9cae-adf46683b051 req-19503d7c-4baa-435b-8e53-3cc93a89fd66 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Updated VIF entry in instance network info cache for port 03999c5a-8fca-4ceb-a7c4-f2361192421c. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG nova.network.neutron [req-a321d2cb-55a9-4e21-9cae-adf46683b051 req-19503d7c-4baa-435b-8e53-3cc93a89fd66 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Updating instance_info_cache with network_info: [{"id": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "address": "fa:16:3e:57:45:d7", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03999c5a-8f", "ovs_interfaceid": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a321d2cb-55a9-4e21-9cae-adf46683b051 req-19503d7c-4baa-435b-8e53-3cc93a89fd66 service nova] Releasing lock "refresh_cache-f08393c9-17c8-40c0-b8de-e8b8237e9109" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqKlgfGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:48:41 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:48:41 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:48:41 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:48:41 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:48:41 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:48:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffdd52b-e03a-4ca5-b23f-267eb6a15c68]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:48:41 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b597c1f6-f8a6-49e6-b2d3-ef6428a08b71]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051] added
Aug 15 00:48:41 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5258aa-538d-4679-9d08-3022aebb430c]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[050a33f6-57b7-4a35-a033-6263c1df08fb]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DqKlgfGv {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DqKlgfGv" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c729e2ee-f366-4b18-a8a1-e9248d9a7594]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DqKlgfGv'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7126b187-9d0a-4489-8ce9-69a2fe4dce4b]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dcf96f-8fde-445e-85ea-6f3c2ecc9528]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 (non-flash)
Aug 15 00:48:42 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 (non-flash)
Aug 15 00:48:42 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4a3093-8b0f-4275-8cac-0a0b926020bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051, portal: 172.16.0.220,3260]
Aug 15 00:48:42 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051, portal: 172.16.0.220,3260] successful.
Aug 15 00:48:42 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cc01e9-7a8e-4cfb-bb12-793cf4c424fa]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad1abd1-350c-4eec-945a-b187a7b8ffbb]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 (non-flash)
Aug 15 00:48:42 user nova-compute[73010]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 (non-flash)
Aug 15 00:48:42 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 (non-flash)
Aug 15 00:48:42 user nova-compute[73010]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 (non-flash)
Aug 15 00:48:42 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[043425b9-7aa0-4dc0-af71-8611b3fb73ca]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:48:42 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqKlgfGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:48:43 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:48:43 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26264666433386632', 'path': '/dev/sdc'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:48:43 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264666433386632', 'path': '/dev/sdc'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:48:43 user nova-compute[73010]: DEBUG nova.objects.instance [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lazy-loading 'flavor' on Instance uuid 5df2a7ef-16c7-4e37-9534-41d95d96af41 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:48:43 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:48:43 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:48:43 user nova-compute[73010]:   <source dev="/dev/sdc"/>
Aug 15 00:48:43 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:48:43 user nova-compute[73010]:   <serial>cb3b75ad-faef-4be0-b217-25d15f197051</serial>
Aug 15 00:48:43 user nova-compute[73010]: </disk>
Aug 15 00:48:43 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:48:44 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:48:44 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:48:44 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] No VIF found with MAC fa:16:3e:fd:5a:8b, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:48:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0010a7ff-816b-4be1-b57e-54dd0859d378 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "5df2a7ef-16c7-4e37-9534-41d95d96af41" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.341s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "5df2a7ef-16c7-4e37-9534-41d95d96af41" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "5df2a7ef-16c7-4e37-9534-41d95d96af41" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:45 user nova-compute[73010]: INFO nova.compute.manager [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Detaching volume cb3b75ad-faef-4be0-b217-25d15f197051
Aug 15 00:48:45 user nova-compute[73010]: INFO nova.virt.block_device [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Attempting to driver detach volume cb3b75ad-faef-4be0-b217-25d15f197051 from mountpoint /dev/vdb
Aug 15 00:48:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Attempting to detach device vdb from instance 5df2a7ef-16c7-4e37-9534-41d95d96af41 from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:48:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:48:45 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:48:45 user nova-compute[73010]:   <source dev="/dev/sdc"/>
Aug 15 00:48:45 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:48:45 user nova-compute[73010]:   <serial>cb3b75ad-faef-4be0-b217-25d15f197051</serial>
Aug 15 00:48:45 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:48:45 user nova-compute[73010]: </disk>
Aug 15 00:48:45 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:48:45 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Successfully detached device vdb from instance 5df2a7ef-16c7-4e37-9534-41d95d96af41 from the persistent domain config.
Aug 15 00:48:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5df2a7ef-16c7-4e37-9534-41d95d96af41 from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:48:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:48:45 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:48:45 user nova-compute[73010]:   <source dev="/dev/sdc"/>
Aug 15 00:48:45 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:48:45 user nova-compute[73010]:   <serial>cb3b75ad-faef-4be0-b217-25d15f197051</serial>
Aug 15 00:48:45 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:48:45 user nova-compute[73010]: </disk>
Aug 15 00:48:45 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692060526.0412178, 5df2a7ef-16c7-4e37-9534-41d95d96af41 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5df2a7ef-16c7-4e37-9534-41d95d96af41 {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:48:46 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Successfully detached device vdb from instance 5df2a7ef-16c7-4e37-9534-41d95d96af41 from the live domain config.
Aug 15 00:48:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqKlgfGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:48:46 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:48:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe3f4d0-db6c-4472-8fb0-6ef81cedf94a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9c56f1-eae6-4c12-9705-3d49e74b70e1]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 (non-flash)
Aug 15 00:48:46 user nova-compute[73010]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 (non-flash)
Aug 15 00:48:46 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 (non-flash)
Aug 15 00:48:46 user nova-compute[73010]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 (non-flash)
Aug 15 00:48:46 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec305abc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051'): ({'sdc'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Removing single pathed devices sdc {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c4e749-aa5f-447d-a680-9dd10a3d3ea2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[40acc742-58b0-4dcc-95ef-1ef0e6b87ee4]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Flushing IO for device /dev/sdc {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5057d140-0639-4586-8456-65c6449058eb]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11d16a6-4a25-4860-9344-284b2e90f577]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] SCSI volumes sdc have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[156473fe-6670-4d99-8221-25c941e1cf57]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8ccee8-3d03-402f-a7a1-233f224bb4ee]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051, portal: 172.16.0.220,3260]
Aug 15 00:48:46 user nova-compute[73010]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051, portal: 172.16.0.220,3260] successful.
Aug 15 00:48:46 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3b75ad-faef-4be0-b217-25d15f197051 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5139d642-8334-495d-9302-de83eb7f8e9b]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] <== disconnect_volume: return (292ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "b94d5990-9053-4119-9228-fdbec348294f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "b94d5990-9053-4119-9228-fdbec348294f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG nova.compute.manager [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:46 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:48:46 user nova-compute[73010]: INFO nova.compute.claims [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Claim successful on node user
Aug 15 00:48:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:47 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:48:47 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:48:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:48:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:48:47 user nova-compute[73010]: DEBUG nova.network.neutron [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:48:47 user nova-compute[73010]: DEBUG nova.objects.instance [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lazy-loading 'flavor' on Instance uuid 5df2a7ef-16c7-4e37-9534-41d95d96af41 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:48:47 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:48:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:48:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-70ca5777-3ce2-44d9-aeba-7afea9550be8 tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "5df2a7ef-16c7-4e37-9534-41d95d96af41" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.725s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:47 user nova-compute[73010]: DEBUG nova.policy [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b85ef05658d64f1fbd78e509e2a606d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a564ea15194c4e059746d2fc6e7e1a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:48:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:48:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:48:47 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Creating image(s)
Aug 15 00:48:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "/opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "/opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "/opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.211s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk 1073741824" returned: 0 in 0.056s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.180s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:48 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:48:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:48 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Cannot resize image /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:48:48 user nova-compute[73010]: DEBUG nova.objects.instance [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'migration_context' on Instance uuid b94d5990-9053-4119-9228-fdbec348294f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:48:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:48:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Ensure instance console log exists: /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:48:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:48 user nova-compute[73010]: DEBUG nova.network.neutron [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Successfully created port: 3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.compute.manager [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:48:49 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Creating image(s)
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Did not create local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Ensure instance console log exists: /opt/stack/data/nova/instances/f08393c9-17c8-40c0-b8de-e8b8237e9109/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Start _get_guest_xml network_info=[{"id": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "address": "fa:16:3e:57:45:d7", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03999c5a-8f", "ovs_interfaceid": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EWMXpDGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f08393c9-17c8-40c0-b8de-e8b8237e9109', 'attached_at': '', 'detached_at': '', 'volume_id': '1f9498e6-7b0b-40c5-92cf-66016737f2e7', 'serial': '1f9498e6-7b0b-40c5-92cf-66016737f2e7'}, 'disk_bus': 'virtio', 'attachment_id': 'f765fb76-f1f8-4e86-8c56-4be8e36b7e92', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:48:49 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:48:49 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EWMXpDGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:48:49 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:48:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:48:49 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:48:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:48:49 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9034600f-6876-466f-8640-293834aafc77]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:48:49 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e972aeaa-30f8-4299-853d-7d7b8b2b4bba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7] added
Aug 15 00:48:49 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.network.neutron [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Successfully updated port: 3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.compute.manager [req-814533a0-b953-49fd-81a3-9d0cd386c272 req-7eee3531-7178-4a37-bad5-1baba8362f57 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received event network-changed-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.compute.manager [req-814533a0-b953-49fd-81a3-9d0cd386c272 req-7eee3531-7178-4a37-bad5-1baba8362f57 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Refreshing instance network info cache due to event network-changed-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-814533a0-b953-49fd-81a3-9d0cd386c272 req-7eee3531-7178-4a37-bad5-1baba8362f57 service nova] Acquiring lock "refresh_cache-b94d5990-9053-4119-9228-fdbec348294f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-814533a0-b953-49fd-81a3-9d0cd386c272 req-7eee3531-7178-4a37-bad5-1baba8362f57 service nova] Acquired lock "refresh_cache-b94d5990-9053-4119-9228-fdbec348294f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.network.neutron [req-814533a0-b953-49fd-81a3-9d0cd386c272 req-7eee3531-7178-4a37-bad5-1baba8362f57 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Refreshing network info cache for port 3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.256s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4f0c8d-59cf-4ef6-9022-7a5db48fcd8f]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.network.neutron [req-814533a0-b953-49fd-81a3-9d0cd386c272 req-7eee3531-7178-4a37-bad5-1baba8362f57 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7628cd-66f7-427c-9bf5-79f4314459db]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "refresh_cache-b94d5990-9053-4119-9228-fdbec348294f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EWMXpDGS {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EWMXpDGS" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[587497dc-8929-4cc0-a082-8ee214f9cff7]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EWMXpDGS'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[557a6303-a778-4bdb-be4e-0b37b53dc896]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fdf41b-4449-49b8-9b89-72630ed27c94]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 (non-flash)
Aug 15 00:48:49 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 (non-flash)
Aug 15 00:48:49 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7e0dc3-cf8e-4484-9421-bd66ed6a2c87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7, portal: 172.16.0.220,3260]
Aug 15 00:48:49 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7, portal: 172.16.0.220,3260] successful.
Aug 15 00:48:49 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc1e47d-6de9-4806-99a0-29c2f5859146]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.network.neutron [req-814533a0-b953-49fd-81a3-9d0cd386c272 req-7eee3531-7178-4a37-bad5-1baba8362f57 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[19af5b97-ae7a-4a5e-b3ab-13bcb196e12a]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 (non-flash)
Aug 15 00:48:49 user nova-compute[73010]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:48:49 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 (non-flash)
Aug 15 00:48:49 user nova-compute[73010]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:48:49 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.538s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-814533a0-b953-49fd-81a3-9d0cd386c272 req-7eee3531-7178-4a37-bad5-1baba8362f57 service nova] Releasing lock "refresh_cache-b94d5990-9053-4119-9228-fdbec348294f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquired lock "refresh_cache-b94d5990-9053-4119-9228-fdbec348294f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG nova.network.neutron [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3323b87-2dae-42b1-aab0-b8c2b6edcc71]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:48:49 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EWMXpDGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.network.neutron [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.network.neutron [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Updating instance_info_cache with network_info: [{"id": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "address": "fa:16:3e:54:79:b9", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e5551e5-7a", "ovs_interfaceid": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Releasing lock "refresh_cache-b94d5990-9053-4119-9228-fdbec348294f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.compute.manager [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Instance network_info: |[{"id": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "address": "fa:16:3e:54:79:b9", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e5551e5-7a", "ovs_interfaceid": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Start _get_guest_xml network_info=[{"id": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "address": "fa:16:3e:54:79:b9", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e5551e5-7a", "ovs_interfaceid": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:48:50 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:48:50 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:48:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-220776850',display_name='tempest-ServerRescueNegativeTestJSON-server-220776850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-220776850',id=36,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3uU0TMyomtTWjjXAOQ1AeVnCevUTKc6xapS8CuxmyV7c2W8WToMj+nZgwdQH3bzcDsH/Zqc8aHV63MQJhBdeGcL5ye492+TxtxTBn8Qkgex996dW0hplq+S7MPfzxsFQ==',key_name='tempest-keypair-1985091748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a564ea15194c4e059746d2fc6e7e1a07',ramdisk_id='',reservation_id='r-66d21cjz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-203744558',owner_user_name='tempest-ServerRescueNegativeTestJSON-203744558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:48:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b85ef05658d64f1fbd78e509e2a606d8',uuid=b94d5990-9053-4119-9228-fdbec348294f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "address": "fa:16:3e:54:79:b9", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e5551e5-7a", "ovs_interfaceid": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Converting VIF {"id": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "address": "fa:16:3e:54:79:b9", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e5551e5-7a", "ovs_interfaceid": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:79:b9,bridge_name='br-int',has_traffic_filtering=True,id=3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9,network=Network(f4772ea6-9cb0-4ca8-b327-34f8dd08808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e5551e5-7a') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.objects.instance [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'pci_devices' on Instance uuid b94d5990-9053-4119-9228-fdbec348294f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:48:50 user nova-compute[73010]:   <uuid>b94d5990-9053-4119-9228-fdbec348294f</uuid>
Aug 15 00:48:50 user nova-compute[73010]:   <name>instance-00000024</name>
Aug 15 00:48:50 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:48:50 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:48:50 user nova-compute[73010]:   <metadata>
Aug 15 00:48:50 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:48:50 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:48:50 user nova-compute[73010]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-220776850</nova:name>
Aug 15 00:48:50 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:48:50</nova:creationTime>
Aug 15 00:48:50 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:48:50 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:48:50 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:48:50 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:48:50 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:48:50 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:48:50 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:48:50 user nova-compute[73010]:       <nova:owner>
Aug 15 00:48:50 user nova-compute[73010]:         <nova:user uuid="b85ef05658d64f1fbd78e509e2a606d8">tempest-ServerRescueNegativeTestJSON-203744558-project-member</nova:user>
Aug 15 00:48:50 user nova-compute[73010]:         <nova:project uuid="a564ea15194c4e059746d2fc6e7e1a07">tempest-ServerRescueNegativeTestJSON-203744558</nova:project>
Aug 15 00:48:50 user nova-compute[73010]:       </nova:owner>
Aug 15 00:48:50 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:48:50 user nova-compute[73010]:       <nova:ports>
Aug 15 00:48:50 user nova-compute[73010]:         <nova:port uuid="3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9">
Aug 15 00:48:50 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 00:48:50 user nova-compute[73010]:         </nova:port>
Aug 15 00:48:50 user nova-compute[73010]:       </nova:ports>
Aug 15 00:48:50 user nova-compute[73010]:     </nova:instance>
Aug 15 00:48:50 user nova-compute[73010]:   </metadata>
Aug 15 00:48:50 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:48:50 user nova-compute[73010]:     <system>
Aug 15 00:48:50 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:48:50 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:48:50 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:48:50 user nova-compute[73010]:       <entry name="serial">b94d5990-9053-4119-9228-fdbec348294f</entry>
Aug 15 00:48:50 user nova-compute[73010]:       <entry name="uuid">b94d5990-9053-4119-9228-fdbec348294f</entry>
Aug 15 00:48:50 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:48:50 user nova-compute[73010]:     </system>
Aug 15 00:48:50 user nova-compute[73010]:   </sysinfo>
Aug 15 00:48:50 user nova-compute[73010]:   <os>
Aug 15 00:48:50 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:48:50 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:48:50 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:48:50 user nova-compute[73010]:   </os>
Aug 15 00:48:50 user nova-compute[73010]:   <features>
Aug 15 00:48:50 user nova-compute[73010]:     <acpi/>
Aug 15 00:48:50 user nova-compute[73010]:     <apic/>
Aug 15 00:48:50 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:48:50 user nova-compute[73010]:   </features>
Aug 15 00:48:50 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:48:50 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:48:50 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:48:50 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:48:50 user nova-compute[73010]:   </clock>
Aug 15 00:48:50 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:48:50 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:48:50 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:48:50 user nova-compute[73010]:   </cpu>
Aug 15 00:48:50 user nova-compute[73010]:   <devices>
Aug 15 00:48:50 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:48:50 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:48:50 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk"/>
Aug 15 00:48:50 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:48:50 user nova-compute[73010]:     </disk>
Aug 15 00:48:50 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:48:50 user nova-compute[73010]:       <mac address="fa:16:3e:54:79:b9"/>
Aug 15 00:48:50 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:48:50 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:48:50 user nova-compute[73010]:       <target dev="tap3e5551e5-7a"/>
Aug 15 00:48:50 user nova-compute[73010]:     </interface>
Aug 15 00:48:50 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:48:50 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/console.log" append="off"/>
Aug 15 00:48:50 user nova-compute[73010]:     </serial>
Aug 15 00:48:50 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:48:50 user nova-compute[73010]:     <video>
Aug 15 00:48:50 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:48:50 user nova-compute[73010]:     </video>
Aug 15 00:48:50 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:48:50 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:48:50 user nova-compute[73010]:     </rng>
Aug 15 00:48:50 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:48:50 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:48:50 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:48:50 user nova-compute[73010]:     </memballoon>
Aug 15 00:48:50 user nova-compute[73010]:   </devices>
Aug 15 00:48:50 user nova-compute[73010]: </domain>
Aug 15 00:48:50 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:48:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-220776850',display_name='tempest-ServerRescueNegativeTestJSON-server-220776850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-220776850',id=36,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3uU0TMyomtTWjjXAOQ1AeVnCevUTKc6xapS8CuxmyV7c2W8WToMj+nZgwdQH3bzcDsH/Zqc8aHV63MQJhBdeGcL5ye492+TxtxTBn8Qkgex996dW0hplq+S7MPfzxsFQ==',key_name='tempest-keypair-1985091748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a564ea15194c4e059746d2fc6e7e1a07',ramdisk_id='',reservation_id='r-66d21cjz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-203744558',owner_user_name='tempest-ServerRescueNegativeTestJSON-203744558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:48:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b85ef05658d64f1fbd78e509e2a606d8',uuid=b94d5990-9053-4119-9228-fdbec348294f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "address": "fa:16:3e:54:79:b9", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e5551e5-7a", "ovs_interfaceid": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Converting VIF {"id": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "address": "fa:16:3e:54:79:b9", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e5551e5-7a", "ovs_interfaceid": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:79:b9,bridge_name='br-int',has_traffic_filtering=True,id=3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9,network=Network(f4772ea6-9cb0-4ca8-b327-34f8dd08808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e5551e5-7a') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG os_vif [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:79:b9,bridge_name='br-int',has_traffic_filtering=True,id=3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9,network=Network(f4772ea6-9cb0-4ca8-b327-34f8dd08808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e5551e5-7a') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e5551e5-7a, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e5551e5-7a, col_values=(('external_ids', {'iface-id': '3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:79:b9', 'vm-uuid': 'b94d5990-9053-4119-9228-fdbec348294f'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:50 user nova-compute[73010]: INFO os_vif [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:79:b9,bridge_name='br-int',has_traffic_filtering=True,id=3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9,network=Network(f4772ea6-9cb0-4ca8-b327-34f8dd08808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e5551e5-7a')
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] No VIF found with MAC fa:16:3e:54:79:b9, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.578s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] <== connect_volume: return (1579ms) {'type': 'block', 'scsi_wwn': '23965643433656238', 'path': '/dev/sdc'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:48:50 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965643433656238', 'path': '/dev/sdc'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:48:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:48:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-563603558',display_name='tempest-ServerActionsTestOtherA-server-563603558',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-563603558',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqunjyZFkLpiNk80zhHJBMmI4Jlrza8ZHLYSe5RBsKwkkEoHKGeBKUwg/vA7wlV9hl0L81vzjguxDm4dKyFGA6ikNNXxOaicSODgz47pq/ht3X4FxrymmL8vELLfuQCog==',key_name='tempest-keypair-786587935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13115a64ccc24df68bdfda1fc72399c4',ramdisk_id='',reservation_id='r-z0n00zv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-671712537',owner_user_name='tempest-ServerActionsTestOtherA-671712537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:48:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0e48e71bb404f26926ac7a8176e04bb',uuid=f08393c9-17c8-40c0-b8de-e8b8237e9109,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "address": "fa:16:3e:57:45:d7", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03999c5a-8f", "ovs_interfaceid": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:48:51 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converting VIF {"id": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "address": "fa:16:3e:57:45:d7", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03999c5a-8f", "ovs_interfaceid": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:48:51 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:45:d7,bridge_name='br-int',has_traffic_filtering=True,id=03999c5a-8fca-4ceb-a7c4-f2361192421c,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03999c5a-8f') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:48:51 user nova-compute[73010]: DEBUG nova.objects.instance [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lazy-loading 'pci_devices' on Instance uuid f08393c9-17c8-40c0-b8de-e8b8237e9109 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:48:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:48:51 user nova-compute[73010]:   <uuid>f08393c9-17c8-40c0-b8de-e8b8237e9109</uuid>
Aug 15 00:48:51 user nova-compute[73010]:   <name>instance-00000023</name>
Aug 15 00:48:51 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:48:51 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:48:51 user nova-compute[73010]:   <metadata>
Aug 15 00:48:51 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:48:51 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:48:51 user nova-compute[73010]:       <nova:name>tempest-ServerActionsTestOtherA-server-563603558</nova:name>
Aug 15 00:48:51 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:48:49</nova:creationTime>
Aug 15 00:48:51 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:48:51 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:48:51 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:48:51 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:48:51 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:48:51 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:48:51 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:48:51 user nova-compute[73010]:       <nova:owner>
Aug 15 00:48:51 user nova-compute[73010]:         <nova:user uuid="b0e48e71bb404f26926ac7a8176e04bb">tempest-ServerActionsTestOtherA-671712537-project-member</nova:user>
Aug 15 00:48:51 user nova-compute[73010]:         <nova:project uuid="13115a64ccc24df68bdfda1fc72399c4">tempest-ServerActionsTestOtherA-671712537</nova:project>
Aug 15 00:48:51 user nova-compute[73010]:       </nova:owner>
Aug 15 00:48:51 user nova-compute[73010]:       <nova:ports>
Aug 15 00:48:51 user nova-compute[73010]:         <nova:port uuid="03999c5a-8fca-4ceb-a7c4-f2361192421c">
Aug 15 00:48:51 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 00:48:51 user nova-compute[73010]:         </nova:port>
Aug 15 00:48:51 user nova-compute[73010]:       </nova:ports>
Aug 15 00:48:51 user nova-compute[73010]:     </nova:instance>
Aug 15 00:48:51 user nova-compute[73010]:   </metadata>
Aug 15 00:48:51 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:48:51 user nova-compute[73010]:     <system>
Aug 15 00:48:51 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:48:51 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:48:51 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:48:51 user nova-compute[73010]:       <entry name="serial">f08393c9-17c8-40c0-b8de-e8b8237e9109</entry>
Aug 15 00:48:51 user nova-compute[73010]:       <entry name="uuid">f08393c9-17c8-40c0-b8de-e8b8237e9109</entry>
Aug 15 00:48:51 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:48:51 user nova-compute[73010]:     </system>
Aug 15 00:48:51 user nova-compute[73010]:   </sysinfo>
Aug 15 00:48:51 user nova-compute[73010]:   <os>
Aug 15 00:48:51 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:48:51 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:48:51 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:48:51 user nova-compute[73010]:   </os>
Aug 15 00:48:51 user nova-compute[73010]:   <features>
Aug 15 00:48:51 user nova-compute[73010]:     <acpi/>
Aug 15 00:48:51 user nova-compute[73010]:     <apic/>
Aug 15 00:48:51 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:48:51 user nova-compute[73010]:   </features>
Aug 15 00:48:51 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:48:51 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:48:51 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:48:51 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:48:51 user nova-compute[73010]:   </clock>
Aug 15 00:48:51 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:48:51 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:48:51 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:48:51 user nova-compute[73010]:   </cpu>
Aug 15 00:48:51 user nova-compute[73010]:   <devices>
Aug 15 00:48:51 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 00:48:51 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:48:51 user nova-compute[73010]:       <source dev="/dev/sdc"/>
Aug 15 00:48:51 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:48:51 user nova-compute[73010]:       <serial>1f9498e6-7b0b-40c5-92cf-66016737f2e7</serial>
Aug 15 00:48:51 user nova-compute[73010]:     </disk>
Aug 15 00:48:51 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:48:51 user nova-compute[73010]:       <mac address="fa:16:3e:57:45:d7"/>
Aug 15 00:48:51 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:48:51 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:48:51 user nova-compute[73010]:       <target dev="tap03999c5a-8f"/>
Aug 15 00:48:51 user nova-compute[73010]:     </interface>
Aug 15 00:48:51 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:48:51 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/f08393c9-17c8-40c0-b8de-e8b8237e9109/console.log" append="off"/>
Aug 15 00:48:51 user nova-compute[73010]:     </serial>
Aug 15 00:48:51 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:48:51 user nova-compute[73010]:     <video>
Aug 15 00:48:51 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:48:51 user nova-compute[73010]:     </video>
Aug 15 00:48:51 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:48:51 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:48:51 user nova-compute[73010]:     </rng>
Aug 15 00:48:51 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:48:51 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:48:51 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:48:51 user nova-compute[73010]:     </memballoon>
Aug 15 00:48:51 user nova-compute[73010]:   </devices>
Aug 15 00:48:51 user nova-compute[73010]: </domain>
Aug 15 00:48:51 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:48:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:48:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-563603558',display_name='tempest-ServerActionsTestOtherA-server-563603558',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-563603558',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqunjyZFkLpiNk80zhHJBMmI4Jlrza8ZHLYSe5RBsKwkkEoHKGeBKUwg/vA7wlV9hl0L81vzjguxDm4dKyFGA6ikNNXxOaicSODgz47pq/ht3X4FxrymmL8vELLfuQCog==',key_name='tempest-keypair-786587935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13115a64ccc24df68bdfda1fc72399c4',ramdisk_id='',reservation_id='r-z0n00zv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-671712537',owner_user_name='tempest-ServerActionsTestOtherA-671712537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:48:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0e48e71bb404f26926ac7a8176e04bb',uuid=f08393c9-17c8-40c0-b8de-e8b8237e9109,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "address": "fa:16:3e:57:45:d7", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03999c5a-8f", "ovs_interfaceid": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:48:51 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converting VIF {"id": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "address": "fa:16:3e:57:45:d7", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03999c5a-8f", "ovs_interfaceid": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:48:51 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:45:d7,bridge_name='br-int',has_traffic_filtering=True,id=03999c5a-8fca-4ceb-a7c4-f2361192421c,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03999c5a-8f') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:48:51 user nova-compute[73010]: DEBUG os_vif [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:45:d7,bridge_name='br-int',has_traffic_filtering=True,id=03999c5a-8fca-4ceb-a7c4-f2361192421c,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03999c5a-8f') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:48:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:48:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:48:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03999c5a-8f, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:48:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap03999c5a-8f, col_values=(('external_ids', {'iface-id': '03999c5a-8fca-4ceb-a7c4-f2361192421c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:45:d7', 'vm-uuid': 'f08393c9-17c8-40c0-b8de-e8b8237e9109'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:48:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:48:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:51 user nova-compute[73010]: INFO os_vif [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:45:d7,bridge_name='br-int',has_traffic_filtering=True,id=03999c5a-8fca-4ceb-a7c4-f2361192421c,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03999c5a-8f')
Aug 15 00:48:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:48:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] No VIF found with MAC fa:16:3e:57:45:d7, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:48:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:53 user nova-compute[73010]: DEBUG nova.compute.manager [req-a54e6caf-f125-4cfd-ab4f-aa69d37532f3 req-a9279054-2ccf-452b-a8c1-105dfe63045b service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received event network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:48:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a54e6caf-f125-4cfd-ab4f-aa69d37532f3 req-a9279054-2ccf-452b-a8c1-105dfe63045b service nova] Acquiring lock "b94d5990-9053-4119-9228-fdbec348294f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a54e6caf-f125-4cfd-ab4f-aa69d37532f3 req-a9279054-2ccf-452b-a8c1-105dfe63045b service nova] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a54e6caf-f125-4cfd-ab4f-aa69d37532f3 req-a9279054-2ccf-452b-a8c1-105dfe63045b service nova] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:53 user nova-compute[73010]: DEBUG nova.compute.manager [req-a54e6caf-f125-4cfd-ab4f-aa69d37532f3 req-a9279054-2ccf-452b-a8c1-105dfe63045b service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] No waiting events found dispatching network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:48:53 user nova-compute[73010]: WARNING nova.compute.manager [req-a54e6caf-f125-4cfd-ab4f-aa69d37532f3 req-a9279054-2ccf-452b-a8c1-105dfe63045b service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received unexpected event network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 for instance with vm_state building and task_state spawning.
Aug 15 00:48:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.compute.manager [req-ff18a82f-c203-40f9-9677-04f7dd865bca req-78f2e307-2511-4edf-a57a-71d01e009d58 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received event network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ff18a82f-c203-40f9-9677-04f7dd865bca req-78f2e307-2511-4edf-a57a-71d01e009d58 service nova] Acquiring lock "b94d5990-9053-4119-9228-fdbec348294f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ff18a82f-c203-40f9-9677-04f7dd865bca req-78f2e307-2511-4edf-a57a-71d01e009d58 service nova] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ff18a82f-c203-40f9-9677-04f7dd865bca req-78f2e307-2511-4edf-a57a-71d01e009d58 service nova] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.compute.manager [req-ff18a82f-c203-40f9-9677-04f7dd865bca req-78f2e307-2511-4edf-a57a-71d01e009d58 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] No waiting events found dispatching network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:48:55 user nova-compute[73010]: WARNING nova.compute.manager [req-ff18a82f-c203-40f9-9677-04f7dd865bca req-78f2e307-2511-4edf-a57a-71d01e009d58 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received unexpected event network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 for instance with vm_state building and task_state spawning.
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.compute.manager [req-ff18a82f-c203-40f9-9677-04f7dd865bca req-78f2e307-2511-4edf-a57a-71d01e009d58 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Received event network-vif-plugged-03999c5a-8fca-4ceb-a7c4-f2361192421c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ff18a82f-c203-40f9-9677-04f7dd865bca req-78f2e307-2511-4edf-a57a-71d01e009d58 service nova] Acquiring lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ff18a82f-c203-40f9-9677-04f7dd865bca req-78f2e307-2511-4edf-a57a-71d01e009d58 service nova] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ff18a82f-c203-40f9-9677-04f7dd865bca req-78f2e307-2511-4edf-a57a-71d01e009d58 service nova] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.compute.manager [req-ff18a82f-c203-40f9-9677-04f7dd865bca req-78f2e307-2511-4edf-a57a-71d01e009d58 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] No waiting events found dispatching network-vif-plugged-03999c5a-8fca-4ceb-a7c4-f2361192421c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:48:55 user nova-compute[73010]: WARNING nova.compute.manager [req-ff18a82f-c203-40f9-9677-04f7dd865bca req-78f2e307-2511-4edf-a57a-71d01e009d58 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Received unexpected event network-vif-plugged-03999c5a-8fca-4ceb-a7c4-f2361192421c for instance with vm_state building and task_state spawning.
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.compute.manager [req-ff18a82f-c203-40f9-9677-04f7dd865bca req-78f2e307-2511-4edf-a57a-71d01e009d58 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Received event network-vif-plugged-03999c5a-8fca-4ceb-a7c4-f2361192421c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ff18a82f-c203-40f9-9677-04f7dd865bca req-78f2e307-2511-4edf-a57a-71d01e009d58 service nova] Acquiring lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ff18a82f-c203-40f9-9677-04f7dd865bca req-78f2e307-2511-4edf-a57a-71d01e009d58 service nova] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ff18a82f-c203-40f9-9677-04f7dd865bca req-78f2e307-2511-4edf-a57a-71d01e009d58 service nova] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.compute.manager [req-ff18a82f-c203-40f9-9677-04f7dd865bca req-78f2e307-2511-4edf-a57a-71d01e009d58 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] No waiting events found dispatching network-vif-plugged-03999c5a-8fca-4ceb-a7c4-f2361192421c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:48:55 user nova-compute[73010]: WARNING nova.compute.manager [req-ff18a82f-c203-40f9-9677-04f7dd865bca req-78f2e307-2511-4edf-a57a-71d01e009d58 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Received unexpected event network-vif-plugged-03999c5a-8fca-4ceb-a7c4-f2361192421c for instance with vm_state building and task_state spawning.
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060535.6959908, b94d5990-9053-4119-9228-fdbec348294f => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:48:55 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] VM Resumed (Lifecycle Event)
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:48:55 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: b94d5990-9053-4119-9228-fdbec348294f] Instance spawned successfully.
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:48:55 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Instance spawned successfully.
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:48:55 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060535.6979258, b94d5990-9053-4119-9228-fdbec348294f => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:48:55 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] VM Started (Lifecycle Event)
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:48:55 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060535.710536, f08393c9-17c8-40c0-b8de-e8b8237e9109 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:48:55 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] VM Resumed (Lifecycle Event)
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:48:55 user nova-compute[73010]: INFO nova.compute.manager [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Took 6.54 seconds to spawn the instance on the hypervisor.
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:48:55 user nova-compute[73010]: INFO nova.compute.manager [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Took 8.40 seconds to spawn the instance on the hypervisor.
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:48:55 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060535.7239032, f08393c9-17c8-40c0-b8de-e8b8237e9109 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:48:55 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] VM Started (Lifecycle Event)
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:48:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:48:55 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:48:55 user nova-compute[73010]: INFO nova.compute.manager [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Took 18.28 seconds to build instance.
Aug 15 00:48:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-100f0a93-e939-4b09-9ae6-fc406e03af7a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.375s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:56 user nova-compute[73010]: INFO nova.compute.manager [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Took 9.39 seconds to build instance.
Aug 15 00:48:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e7078fa3-7bb7-44ce-9aee-1a637c9c6fe0 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "b94d5990-9053-4119-9228-fdbec348294f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.500s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:56 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:48:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:48:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:48:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:48:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:48:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:48:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:48:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:48:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:48:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:48:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:00 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:49:00 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:49:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=7671MB free_disk=25.58875274658203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:49:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:49:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:49:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6dfc356b-953a-47b0-9da7-70cc59a80853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:49:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance eec545e8-eeda-443c-9892-980e19e7267a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:49:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4b489f97-c8d4-4a6a-8404-e1a05a990261 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:49:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:49:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 5df2a7ef-16c7-4e37-9534-41d95d96af41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:49:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 31f8bcac-6874-4619-928a-a04a3a94ffa5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:49:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 9105f21a-ae71-43de-9ec7-2911ed2f5a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:49:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance f08393c9-17c8-40c0-b8de-e8b8237e9109 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:49:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance b94d5990-9053-4119-9228-fdbec348294f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:49:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:49:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:49:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:01 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:49:01 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:49:01 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:49:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.618s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:49:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:05 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:49:05 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:49:05 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:49:05 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Didn't find any instances for network info cache update. {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 00:49:05 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:49:05 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:49:05 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:49:05 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:49:05 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:49:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:06 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:49:10 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:49:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:49:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 00:49:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:49:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:49:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fa8e7a07-3bc1-4d0d-a33f-b12642fcaf0e tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "5df2a7ef-16c7-4e37-9534-41d95d96af41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:49:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fa8e7a07-3bc1-4d0d-a33f-b12642fcaf0e tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "5df2a7ef-16c7-4e37-9534-41d95d96af41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:49:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fa8e7a07-3bc1-4d0d-a33f-b12642fcaf0e tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "5df2a7ef-16c7-4e37-9534-41d95d96af41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:49:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fa8e7a07-3bc1-4d0d-a33f-b12642fcaf0e tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "5df2a7ef-16c7-4e37-9534-41d95d96af41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:49:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fa8e7a07-3bc1-4d0d-a33f-b12642fcaf0e tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "5df2a7ef-16c7-4e37-9534-41d95d96af41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:49:35 user nova-compute[73010]: INFO nova.compute.manager [None req-fa8e7a07-3bc1-4d0d-a33f-b12642fcaf0e tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Terminating instance
Aug 15 00:49:35 user nova-compute[73010]: DEBUG nova.compute.manager [None req-fa8e7a07-3bc1-4d0d-a33f-b12642fcaf0e tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:49:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:36 user nova-compute[73010]: DEBUG nova.compute.manager [req-eea50d93-016f-4c76-886d-991da7b6f1db req-7778330a-7d35-45cb-a5a7-156511db5539 service nova] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Received event network-vif-unplugged-7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:49:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-eea50d93-016f-4c76-886d-991da7b6f1db req-7778330a-7d35-45cb-a5a7-156511db5539 service nova] Acquiring lock "5df2a7ef-16c7-4e37-9534-41d95d96af41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:49:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-eea50d93-016f-4c76-886d-991da7b6f1db req-7778330a-7d35-45cb-a5a7-156511db5539 service nova] Lock "5df2a7ef-16c7-4e37-9534-41d95d96af41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:49:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-eea50d93-016f-4c76-886d-991da7b6f1db req-7778330a-7d35-45cb-a5a7-156511db5539 service nova] Lock "5df2a7ef-16c7-4e37-9534-41d95d96af41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:49:36 user nova-compute[73010]: DEBUG nova.compute.manager [req-eea50d93-016f-4c76-886d-991da7b6f1db req-7778330a-7d35-45cb-a5a7-156511db5539 service nova] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] No waiting events found dispatching network-vif-unplugged-7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:49:36 user nova-compute[73010]: DEBUG nova.compute.manager [req-eea50d93-016f-4c76-886d-991da7b6f1db req-7778330a-7d35-45cb-a5a7-156511db5539 service nova] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Received event network-vif-unplugged-7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:49:36 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Instance destroyed successfully.
Aug 15 00:49:36 user nova-compute[73010]: DEBUG nova.objects.instance [None req-fa8e7a07-3bc1-4d0d-a33f-b12642fcaf0e tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lazy-loading 'resources' on Instance uuid 5df2a7ef-16c7-4e37-9534-41d95d96af41 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:49:36 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-fa8e7a07-3bc1-4d0d-a33f-b12642fcaf0e tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:46:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-521405778',display_name='tempest-AttachVolumeNegativeTest-server-521405778',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-521405778',id=32,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCp3mQO2pKPYHExfn3C4RDIB4GPL4PgIYiuJ9s6QsdMmGnx7v9KEzpUUPMzCDr2GK5xdmqUJfV+dYSIrTeJC52HzghlzN0Zda5HbRCDvX7Dr+75bdu6BXUrUqlsv1Lnqfg==',key_name='tempest-keypair-290987230',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:46:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e962745e3a554f2b8f42d97434173a7a',ramdisk_id='',reservation_id='r-cn6dnc2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-865469153',owner_user_name='tempest-AttachVolumeNegativeTest-865469153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:46:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928ab235d55d4bfc86de82f2387c9d06',uuid=5df2a7ef-16c7-4e37-9534-41d95d96af41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9", "address": "fa:16:3e:fd:5a:8b", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edc2bb1-66", "ovs_interfaceid": "7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:49:36 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-fa8e7a07-3bc1-4d0d-a33f-b12642fcaf0e tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Converting VIF {"id": "7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9", "address": "fa:16:3e:fd:5a:8b", "network": {"id": "63eba9ab-f509-474e-a47e-64bbd03f5eda", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-406748402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e962745e3a554f2b8f42d97434173a7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edc2bb1-66", "ovs_interfaceid": "7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:49:36 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-fa8e7a07-3bc1-4d0d-a33f-b12642fcaf0e tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:5a:8b,bridge_name='br-int',has_traffic_filtering=True,id=7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7edc2bb1-66') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:49:36 user nova-compute[73010]: DEBUG os_vif [None req-fa8e7a07-3bc1-4d0d-a33f-b12642fcaf0e tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:5a:8b,bridge_name='br-int',has_traffic_filtering=True,id=7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7edc2bb1-66') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:49:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7edc2bb1-66, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:49:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:49:36 user nova-compute[73010]: INFO os_vif [None req-fa8e7a07-3bc1-4d0d-a33f-b12642fcaf0e tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:5a:8b,bridge_name='br-int',has_traffic_filtering=True,id=7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9,network=Network(63eba9ab-f509-474e-a47e-64bbd03f5eda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7edc2bb1-66')
Aug 15 00:49:36 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-fa8e7a07-3bc1-4d0d-a33f-b12642fcaf0e tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Deleting instance files /opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41_del
Aug 15 00:49:36 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-fa8e7a07-3bc1-4d0d-a33f-b12642fcaf0e tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Deletion of /opt/stack/data/nova/instances/5df2a7ef-16c7-4e37-9534-41d95d96af41_del complete
Aug 15 00:49:36 user nova-compute[73010]: INFO nova.compute.manager [None req-fa8e7a07-3bc1-4d0d-a33f-b12642fcaf0e tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 15 00:49:36 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-fa8e7a07-3bc1-4d0d-a33f-b12642fcaf0e tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:49:36 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:49:36 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:49:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:37 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:49:37 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Took 0.89 seconds to deallocate network for instance.
Aug 15 00:49:37 user nova-compute[73010]: DEBUG nova.compute.manager [req-7cb90223-9d8b-4d7d-a840-5bb65ddea9f6 req-13af0494-529b-48db-91e5-5c88f871dc1b service nova] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Received event network-vif-deleted-7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:49:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fa8e7a07-3bc1-4d0d-a33f-b12642fcaf0e tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:49:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fa8e7a07-3bc1-4d0d-a33f-b12642fcaf0e tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:49:37 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-fa8e7a07-3bc1-4d0d-a33f-b12642fcaf0e tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:49:37 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-fa8e7a07-3bc1-4d0d-a33f-b12642fcaf0e tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:49:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fa8e7a07-3bc1-4d0d-a33f-b12642fcaf0e tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:49:37 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-fa8e7a07-3bc1-4d0d-a33f-b12642fcaf0e tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Deleted allocations for instance 5df2a7ef-16c7-4e37-9534-41d95d96af41
Aug 15 00:49:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fa8e7a07-3bc1-4d0d-a33f-b12642fcaf0e tempest-AttachVolumeNegativeTest-865469153 tempest-AttachVolumeNegativeTest-865469153-project-member] Lock "5df2a7ef-16c7-4e37-9534-41d95d96af41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.228s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:49:38 user nova-compute[73010]: DEBUG nova.compute.manager [req-c2f05068-39af-4d96-bb78-adcb43573d5f req-5d6d77f0-be8c-470e-b1ba-112ad0a46eec service nova] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Received event network-vif-plugged-7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:49:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c2f05068-39af-4d96-bb78-adcb43573d5f req-5d6d77f0-be8c-470e-b1ba-112ad0a46eec service nova] Acquiring lock "5df2a7ef-16c7-4e37-9534-41d95d96af41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:49:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c2f05068-39af-4d96-bb78-adcb43573d5f req-5d6d77f0-be8c-470e-b1ba-112ad0a46eec service nova] Lock "5df2a7ef-16c7-4e37-9534-41d95d96af41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:49:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c2f05068-39af-4d96-bb78-adcb43573d5f req-5d6d77f0-be8c-470e-b1ba-112ad0a46eec service nova] Lock "5df2a7ef-16c7-4e37-9534-41d95d96af41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:49:38 user nova-compute[73010]: DEBUG nova.compute.manager [req-c2f05068-39af-4d96-bb78-adcb43573d5f req-5d6d77f0-be8c-470e-b1ba-112ad0a46eec service nova] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] No waiting events found dispatching network-vif-plugged-7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:49:38 user nova-compute[73010]: WARNING nova.compute.manager [req-c2f05068-39af-4d96-bb78-adcb43573d5f req-5d6d77f0-be8c-470e-b1ba-112ad0a46eec service nova] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Received unexpected event network-vif-plugged-7edc2bb1-6662-42ce-bd6f-0a42e3cfe7d9 for instance with vm_state deleted and task_state None.
Aug 15 00:49:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:49:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 00:49:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:49:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:49:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:49:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Acquiring lock "0ddb8ea1-8748-46ce-8387-c049819b67ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:49:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Lock "0ddb8ea1-8748-46ce-8387-c049819b67ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:49:48 user nova-compute[73010]: DEBUG nova.compute.manager [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:49:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:49:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:49:48 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:49:48 user nova-compute[73010]: INFO nova.compute.claims [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Claim successful on node user
Aug 15 00:49:48 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:49:48 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:49:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:49:48 user nova-compute[73010]: DEBUG nova.compute.manager [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:49:48 user nova-compute[73010]: DEBUG nova.compute.manager [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:49:48 user nova-compute[73010]: DEBUG nova.network.neutron [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:49:48 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:49:48 user nova-compute[73010]: DEBUG nova.compute.manager [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:49:48 user nova-compute[73010]: DEBUG nova.compute.manager [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:49:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:49:48 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Creating image(s)
Aug 15 00:49:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ddb8ea1-8748-46ce-8387-c049819b67ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:49:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Lock "/opt/stack/data/nova/instances/0ddb8ea1-8748-46ce-8387-c049819b67ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:49:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Lock "/opt/stack/data/nova/instances/0ddb8ea1-8748-46ce-8387-c049819b67ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:49:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:48 user nova-compute[73010]: DEBUG nova.policy [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53dcd6b09aaa48d4afb2093800d4dceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce51084b3aff47da8c4eb4ee37868735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:49:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.179s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:49:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:49:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.171s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/0ddb8ea1-8748-46ce-8387-c049819b67ce/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/0ddb8ea1-8748-46ce-8387-c049819b67ce/disk 1073741824" returned: 0 in 0.049s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:49:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.177s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:49 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ddb8ea1-8748-46ce-8387-c049819b67ce/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:49:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ddb8ea1-8748-46ce-8387-c049819b67ce/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:49 user nova-compute[73010]: DEBUG nova.network.neutron [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Successfully created port: 3d940fe5-e022-4c81-a974-e316ed2fbd12 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:49:49 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ddb8ea1-8748-46ce-8387-c049819b67ce/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:49 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Cannot resize image /opt/stack/data/nova/instances/0ddb8ea1-8748-46ce-8387-c049819b67ce/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:49:49 user nova-compute[73010]: DEBUG nova.objects.instance [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Lazy-loading 'migration_context' on Instance uuid 0ddb8ea1-8748-46ce-8387-c049819b67ce {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:49:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:49:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Ensure instance console log exists: /opt/stack/data/nova/instances/0ddb8ea1-8748-46ce-8387-c049819b67ce/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:49:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:49:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:49:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:49:50 user nova-compute[73010]: DEBUG nova.network.neutron [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Successfully updated port: 3d940fe5-e022-4c81-a974-e316ed2fbd12 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:49:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Acquiring lock "refresh_cache-0ddb8ea1-8748-46ce-8387-c049819b67ce" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:49:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Acquired lock "refresh_cache-0ddb8ea1-8748-46ce-8387-c049819b67ce" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:49:50 user nova-compute[73010]: DEBUG nova.network.neutron [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:49:50 user nova-compute[73010]: DEBUG nova.compute.manager [req-e0e217f7-347a-41b4-a2be-41a68a45dda0 req-2cb8f238-beb9-4d95-bac3-d265cbf39159 service nova] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Received event network-changed-3d940fe5-e022-4c81-a974-e316ed2fbd12 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:49:50 user nova-compute[73010]: DEBUG nova.compute.manager [req-e0e217f7-347a-41b4-a2be-41a68a45dda0 req-2cb8f238-beb9-4d95-bac3-d265cbf39159 service nova] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Refreshing instance network info cache due to event network-changed-3d940fe5-e022-4c81-a974-e316ed2fbd12. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:49:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e0e217f7-347a-41b4-a2be-41a68a45dda0 req-2cb8f238-beb9-4d95-bac3-d265cbf39159 service nova] Acquiring lock "refresh_cache-0ddb8ea1-8748-46ce-8387-c049819b67ce" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:49:50 user nova-compute[73010]: DEBUG nova.network.neutron [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.network.neutron [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Updating instance_info_cache with network_info: [{"id": "3d940fe5-e022-4c81-a974-e316ed2fbd12", "address": "fa:16:3e:76:5c:b9", "network": {"id": "362d171b-1bf1-46f7-a351-944d47736dcd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6f986236872347e7ae70dcf280523096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d940fe5-e0", "ovs_interfaceid": "3d940fe5-e022-4c81-a974-e316ed2fbd12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Releasing lock "refresh_cache-0ddb8ea1-8748-46ce-8387-c049819b67ce" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.compute.manager [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Instance network_info: |[{"id": "3d940fe5-e022-4c81-a974-e316ed2fbd12", "address": "fa:16:3e:76:5c:b9", "network": {"id": "362d171b-1bf1-46f7-a351-944d47736dcd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6f986236872347e7ae70dcf280523096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d940fe5-e0", "ovs_interfaceid": "3d940fe5-e022-4c81-a974-e316ed2fbd12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e0e217f7-347a-41b4-a2be-41a68a45dda0 req-2cb8f238-beb9-4d95-bac3-d265cbf39159 service nova] Acquired lock "refresh_cache-0ddb8ea1-8748-46ce-8387-c049819b67ce" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.network.neutron [req-e0e217f7-347a-41b4-a2be-41a68a45dda0 req-2cb8f238-beb9-4d95-bac3-d265cbf39159 service nova] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Refreshing network info cache for port 3d940fe5-e022-4c81-a974-e316ed2fbd12 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Start _get_guest_xml network_info=[{"id": "3d940fe5-e022-4c81-a974-e316ed2fbd12", "address": "fa:16:3e:76:5c:b9", "network": {"id": "362d171b-1bf1-46f7-a351-944d47736dcd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6f986236872347e7ae70dcf280523096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d940fe5-e0", "ovs_interfaceid": "3d940fe5-e022-4c81-a974-e316ed2fbd12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:49:51 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:49:51 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1622643275',display_name='tempest-VolumesNegativeTest-instance-1622643275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1622643275',id=37,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce51084b3aff47da8c4eb4ee37868735',ramdisk_id='',reservation_id='r-jrk2fce4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1407531594',owner_user_name='tempest-VolumesNegativeTest-1407531594-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:49:49Z,user_data=None,user_id='53dcd6b09aaa48d4afb2093800d4dceb',uuid=0ddb8ea1-8748-46ce-8387-c049819b67ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d940fe5-e022-4c81-a974-e316ed2fbd12", "address": "fa:16:3e:76:5c:b9", "network": {"id": "362d171b-1bf1-46f7-a351-944d47736dcd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6f986236872347e7ae70dcf280523096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d940fe5-e0", "ovs_interfaceid": "3d940fe5-e022-4c81-a974-e316ed2fbd12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Converting VIF {"id": "3d940fe5-e022-4c81-a974-e316ed2fbd12", "address": "fa:16:3e:76:5c:b9", "network": {"id": "362d171b-1bf1-46f7-a351-944d47736dcd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6f986236872347e7ae70dcf280523096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d940fe5-e0", "ovs_interfaceid": "3d940fe5-e022-4c81-a974-e316ed2fbd12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:5c:b9,bridge_name='br-int',has_traffic_filtering=True,id=3d940fe5-e022-4c81-a974-e316ed2fbd12,network=Network(362d171b-1bf1-46f7-a351-944d47736dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d940fe5-e0') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.objects.instance [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ddb8ea1-8748-46ce-8387-c049819b67ce {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:49:51 user nova-compute[73010]:   <uuid>0ddb8ea1-8748-46ce-8387-c049819b67ce</uuid>
Aug 15 00:49:51 user nova-compute[73010]:   <name>instance-00000025</name>
Aug 15 00:49:51 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:49:51 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:49:51 user nova-compute[73010]:   <metadata>
Aug 15 00:49:51 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:49:51 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:49:51 user nova-compute[73010]:       <nova:name>tempest-VolumesNegativeTest-instance-1622643275</nova:name>
Aug 15 00:49:51 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:49:51</nova:creationTime>
Aug 15 00:49:51 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:49:51 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:49:51 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:49:51 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:49:51 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:49:51 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:49:51 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:49:51 user nova-compute[73010]:       <nova:owner>
Aug 15 00:49:51 user nova-compute[73010]:         <nova:user uuid="53dcd6b09aaa48d4afb2093800d4dceb">tempest-VolumesNegativeTest-1407531594-project-member</nova:user>
Aug 15 00:49:51 user nova-compute[73010]:         <nova:project uuid="ce51084b3aff47da8c4eb4ee37868735">tempest-VolumesNegativeTest-1407531594</nova:project>
Aug 15 00:49:51 user nova-compute[73010]:       </nova:owner>
Aug 15 00:49:51 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:49:51 user nova-compute[73010]:       <nova:ports>
Aug 15 00:49:51 user nova-compute[73010]:         <nova:port uuid="3d940fe5-e022-4c81-a974-e316ed2fbd12">
Aug 15 00:49:51 user nova-compute[73010]:           <nova:ip type="fixed" address="192.168.233.238" ipVersion="4"/>
Aug 15 00:49:51 user nova-compute[73010]:         </nova:port>
Aug 15 00:49:51 user nova-compute[73010]:       </nova:ports>
Aug 15 00:49:51 user nova-compute[73010]:     </nova:instance>
Aug 15 00:49:51 user nova-compute[73010]:   </metadata>
Aug 15 00:49:51 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:49:51 user nova-compute[73010]:     <system>
Aug 15 00:49:51 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:49:51 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:49:51 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:49:51 user nova-compute[73010]:       <entry name="serial">0ddb8ea1-8748-46ce-8387-c049819b67ce</entry>
Aug 15 00:49:51 user nova-compute[73010]:       <entry name="uuid">0ddb8ea1-8748-46ce-8387-c049819b67ce</entry>
Aug 15 00:49:51 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:49:51 user nova-compute[73010]:     </system>
Aug 15 00:49:51 user nova-compute[73010]:   </sysinfo>
Aug 15 00:49:51 user nova-compute[73010]:   <os>
Aug 15 00:49:51 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:49:51 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:49:51 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:49:51 user nova-compute[73010]:   </os>
Aug 15 00:49:51 user nova-compute[73010]:   <features>
Aug 15 00:49:51 user nova-compute[73010]:     <acpi/>
Aug 15 00:49:51 user nova-compute[73010]:     <apic/>
Aug 15 00:49:51 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:49:51 user nova-compute[73010]:   </features>
Aug 15 00:49:51 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:49:51 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:49:51 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:49:51 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:49:51 user nova-compute[73010]:   </clock>
Aug 15 00:49:51 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:49:51 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:49:51 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:49:51 user nova-compute[73010]:   </cpu>
Aug 15 00:49:51 user nova-compute[73010]:   <devices>
Aug 15 00:49:51 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:49:51 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:49:51 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/0ddb8ea1-8748-46ce-8387-c049819b67ce/disk"/>
Aug 15 00:49:51 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:49:51 user nova-compute[73010]:     </disk>
Aug 15 00:49:51 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:49:51 user nova-compute[73010]:       <mac address="fa:16:3e:76:5c:b9"/>
Aug 15 00:49:51 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:49:51 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:49:51 user nova-compute[73010]:       <target dev="tap3d940fe5-e0"/>
Aug 15 00:49:51 user nova-compute[73010]:     </interface>
Aug 15 00:49:51 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:49:51 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/0ddb8ea1-8748-46ce-8387-c049819b67ce/console.log" append="off"/>
Aug 15 00:49:51 user nova-compute[73010]:     </serial>
Aug 15 00:49:51 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:49:51 user nova-compute[73010]:     <video>
Aug 15 00:49:51 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:49:51 user nova-compute[73010]:     </video>
Aug 15 00:49:51 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:49:51 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:49:51 user nova-compute[73010]:     </rng>
Aug 15 00:49:51 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:49:51 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:49:51 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:49:51 user nova-compute[73010]:     </memballoon>
Aug 15 00:49:51 user nova-compute[73010]:   </devices>
Aug 15 00:49:51 user nova-compute[73010]: </domain>
Aug 15 00:49:51 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1622643275',display_name='tempest-VolumesNegativeTest-instance-1622643275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1622643275',id=37,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce51084b3aff47da8c4eb4ee37868735',ramdisk_id='',reservation_id='r-jrk2fce4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1407531594',owner_user_name='tempest-VolumesNegativeTest-1407531594-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:49:49Z,user_data=None,user_id='53dcd6b09aaa48d4afb2093800d4dceb',uuid=0ddb8ea1-8748-46ce-8387-c049819b67ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d940fe5-e022-4c81-a974-e316ed2fbd12", "address": "fa:16:3e:76:5c:b9", "network": {"id": "362d171b-1bf1-46f7-a351-944d47736dcd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6f986236872347e7ae70dcf280523096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d940fe5-e0", "ovs_interfaceid": "3d940fe5-e022-4c81-a974-e316ed2fbd12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Converting VIF {"id": "3d940fe5-e022-4c81-a974-e316ed2fbd12", "address": "fa:16:3e:76:5c:b9", "network": {"id": "362d171b-1bf1-46f7-a351-944d47736dcd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6f986236872347e7ae70dcf280523096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d940fe5-e0", "ovs_interfaceid": "3d940fe5-e022-4c81-a974-e316ed2fbd12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:5c:b9,bridge_name='br-int',has_traffic_filtering=True,id=3d940fe5-e022-4c81-a974-e316ed2fbd12,network=Network(362d171b-1bf1-46f7-a351-944d47736dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d940fe5-e0') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG os_vif [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:5c:b9,bridge_name='br-int',has_traffic_filtering=True,id=3d940fe5-e022-4c81-a974-e316ed2fbd12,network=Network(362d171b-1bf1-46f7-a351-944d47736dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d940fe5-e0') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d940fe5-e0, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3d940fe5-e0, col_values=(('external_ids', {'iface-id': '3d940fe5-e022-4c81-a974-e316ed2fbd12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:5c:b9', 'vm-uuid': '0ddb8ea1-8748-46ce-8387-c049819b67ce'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:51 user nova-compute[73010]: INFO os_vif [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:5c:b9,bridge_name='br-int',has_traffic_filtering=True,id=3d940fe5-e022-4c81-a974-e316ed2fbd12,network=Network(362d171b-1bf1-46f7-a351-944d47736dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d940fe5-e0')
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] No VIF found with MAC fa:16:3e:76:5c:b9, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.network.neutron [req-e0e217f7-347a-41b4-a2be-41a68a45dda0 req-2cb8f238-beb9-4d95-bac3-d265cbf39159 service nova] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Updated VIF entry in instance network info cache for port 3d940fe5-e022-4c81-a974-e316ed2fbd12. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.network.neutron [req-e0e217f7-347a-41b4-a2be-41a68a45dda0 req-2cb8f238-beb9-4d95-bac3-d265cbf39159 service nova] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Updating instance_info_cache with network_info: [{"id": "3d940fe5-e022-4c81-a974-e316ed2fbd12", "address": "fa:16:3e:76:5c:b9", "network": {"id": "362d171b-1bf1-46f7-a351-944d47736dcd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6f986236872347e7ae70dcf280523096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d940fe5-e0", "ovs_interfaceid": "3d940fe5-e022-4c81-a974-e316ed2fbd12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e0e217f7-347a-41b4-a2be-41a68a45dda0 req-2cb8f238-beb9-4d95-bac3-d265cbf39159 service nova] Releasing lock "refresh_cache-0ddb8ea1-8748-46ce-8387-c049819b67ce" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060576.6081223, 5df2a7ef-16c7-4e37-9534-41d95d96af41 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:49:51 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] VM Stopped (Lifecycle Event)
Aug 15 00:49:51 user nova-compute[73010]: DEBUG nova.compute.manager [None req-00e82ad2-94ae-49b4-8b34-cb318ec0f233 None None] [instance: 5df2a7ef-16c7-4e37-9534-41d95d96af41] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:49:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:52 user nova-compute[73010]: DEBUG nova.compute.manager [req-f6d390e2-253f-4280-8d92-92b4cb693c98 req-b288e0ff-41c3-425e-af5d-1e913dc2d9cc service nova] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Received event network-vif-plugged-3d940fe5-e022-4c81-a974-e316ed2fbd12 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:49:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f6d390e2-253f-4280-8d92-92b4cb693c98 req-b288e0ff-41c3-425e-af5d-1e913dc2d9cc service nova] Acquiring lock "0ddb8ea1-8748-46ce-8387-c049819b67ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:49:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f6d390e2-253f-4280-8d92-92b4cb693c98 req-b288e0ff-41c3-425e-af5d-1e913dc2d9cc service nova] Lock "0ddb8ea1-8748-46ce-8387-c049819b67ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:49:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f6d390e2-253f-4280-8d92-92b4cb693c98 req-b288e0ff-41c3-425e-af5d-1e913dc2d9cc service nova] Lock "0ddb8ea1-8748-46ce-8387-c049819b67ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:49:52 user nova-compute[73010]: DEBUG nova.compute.manager [req-f6d390e2-253f-4280-8d92-92b4cb693c98 req-b288e0ff-41c3-425e-af5d-1e913dc2d9cc service nova] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] No waiting events found dispatching network-vif-plugged-3d940fe5-e022-4c81-a974-e316ed2fbd12 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:49:52 user nova-compute[73010]: WARNING nova.compute.manager [req-f6d390e2-253f-4280-8d92-92b4cb693c98 req-b288e0ff-41c3-425e-af5d-1e913dc2d9cc service nova] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Received unexpected event network-vif-plugged-3d940fe5-e022-4c81-a974-e316ed2fbd12 for instance with vm_state building and task_state spawning.
Aug 15 00:49:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "31f8bcac-6874-4619-928a-a04a3a94ffa5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "31f8bcac-6874-4619-928a-a04a3a94ffa5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "31f8bcac-6874-4619-928a-a04a3a94ffa5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "31f8bcac-6874-4619-928a-a04a3a94ffa5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "31f8bcac-6874-4619-928a-a04a3a94ffa5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:49:54 user nova-compute[73010]: INFO nova.compute.manager [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Terminating instance
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060594.6396923, 0ddb8ea1-8748-46ce-8387-c049819b67ce => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:49:54 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] VM Resumed (Lifecycle Event)
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:49:54 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Instance spawned successfully.
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:49:54 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060594.6416996, 0ddb8ea1-8748-46ce-8387-c049819b67ce => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:49:54 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] VM Started (Lifecycle Event)
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:49:54 user nova-compute[73010]: INFO nova.compute.manager [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Took 5.88 seconds to spawn the instance on the hypervisor.
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:49:54 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.compute.manager [req-53ba08e0-fa31-452a-a93a-992024c30f60 req-a1f68d54-e886-4295-a68b-aefb2e296d29 service nova] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Received event network-vif-plugged-3d940fe5-e022-4c81-a974-e316ed2fbd12 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-53ba08e0-fa31-452a-a93a-992024c30f60 req-a1f68d54-e886-4295-a68b-aefb2e296d29 service nova] Acquiring lock "0ddb8ea1-8748-46ce-8387-c049819b67ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-53ba08e0-fa31-452a-a93a-992024c30f60 req-a1f68d54-e886-4295-a68b-aefb2e296d29 service nova] Lock "0ddb8ea1-8748-46ce-8387-c049819b67ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-53ba08e0-fa31-452a-a93a-992024c30f60 req-a1f68d54-e886-4295-a68b-aefb2e296d29 service nova] Lock "0ddb8ea1-8748-46ce-8387-c049819b67ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.compute.manager [req-53ba08e0-fa31-452a-a93a-992024c30f60 req-a1f68d54-e886-4295-a68b-aefb2e296d29 service nova] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] No waiting events found dispatching network-vif-plugged-3d940fe5-e022-4c81-a974-e316ed2fbd12 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:49:54 user nova-compute[73010]: WARNING nova.compute.manager [req-53ba08e0-fa31-452a-a93a-992024c30f60 req-a1f68d54-e886-4295-a68b-aefb2e296d29 service nova] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Received unexpected event network-vif-plugged-3d940fe5-e022-4c81-a974-e316ed2fbd12 for instance with vm_state building and task_state spawning.
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.compute.manager [req-53ba08e0-fa31-452a-a93a-992024c30f60 req-a1f68d54-e886-4295-a68b-aefb2e296d29 service nova] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Received event network-vif-unplugged-d62f7ba0-c61b-48e3-9013-5ad445d717d3 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-53ba08e0-fa31-452a-a93a-992024c30f60 req-a1f68d54-e886-4295-a68b-aefb2e296d29 service nova] Acquiring lock "31f8bcac-6874-4619-928a-a04a3a94ffa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-53ba08e0-fa31-452a-a93a-992024c30f60 req-a1f68d54-e886-4295-a68b-aefb2e296d29 service nova] Lock "31f8bcac-6874-4619-928a-a04a3a94ffa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-53ba08e0-fa31-452a-a93a-992024c30f60 req-a1f68d54-e886-4295-a68b-aefb2e296d29 service nova] Lock "31f8bcac-6874-4619-928a-a04a3a94ffa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.compute.manager [req-53ba08e0-fa31-452a-a93a-992024c30f60 req-a1f68d54-e886-4295-a68b-aefb2e296d29 service nova] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] No waiting events found dispatching network-vif-unplugged-d62f7ba0-c61b-48e3-9013-5ad445d717d3 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.compute.manager [req-53ba08e0-fa31-452a-a93a-992024c30f60 req-a1f68d54-e886-4295-a68b-aefb2e296d29 service nova] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Received event network-vif-unplugged-d62f7ba0-c61b-48e3-9013-5ad445d717d3 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.compute.manager [req-53ba08e0-fa31-452a-a93a-992024c30f60 req-a1f68d54-e886-4295-a68b-aefb2e296d29 service nova] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Received event network-vif-plugged-d62f7ba0-c61b-48e3-9013-5ad445d717d3 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-53ba08e0-fa31-452a-a93a-992024c30f60 req-a1f68d54-e886-4295-a68b-aefb2e296d29 service nova] Acquiring lock "31f8bcac-6874-4619-928a-a04a3a94ffa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-53ba08e0-fa31-452a-a93a-992024c30f60 req-a1f68d54-e886-4295-a68b-aefb2e296d29 service nova] Lock "31f8bcac-6874-4619-928a-a04a3a94ffa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-53ba08e0-fa31-452a-a93a-992024c30f60 req-a1f68d54-e886-4295-a68b-aefb2e296d29 service nova] Lock "31f8bcac-6874-4619-928a-a04a3a94ffa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.compute.manager [req-53ba08e0-fa31-452a-a93a-992024c30f60 req-a1f68d54-e886-4295-a68b-aefb2e296d29 service nova] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] No waiting events found dispatching network-vif-plugged-d62f7ba0-c61b-48e3-9013-5ad445d717d3 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:49:54 user nova-compute[73010]: WARNING nova.compute.manager [req-53ba08e0-fa31-452a-a93a-992024c30f60 req-a1f68d54-e886-4295-a68b-aefb2e296d29 service nova] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Received unexpected event network-vif-plugged-d62f7ba0-c61b-48e3-9013-5ad445d717d3 for instance with vm_state active and task_state deleting.
Aug 15 00:49:54 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Instance destroyed successfully.
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.objects.instance [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lazy-loading 'resources' on Instance uuid 31f8bcac-6874-4619-928a-a04a3a94ffa5 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:48:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-14755846',display_name='tempest-TestVolumeBootPattern-server-14755846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-14755846',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:48:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f67d1031d3cb4c8fb66342a7888ca1c4',ramdisk_id='',reservation_id='r-zmtad059',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1953358779',owner_user_name='tempest-TestVolumeBootPattern-1953358779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:48:24Z,user_data=None,user_id='daa4eb788f724a6fbf908b029315a02b',uuid=31f8bcac-6874-4619-928a-a04a3a94ffa5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d62f7ba0-c61b-48e3-9013-5ad445d717d3", "address": "fa:16:3e:5c:27:02", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62f7ba0-c6", "ovs_interfaceid": "d62f7ba0-c61b-48e3-9013-5ad445d717d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converting VIF {"id": "d62f7ba0-c61b-48e3-9013-5ad445d717d3", "address": "fa:16:3e:5c:27:02", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62f7ba0-c6", "ovs_interfaceid": "d62f7ba0-c61b-48e3-9013-5ad445d717d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:27:02,bridge_name='br-int',has_traffic_filtering=True,id=d62f7ba0-c61b-48e3-9013-5ad445d717d3,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd62f7ba0-c6') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG os_vif [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:27:02,bridge_name='br-int',has_traffic_filtering=True,id=d62f7ba0-c61b-48e3-9013-5ad445d717d3,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd62f7ba0-c6') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd62f7ba0-c6, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:49:54 user nova-compute[73010]: INFO nova.compute.manager [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Took 6.54 seconds to build instance.
Aug 15 00:49:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:49:54 user nova-compute[73010]: INFO os_vif [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:27:02,bridge_name='br-int',has_traffic_filtering=True,id=d62f7ba0-c61b-48e3-9013-5ad445d717d3,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd62f7ba0-c6')
Aug 15 00:49:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mdSDOaNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:49:54 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:49:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-4f85473a-af39-42f2-b9e4-ec5ded6132f5 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Lock "0ddb8ea1-8748-46ce-8387-c049819b67ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.647s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ea810c-ee83-435c-a6af-61540333e40c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe8e44e-5d27-47f9-9e31-a7b2c9a8f513]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 (non-flash)
Aug 15 00:49:54 user nova-compute[73010]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:49:54 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 (non-flash)
Aug 15 00:49:54 user nova-compute[73010]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:49:54 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec30361cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5'): ({'sdb'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Removing single pathed devices sdb {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a42732-aa1a-47e7-b19c-efce9d10e537]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[385e653f-e754-4744-9ece-c03b58356049]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Flushing IO for device /dev/sdb {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[773faf3c-20a9-4952-b351-68a3ece48fee]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24e40ce-b5da-43e1-94d5-cde9de87b8d9]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3584ede6-7e8d-4a2b-813b-7ddeeff4bfed]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b1a94c-5b7e-4ed9-9436-2009b98cc313]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5, portal: 172.16.0.220,3260]
Aug 15 00:49:55 user nova-compute[73010]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5, portal: 172.16.0.220,3260] successful.
Aug 15 00:49:55 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4738138-3d55-46c1-8050-9c3fd62e42f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[530d597a-fa7e-4069-baa1-a9925ebbc933]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] <== disconnect_volume: return (324ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:49:55 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Deleting instance files /opt/stack/data/nova/instances/31f8bcac-6874-4619-928a-a04a3a94ffa5_del
Aug 15 00:49:55 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Deletion of /opt/stack/data/nova/instances/31f8bcac-6874-4619-928a-a04a3a94ffa5_del complete
Aug 15 00:49:55 user nova-compute[73010]: INFO nova.compute.manager [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 15 00:49:55 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:49:55 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:49:55 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Took 0.51 seconds to deallocate network for instance.
Aug 15 00:49:56 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:49:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:49:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:49:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:49:56 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:49:56 user nova-compute[73010]: INFO nova.compute.manager [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Took 0.83 seconds to detach 1 volumes for instance.
Aug 15 00:49:56 user nova-compute[73010]: DEBUG nova.compute.manager [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Deleting volume: b4738138-3d55-46c1-8050-9c3fd62e42f5 {{(pid=73010) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 00:49:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:49:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:49:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:49:56 user nova-compute[73010]: DEBUG nova.compute.manager [req-b0ac4f30-051e-4dc0-9f66-c3ed15291f45 req-4c30b3af-f308-4551-bdfe-1cbbc54f2ac4 service nova] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Received event network-vif-deleted-d62f7ba0-c61b-48e3-9013-5ad445d717d3 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:49:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:49:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:57 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:49:57 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:49:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:49:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:57 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Deleted allocations for instance 31f8bcac-6874-4619-928a-a04a3a94ffa5
Aug 15 00:49:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-575952ba-33e0-428d-817f-60e285f884b7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "31f8bcac-6874-4619-928a-a04a3a94ffa5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.289s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:49:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ddb8ea1-8748-46ce-8387-c049819b67ce/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ddb8ea1-8748-46ce-8387-c049819b67ce/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ddb8ea1-8748-46ce-8387-c049819b67ce/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ddb8ea1-8748-46ce-8387-c049819b67ce/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:49:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:49:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:00 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:50:00 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:50:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=7691MB free_disk=25.585369110107422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:50:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:50:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:50:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6dfc356b-953a-47b0-9da7-70cc59a80853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:50:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance eec545e8-eeda-443c-9892-980e19e7267a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:50:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4b489f97-c8d4-4a6a-8404-e1a05a990261 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:50:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:50:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 9105f21a-ae71-43de-9ec7-2911ed2f5a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:50:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance f08393c9-17c8-40c0-b8de-e8b8237e9109 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:50:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance b94d5990-9053-4119-9228-fdbec348294f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:50:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 0ddb8ea1-8748-46ce-8387-c049819b67ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:50:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:50:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:50:00 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:50:00 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:50:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:50:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:50:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:50:05 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:50:05 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:50:05 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:50:05 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 00:50:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-6dfc356b-953a-47b0-9da7-70cc59a80853" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:50:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-6dfc356b-953a-47b0-9da7-70cc59a80853" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:50:05 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 00:50:05 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lazy-loading 'info_cache' on Instance uuid 6dfc356b-953a-47b0-9da7-70cc59a80853 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:50:06 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Updating instance_info_cache with network_info: [{"id": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "address": "fa:16:3e:63:99:69", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff59e78-ba", "ovs_interfaceid": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:50:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-6dfc356b-953a-47b0-9da7-70cc59a80853" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:50:06 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 00:50:06 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:50:06 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:50:06 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:50:06 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:50:06 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:50:08 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:50:09 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060594.8534224, 31f8bcac-6874-4619-928a-a04a3a94ffa5 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:50:09 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] VM Stopped (Lifecycle Event)
Aug 15 00:50:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-028af898-5574-427f-a16b-6d2c99b14725 None None] [instance: 31f8bcac-6874-4619-928a-a04a3a94ffa5] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:50:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:50:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 00:50:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:50:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:50:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:10 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:50:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:13 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:50:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG nova.compute.manager [req-a710bb7d-9307-41d3-9137-8f98ffbbf141 req-6280d58a-105e-43a8-a03e-d71694daa1a4 service nova] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Received event network-changed-a0b20ef5-895b-4455-a38d-a8cca288213f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG nova.compute.manager [req-a710bb7d-9307-41d3-9137-8f98ffbbf141 req-6280d58a-105e-43a8-a03e-d71694daa1a4 service nova] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Refreshing instance network info cache due to event network-changed-a0b20ef5-895b-4455-a38d-a8cca288213f. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a710bb7d-9307-41d3-9137-8f98ffbbf141 req-6280d58a-105e-43a8-a03e-d71694daa1a4 service nova] Acquiring lock "refresh_cache-9105f21a-ae71-43de-9ec7-2911ed2f5a01" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a710bb7d-9307-41d3-9137-8f98ffbbf141 req-6280d58a-105e-43a8-a03e-d71694daa1a4 service nova] Acquired lock "refresh_cache-9105f21a-ae71-43de-9ec7-2911ed2f5a01" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG nova.network.neutron [req-a710bb7d-9307-41d3-9137-8f98ffbbf141 req-6280d58a-105e-43a8-a03e-d71694daa1a4 service nova] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Refreshing network info cache for port a0b20ef5-895b-4455-a38d-a8cca288213f {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG nova.objects.instance [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lazy-loading 'flavor' on Instance uuid 9105f21a-ae71-43de-9ec7-2911ed2f5a01 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:50:16 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Ignoring supplied device name: /dev/vdb
Aug 15 00:50:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:50:16 user nova-compute[73010]: INFO nova.compute.manager [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Attaching volume 81778e1b-123c-4d7e-8519-d79c0f67dc77 to /dev/vdb
Aug 15 00:50:16 user nova-compute[73010]: DEBUG os_brick.utils [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3667c741-1b0c-4b9d-a043-726f52b0da04]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2be1e6-3f3d-4e77-8862-1a5ddb791e63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f675f25-65f6-4041-98f4-c6265cba82bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55e00c1-77ac-419c-85ca-a30844ae3445]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG nova.network.neutron [req-a710bb7d-9307-41d3-9137-8f98ffbbf141 req-6280d58a-105e-43a8-a03e-d71694daa1a4 service nova] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Updated VIF entry in instance network info cache for port a0b20ef5-895b-4455-a38d-a8cca288213f. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG nova.network.neutron [req-a710bb7d-9307-41d3-9137-8f98ffbbf141 req-6280d58a-105e-43a8-a03e-d71694daa1a4 service nova] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Updating instance_info_cache with network_info: [{"id": "a0b20ef5-895b-4455-a38d-a8cca288213f", "address": "fa:16:3e:ac:d2:eb", "network": {"id": "97be784b-67e7-46e9-949a-510d7c526338", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207062863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4dad0b4fa44c61b6cae2227e6b77d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b20ef5-89", "ovs_interfaceid": "a0b20ef5-895b-4455-a38d-a8cca288213f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:50:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a710bb7d-9307-41d3-9137-8f98ffbbf141 req-6280d58a-105e-43a8-a03e-d71694daa1a4 service nova] Releasing lock "refresh_cache-9105f21a-ae71-43de-9ec7-2911ed2f5a01" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:50:17 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:50:17 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:50:17 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cbd594-d72a-4c47-90c9-353e8dfdec07]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:17 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:50:17 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:50:17 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:50:17 user nova-compute[73010]: DEBUG os_brick.utils [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:50:17 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Updating existing volume attachment record: f268c7d1-1200-4a4c-8585-a63d1a7b7b8d {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:50:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrycaJOD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:50:25 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:50:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:50:25 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:50:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:50:25 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8fb4e6-7bae-4251-b77a-11da140fe88b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:50:25 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf111c5-d6bb-49c3-950b-94f20b070286]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77] added
Aug 15 00:50:25 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5393eb-bc48-4419-9ccb-66499a16a279]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c936cb7c-3cb1-4707-8295-3e905e280774]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xrycaJOD {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xrycaJOD" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0d0648-d4f7-4747-9249-ef13056f1430]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xrycaJOD'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dc1213-d9d4-4928-9034-3a7489d6ebb2]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a075f6dc-ca89-4a7b-a1e7-f3041006d137]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:50:25 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:50:25 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9923934b-ee8b-4c4c-81a4-1691771e2958]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77, portal: 172.16.0.220,3260]
Aug 15 00:50:25 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77, portal: 172.16.0.220,3260] successful.
Aug 15 00:50:25 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a186de0f-bf70-47f9-9aa3-b9c5615f2c6b]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c6c9a1-36e9-42b8-bbc5-876b30ab4ef8]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:50:25 user nova-compute[73010]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 (non-flash)
Aug 15 00:50:25 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:50:25 user nova-compute[73010]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 (non-flash)
Aug 15 00:50:25 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36dfe94-7a3c-499b-9f6f-12def8bab815]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:50:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrycaJOD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:50:26 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:50:26 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26266346163643636', 'path': '/dev/sdb'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:50:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266346163643636', 'path': '/dev/sdb'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:50:26 user nova-compute[73010]: DEBUG nova.objects.instance [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lazy-loading 'flavor' on Instance uuid 9105f21a-ae71-43de-9ec7-2911ed2f5a01 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:50:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:50:26 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:50:26 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:50:26 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:50:26 user nova-compute[73010]:   <serial>81778e1b-123c-4d7e-8519-d79c0f67dc77</serial>
Aug 15 00:50:26 user nova-compute[73010]: </disk>
Aug 15 00:50:26 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:50:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:50:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:50:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] No VIF found with MAC fa:16:3e:ac:d2:eb, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:50:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8d837a88-304a-4cab-a57f-7482d7870959 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.650s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:50:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-2ecadc80-49f5-4ebf-a251-2954bf723422 req-bfed51b0-7d0f-4e6f-8f33-5e764c0b2c2f service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Received event network-changed-4ff59e78-ba56-4896-8f62-3cd1cc2465b4 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:50:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-2ecadc80-49f5-4ebf-a251-2954bf723422 req-bfed51b0-7d0f-4e6f-8f33-5e764c0b2c2f service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Refreshing instance network info cache due to event network-changed-4ff59e78-ba56-4896-8f62-3cd1cc2465b4. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:50:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2ecadc80-49f5-4ebf-a251-2954bf723422 req-bfed51b0-7d0f-4e6f-8f33-5e764c0b2c2f service nova] Acquiring lock "refresh_cache-6dfc356b-953a-47b0-9da7-70cc59a80853" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:50:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2ecadc80-49f5-4ebf-a251-2954bf723422 req-bfed51b0-7d0f-4e6f-8f33-5e764c0b2c2f service nova] Acquired lock "refresh_cache-6dfc356b-953a-47b0-9da7-70cc59a80853" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:50:28 user nova-compute[73010]: DEBUG nova.network.neutron [req-2ecadc80-49f5-4ebf-a251-2954bf723422 req-bfed51b0-7d0f-4e6f-8f33-5e764c0b2c2f service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Refreshing network info cache for port 4ff59e78-ba56-4896-8f62-3cd1cc2465b4 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:50:29 user nova-compute[73010]: DEBUG nova.network.neutron [req-2ecadc80-49f5-4ebf-a251-2954bf723422 req-bfed51b0-7d0f-4e6f-8f33-5e764c0b2c2f service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Updated VIF entry in instance network info cache for port 4ff59e78-ba56-4896-8f62-3cd1cc2465b4. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:50:29 user nova-compute[73010]: DEBUG nova.network.neutron [req-2ecadc80-49f5-4ebf-a251-2954bf723422 req-bfed51b0-7d0f-4e6f-8f33-5e764c0b2c2f service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Updating instance_info_cache with network_info: [{"id": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "address": "fa:16:3e:63:99:69", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff59e78-ba", "ovs_interfaceid": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:50:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2ecadc80-49f5-4ebf-a251-2954bf723422 req-bfed51b0-7d0f-4e6f-8f33-5e764c0b2c2f service nova] Releasing lock "refresh_cache-6dfc356b-953a-47b0-9da7-70cc59a80853" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:50:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:30 user nova-compute[73010]: DEBUG nova.compute.manager [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Stashing vm_state: active {{(pid=73010) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 15 00:50:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-78587246-7439-48ac-abbe-acc6af121cc3 req-f55a07a4-df10-40f8-ab4d-a583fb1b5c93 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Received event network-changed-03999c5a-8fca-4ceb-a7c4-f2361192421c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:50:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-78587246-7439-48ac-abbe-acc6af121cc3 req-f55a07a4-df10-40f8-ab4d-a583fb1b5c93 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Refreshing instance network info cache due to event network-changed-03999c5a-8fca-4ceb-a7c4-f2361192421c. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:50:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-78587246-7439-48ac-abbe-acc6af121cc3 req-f55a07a4-df10-40f8-ab4d-a583fb1b5c93 service nova] Acquiring lock "refresh_cache-f08393c9-17c8-40c0-b8de-e8b8237e9109" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:50:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-78587246-7439-48ac-abbe-acc6af121cc3 req-f55a07a4-df10-40f8-ab4d-a583fb1b5c93 service nova] Acquired lock "refresh_cache-f08393c9-17c8-40c0-b8de-e8b8237e9109" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:50:30 user nova-compute[73010]: DEBUG nova.network.neutron [req-78587246-7439-48ac-abbe-acc6af121cc3 req-f55a07a4-df10-40f8-ab4d-a583fb1b5c93 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Refreshing network info cache for port 03999c5a-8fca-4ceb-a7c4-f2361192421c {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:50:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:50:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:50:31 user nova-compute[73010]: DEBUG nova.objects.instance [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lazy-loading 'pci_requests' on Instance uuid f08393c9-17c8-40c0-b8de-e8b8237e9109 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:50:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:50:31 user nova-compute[73010]: INFO nova.compute.claims [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Claim successful on node user
Aug 15 00:50:31 user nova-compute[73010]: DEBUG nova.objects.instance [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lazy-loading 'resources' on Instance uuid f08393c9-17c8-40c0-b8de-e8b8237e9109 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:50:31 user nova-compute[73010]: DEBUG nova.objects.instance [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lazy-loading 'pci_devices' on Instance uuid f08393c9-17c8-40c0-b8de-e8b8237e9109 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:50:31 user nova-compute[73010]: INFO nova.compute.resource_tracker [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Updating resource usage from migration 5ec820f0-cab3-43ca-97c3-c3b6db148a4a
Aug 15 00:50:31 user nova-compute[73010]: DEBUG nova.network.neutron [req-78587246-7439-48ac-abbe-acc6af121cc3 req-f55a07a4-df10-40f8-ab4d-a583fb1b5c93 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Updated VIF entry in instance network info cache for port 03999c5a-8fca-4ceb-a7c4-f2361192421c. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:50:31 user nova-compute[73010]: DEBUG nova.network.neutron [req-78587246-7439-48ac-abbe-acc6af121cc3 req-f55a07a4-df10-40f8-ab4d-a583fb1b5c93 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Updating instance_info_cache with network_info: [{"id": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "address": "fa:16:3e:57:45:d7", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03999c5a-8f", "ovs_interfaceid": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:50:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-78587246-7439-48ac-abbe-acc6af121cc3 req-f55a07a4-df10-40f8-ab4d-a583fb1b5c93 service nova] Releasing lock "refresh_cache-f08393c9-17c8-40c0-b8de-e8b8237e9109" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:50:31 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:50:31 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:50:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.563s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:50:31 user nova-compute[73010]: INFO nova.compute.manager [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Migrating
Aug 15 00:50:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "refresh_cache-f08393c9-17c8-40c0-b8de-e8b8237e9109" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:50:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquired lock "refresh_cache-f08393c9-17c8-40c0-b8de-e8b8237e9109" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:50:31 user nova-compute[73010]: DEBUG nova.network.neutron [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:50:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG nova.network.neutron [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Updating instance_info_cache with network_info: [{"id": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "address": "fa:16:3e:57:45:d7", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03999c5a-8f", "ovs_interfaceid": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Releasing lock "refresh_cache-f08393c9-17c8-40c0-b8de-e8b8237e9109" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Starting migrate_disk_and_power_off {{(pid=73010) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG nova.compute.manager [req-dcd26dd3-237e-45a6-9df3-4c9a9d04d053 req-ab385025-10c1-4eb4-ba08-8732aa8979e7 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Received event network-vif-unplugged-03999c5a-8fca-4ceb-a7c4-f2361192421c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dcd26dd3-237e-45a6-9df3-4c9a9d04d053 req-ab385025-10c1-4eb4-ba08-8732aa8979e7 service nova] Acquiring lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dcd26dd3-237e-45a6-9df3-4c9a9d04d053 req-ab385025-10c1-4eb4-ba08-8732aa8979e7 service nova] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dcd26dd3-237e-45a6-9df3-4c9a9d04d053 req-ab385025-10c1-4eb4-ba08-8732aa8979e7 service nova] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG nova.compute.manager [req-dcd26dd3-237e-45a6-9df3-4c9a9d04d053 req-ab385025-10c1-4eb4-ba08-8732aa8979e7 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] No waiting events found dispatching network-vif-unplugged-03999c5a-8fca-4ceb-a7c4-f2361192421c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:50:32 user nova-compute[73010]: WARNING nova.compute.manager [req-dcd26dd3-237e-45a6-9df3-4c9a9d04d053 req-ab385025-10c1-4eb4-ba08-8732aa8979e7 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Received unexpected event network-vif-unplugged-03999c5a-8fca-4ceb-a7c4-f2361192421c for instance with vm_state active and task_state resize_migrating.
Aug 15 00:50:32 user nova-compute[73010]: DEBUG nova.compute.manager [req-dcd26dd3-237e-45a6-9df3-4c9a9d04d053 req-ab385025-10c1-4eb4-ba08-8732aa8979e7 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Received event network-vif-plugged-03999c5a-8fca-4ceb-a7c4-f2361192421c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dcd26dd3-237e-45a6-9df3-4c9a9d04d053 req-ab385025-10c1-4eb4-ba08-8732aa8979e7 service nova] Acquiring lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dcd26dd3-237e-45a6-9df3-4c9a9d04d053 req-ab385025-10c1-4eb4-ba08-8732aa8979e7 service nova] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dcd26dd3-237e-45a6-9df3-4c9a9d04d053 req-ab385025-10c1-4eb4-ba08-8732aa8979e7 service nova] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG nova.compute.manager [req-dcd26dd3-237e-45a6-9df3-4c9a9d04d053 req-ab385025-10c1-4eb4-ba08-8732aa8979e7 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] No waiting events found dispatching network-vif-plugged-03999c5a-8fca-4ceb-a7c4-f2361192421c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:50:32 user nova-compute[73010]: WARNING nova.compute.manager [req-dcd26dd3-237e-45a6-9df3-4c9a9d04d053 req-ab385025-10c1-4eb4-ba08-8732aa8979e7 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Received unexpected event network-vif-plugged-03999c5a-8fca-4ceb-a7c4-f2361192421c for instance with vm_state active and task_state resize_migrating.
Aug 15 00:50:32 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Instance destroyed successfully.
Aug 15 00:50:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:48:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-563603558',display_name='tempest-ServerActionsTestOtherA-server-563603558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-563603558',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqunjyZFkLpiNk80zhHJBMmI4Jlrza8ZHLYSe5RBsKwkkEoHKGeBKUwg/vA7wlV9hl0L81vzjguxDm4dKyFGA6ikNNXxOaicSODgz47pq/ht3X4FxrymmL8vELLfuQCog==',key_name='tempest-keypair-786587935',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:48:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='13115a64ccc24df68bdfda1fc72399c4',ramdisk_id='',reservation_id='r-z0n00zv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-671712537',owner_user_name='tempest-ServerActionsTestOtherA-671712537-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:50:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0e48e71bb404f26926ac7a8176e04bb',uuid=f08393c9-17c8-40c0-b8de-e8b8237e9109,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "address": "fa:16:3e:57:45:d7", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-145498156-network", "vif_mac": "fa:16:3e:57:45:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03999c5a-8f", "ovs_interfaceid": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converting VIF {"id": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "address": "fa:16:3e:57:45:d7", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-145498156-network", "vif_mac": "fa:16:3e:57:45:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03999c5a-8f", "ovs_interfaceid": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:45:d7,bridge_name='br-int',has_traffic_filtering=True,id=03999c5a-8fca-4ceb-a7c4-f2361192421c,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03999c5a-8f') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG os_vif [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:45:d7,bridge_name='br-int',has_traffic_filtering=True,id=03999c5a-8fca-4ceb-a7c4-f2361192421c,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03999c5a-8f') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03999c5a-8f, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:32 user nova-compute[73010]: INFO os_vif [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:45:d7,bridge_name='br-int',has_traffic_filtering=True,id=03999c5a-8fca-4ceb-a7c4-f2361192421c,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03999c5a-8f')
Aug 15 00:50:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EWMXpDGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:50:32 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:50:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7901cff-8e74-4c68-a28d-a71fa687b65f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dea4abf-8de8-4b54-b59e-05cddbd58f26]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:50:33 user nova-compute[73010]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 (non-flash)
Aug 15 00:50:33 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:50:33 user nova-compute[73010]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 (non-flash)
Aug 15 00:50:33 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec3064a440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7'): ({'sdc'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Removing single pathed devices sdc {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b996d49-b211-4e7c-9ba2-f2ef8f3db8fc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.031s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[29891fdf-6371-4f1d-907f-df15dc20748f]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Flushing IO for device /dev/sdc {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.057s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[813d5968-1826-4483-afdc-97c90a835e67]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a99607f-747d-4712-9b72-07e5846d180d]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] SCSI volumes sdc have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23965643433656238', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3fa46c90', '/dev/disk/by-id/scsi-1SCST_BIO3fa46c90-9ed43eb835d6ef3e') {{(pid=84080) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41a9c9a-0fc7-441f-8cfd-b6e94f4cecf9]: (4, None) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b051d0a2-90cc-46fa-8dd5-ed97181d5179]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9e9d36-fd8b-46f3-ad05-1efee527652b]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7, portal: 172.16.0.220,3260]
Aug 15 00:50:33 user nova-compute[73010]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7, portal: 172.16.0.220,3260] successful.
Aug 15 00:50:33 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed70803-f97b-4621-8a7a-790d65e0f658]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] <== disconnect_volume: return (354ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:50:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:50:34 user nova-compute[73010]: DEBUG nova.network.neutron [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Port 03999c5a-8fca-4ceb-a7c4-f2361192421c binding to destination host user is already ACTIVE {{(pid=73010) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 00:50:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:50:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:50:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:50:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "refresh_cache-f08393c9-17c8-40c0-b8de-e8b8237e9109" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:50:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquired lock "refresh_cache-f08393c9-17c8-40c0-b8de-e8b8237e9109" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:50:34 user nova-compute[73010]: DEBUG nova.network.neutron [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:50:35 user nova-compute[73010]: DEBUG nova.network.neutron [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Updating instance_info_cache with network_info: [{"id": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "address": "fa:16:3e:57:45:d7", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03999c5a-8f", "ovs_interfaceid": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:50:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Releasing lock "refresh_cache-f08393c9-17c8-40c0-b8de-e8b8237e9109" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:50:35 user nova-compute[73010]: DEBUG os_brick.utils [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:50:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:35 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6609e61d-2e7f-498f-b58d-939a9ce5df56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:35 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5616163-0c11-45ed-94e7-e26631a5c7d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:35 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9bd252-70c1-4478-b636-15761e638225]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:35 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c69c824-5053-4bba-a7dc-0497194299dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:50:35 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:50:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:35 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:50:35 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:50:35 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[20883b76-99df-4f3e-9177-7598bc79db50]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:35 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:50:35 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:50:35 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:50:35 user nova-compute[73010]: DEBUG os_brick.utils [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:50:37 user nova-compute[73010]: DEBUG nova.compute.manager [req-9062eac4-b820-418f-9167-2bae9fa20d51 req-f2ff66af-2938-46c9-a1d3-7c36a0745d0b service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received event network-changed-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:50:37 user nova-compute[73010]: DEBUG nova.compute.manager [req-9062eac4-b820-418f-9167-2bae9fa20d51 req-f2ff66af-2938-46c9-a1d3-7c36a0745d0b service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Refreshing instance network info cache due to event network-changed-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:50:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9062eac4-b820-418f-9167-2bae9fa20d51 req-f2ff66af-2938-46c9-a1d3-7c36a0745d0b service nova] Acquiring lock "refresh_cache-b94d5990-9053-4119-9228-fdbec348294f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:50:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9062eac4-b820-418f-9167-2bae9fa20d51 req-f2ff66af-2938-46c9-a1d3-7c36a0745d0b service nova] Acquired lock "refresh_cache-b94d5990-9053-4119-9228-fdbec348294f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:50:37 user nova-compute[73010]: DEBUG nova.network.neutron [req-9062eac4-b820-418f-9167-2bae9fa20d51 req-f2ff66af-2938-46c9-a1d3-7c36a0745d0b service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Refreshing network info cache for port 3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:50:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "b94d5990-9053-4119-9228-fdbec348294f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:50:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "b94d5990-9053-4119-9228-fdbec348294f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:50:37 user nova-compute[73010]: DEBUG nova.objects.instance [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'flavor' on Instance uuid b94d5990-9053-4119-9228-fdbec348294f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:50:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "b94d5990-9053-4119-9228-fdbec348294f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:50:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "b94d5990-9053-4119-9228-fdbec348294f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "b94d5990-9053-4119-9228-fdbec348294f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:50:38 user nova-compute[73010]: INFO nova.compute.manager [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Attaching volume a29dea1e-c77f-4c31-b003-6a86a332180f to /dev/vdb
Aug 15 00:50:38 user nova-compute[73010]: DEBUG os_brick.utils [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3193189c-f4f3-4c0f-8748-cbb139c93107]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3227eecc-6f25-47dd-bac4-64464e5b69bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG nova.network.neutron [req-9062eac4-b820-418f-9167-2bae9fa20d51 req-f2ff66af-2938-46c9-a1d3-7c36a0745d0b service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Updated VIF entry in instance network info cache for port 3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG nova.network.neutron [req-9062eac4-b820-418f-9167-2bae9fa20d51 req-f2ff66af-2938-46c9-a1d3-7c36a0745d0b service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Updating instance_info_cache with network_info: [{"id": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "address": "fa:16:3e:54:79:b9", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e5551e5-7a", "ovs_interfaceid": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a91903c-c2f0-4bfa-a1a2-9b45443488d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[55987d20-c89e-42ed-a342-dd4382927bda]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9062eac4-b820-418f-9167-2bae9fa20d51 req-f2ff66af-2938-46c9-a1d3-7c36a0745d0b service nova] Releasing lock "refresh_cache-b94d5990-9053-4119-9228-fdbec348294f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:50:38 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:50:38 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b5e5ec-b17d-4df8-91e4-abf7c5434c6d]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG os_brick.utils [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:50:38 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Updating existing volume attachment record: 29c9747d-7144-44bb-b793-751dcb4b6858 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:50:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:47 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060632.9256558, f08393c9-17c8-40c0-b8de-e8b8237e9109 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:50:47 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] VM Stopped (Lifecycle Event)
Aug 15 00:50:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f5dfe511-136b-4e3b-9851-02048dd616d7 None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:50:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f5dfe511-136b-4e3b-9851-02048dd616d7 None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:50:47 user nova-compute[73010]: INFO nova.compute.manager [None req-f5dfe511-136b-4e3b-9851-02048dd616d7 None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 00:50:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TtdbxhMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:50:51 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:50:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:50:51 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:50:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:50:51 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ba20c4-6e58-4e17-bbc1-0f2ae2fec897]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:50:51 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ca637d-8bdf-4345-9983-fe40472b678c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f] added
Aug 15 00:50:51 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53112c5-d045-42cc-99a0-32f0263a91c6]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[31551ef9-9354-441d-ac11-643fe9f3e8ef]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TtdbxhMq {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TtdbxhMq" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42ca3bb-a546-4c72-9e3e-c7ac048f8b9a]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TtdbxhMq'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80abe61-4d49-46bd-87c3-6515380c4d13]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4088295a-fe81-449f-be24-23b2f985ba8d]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 (non-flash)
Aug 15 00:50:51 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 (non-flash)
Aug 15 00:50:51 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[758779da-1b7d-4b47-833d-8c324681247e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f, portal: 172.16.0.220,3260]
Aug 15 00:50:51 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f, portal: 172.16.0.220,3260] successful.
Aug 15 00:50:51 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[06359b4b-b1e3-4332-b437-efd24ad59318]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a00d2e-ba1c-4ec7-aa48-4ac05074a97b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 (non-flash)
Aug 15 00:50:51 user nova-compute[73010]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)
Aug 15 00:50:51 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 (non-flash)
Aug 15 00:50:51 user nova-compute[73010]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)
Aug 15 00:50:51 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:50:51 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c9446c-11cd-4d32-aa70-bde6463975c2]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:52 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:50:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:53 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:50:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TtdbxhMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:50:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:50:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23536336532383735', 'path': '/dev/sdc'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:50:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536336532383735', 'path': '/dev/sdc'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:50:53 user nova-compute[73010]: DEBUG nova.objects.instance [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'flavor' on Instance uuid b94d5990-9053-4119-9228-fdbec348294f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:50:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:50:53 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:50:53 user nova-compute[73010]:   <source dev="/dev/sdc"/>
Aug 15 00:50:53 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:50:53 user nova-compute[73010]:   <serial>a29dea1e-c77f-4c31-b003-6a86a332180f</serial>
Aug 15 00:50:53 user nova-compute[73010]: </disk>
Aug 15 00:50:53 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:50:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:50:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:50:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] No VIF found with MAC fa:16:3e:54:79:b9, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:50:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0d407388-4545-48cf-82ed-b9a3f1216c4b tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "b94d5990-9053-4119-9228-fdbec348294f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.633s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Starting finish_migration {{(pid=73010) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Instance directory exists: not creating {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 00:50:54 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Creating image(s)
Aug 15 00:50:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Did not create local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Ensure instance console log exists: /opt/stack/data/nova/instances/f08393c9-17c8-40c0-b8de-e8b8237e9109/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Start _get_guest_xml network_info=[{"id": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "address": "fa:16:3e:57:45:d7", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-145498156-network", "vif_mac": "fa:16:3e:57:45:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03999c5a-8f", "ovs_interfaceid": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EWMXpDGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'f08393c9-17c8-40c0-b8de-e8b8237e9109', 'attached_at': '2023-08-15T00:50:54.000000', 'detached_at': '', 'volume_id': '1f9498e6-7b0b-40c5-92cf-66016737f2e7', 'serial': '1f9498e6-7b0b-40c5-92cf-66016737f2e7'}, 'disk_bus': 'virtio', 'attachment_id': '50e6170e-d43a-4e3f-95c2-d25cb62d1c5d', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:50:54 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:50:54 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:50:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:28:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG nova.objects.instance [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lazy-loading 'vcpu_model' on Instance uuid f08393c9-17c8-40c0-b8de-e8b8237e9109 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EWMXpDGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:50:54 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:50:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:50:54 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:50:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:50:54 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c3d484-2b90-41c2-9ae5-ae40254c03ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:50:54 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[143fc3bc-2126-489c-8dc5-4fcc6f179f9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7] added
Aug 15 00:50:54 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92f2268-b667-47c0-b124-4990f9bbb4e0]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98eab7f-fb4a-4014-8799-c339e3fc7c44]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EWMXpDGS {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EWMXpDGS" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bb20ce-b848-407f-8db1-189e46ca524a]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EWMXpDGS'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5722065-47ce-4beb-affc-2d52030513d1]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c634cef1-78c6-407f-ae39-6c8591d64c76]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 (non-flash)
Aug 15 00:50:54 user nova-compute[73010]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)
Aug 15 00:50:54 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 (non-flash)
Aug 15 00:50:54 user nova-compute[73010]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)
Aug 15 00:50:54 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7660260-c1b0-4b61-adbc-af86041a7dbe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7, portal: 172.16.0.220,3260]
Aug 15 00:50:54 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7, portal: 172.16.0.220,3260] successful.
Aug 15 00:50:54 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7c42e7-7b22-49b7-b9bf-2133ada8b68e]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8df5a2-b794-4b41-a120-cf846f6b9f4b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 (non-flash)
Aug 15 00:50:54 user nova-compute[73010]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)
Aug 15 00:50:54 user nova-compute[73010]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:50:54 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 (non-flash)
Aug 15 00:50:54 user nova-compute[73010]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)
Aug 15 00:50:54 user nova-compute[73010]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:50:54 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4db2432-73ff-436e-8387-66db3c710db9]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: None {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:50:54 user nova-compute[73010]: INFO nova.compute.manager [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Rescuing
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "refresh_cache-b94d5990-9053-4119-9228-fdbec348294f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquired lock "refresh_cache-b94d5990-9053-4119-9228-fdbec348294f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:50:54 user nova-compute[73010]: DEBUG nova.network.neutron [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG nova.network.neutron [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Updating instance_info_cache with network_info: [{"id": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "address": "fa:16:3e:54:79:b9", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e5551e5-7a", "ovs_interfaceid": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Releasing lock "refresh_cache-b94d5990-9053-4119-9228-fdbec348294f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG nova.compute.manager [req-a7c11529-9a8f-42a4-afd7-215b3b13bc52 req-3f9b3ea0-ea71-4630-81b5-70fffe579a1b service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received event network-vif-unplugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a7c11529-9a8f-42a4-afd7-215b3b13bc52 req-3f9b3ea0-ea71-4630-81b5-70fffe579a1b service nova] Acquiring lock "b94d5990-9053-4119-9228-fdbec348294f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a7c11529-9a8f-42a4-afd7-215b3b13bc52 req-3f9b3ea0-ea71-4630-81b5-70fffe579a1b service nova] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a7c11529-9a8f-42a4-afd7-215b3b13bc52 req-3f9b3ea0-ea71-4630-81b5-70fffe579a1b service nova] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG nova.compute.manager [req-a7c11529-9a8f-42a4-afd7-215b3b13bc52 req-3f9b3ea0-ea71-4630-81b5-70fffe579a1b service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] No waiting events found dispatching network-vif-unplugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:50:55 user nova-compute[73010]: WARNING nova.compute.manager [req-a7c11529-9a8f-42a4-afd7-215b3b13bc52 req-3f9b3ea0-ea71-4630-81b5-70fffe579a1b service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received unexpected event network-vif-unplugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 for instance with vm_state active and task_state rescuing.
Aug 15 00:50:55 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EWMXpDGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23965643433656238', 'path': '/dev/sdd'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965643433656238', 'path': '/dev/sdd'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:48:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-563603558',display_name='tempest-ServerActionsTestOtherA-server-563603558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-563603558',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqunjyZFkLpiNk80zhHJBMmI4Jlrza8ZHLYSe5RBsKwkkEoHKGeBKUwg/vA7wlV9hl0L81vzjguxDm4dKyFGA6ikNNXxOaicSODgz47pq/ht3X4FxrymmL8vELLfuQCog==',key_name='tempest-keypair-786587935',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:48:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='13115a64ccc24df68bdfda1fc72399c4',ramdisk_id='',reservation_id='r-z0n00zv0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-671712537',owner_user_name='tempest-ServerActionsTestOtherA-671712537-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:50:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0e48e71bb404f26926ac7a8176e04bb',uuid=f08393c9-17c8-40c0-b8de-e8b8237e9109,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "address": "fa:16:3e:57:45:d7", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-145498156-network", "vif_mac": "fa:16:3e:57:45:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03999c5a-8f", "ovs_interfaceid": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converting VIF {"id": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "address": "fa:16:3e:57:45:d7", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-145498156-network", "vif_mac": "fa:16:3e:57:45:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03999c5a-8f", "ovs_interfaceid": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:45:d7,bridge_name='br-int',has_traffic_filtering=True,id=03999c5a-8fca-4ceb-a7c4-f2361192421c,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03999c5a-8f') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:50:55 user nova-compute[73010]:   <uuid>f08393c9-17c8-40c0-b8de-e8b8237e9109</uuid>
Aug 15 00:50:55 user nova-compute[73010]:   <name>instance-00000023</name>
Aug 15 00:50:55 user nova-compute[73010]:   <memory>2097152</memory>
Aug 15 00:50:55 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:50:55 user nova-compute[73010]:   <metadata>
Aug 15 00:50:55 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:50:55 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:50:55 user nova-compute[73010]:       <nova:name>tempest-ServerActionsTestOtherA-server-563603558</nova:name>
Aug 15 00:50:55 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:50:54</nova:creationTime>
Aug 15 00:50:55 user nova-compute[73010]:       <nova:flavor name="m1.small">
Aug 15 00:50:55 user nova-compute[73010]:         <nova:memory>2048</nova:memory>
Aug 15 00:50:55 user nova-compute[73010]:         <nova:disk>20</nova:disk>
Aug 15 00:50:55 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:50:55 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:50:55 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:50:55 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:50:55 user nova-compute[73010]:       <nova:owner>
Aug 15 00:50:55 user nova-compute[73010]:         <nova:user uuid="b0e48e71bb404f26926ac7a8176e04bb">tempest-ServerActionsTestOtherA-671712537-project-member</nova:user>
Aug 15 00:50:55 user nova-compute[73010]:         <nova:project uuid="13115a64ccc24df68bdfda1fc72399c4">tempest-ServerActionsTestOtherA-671712537</nova:project>
Aug 15 00:50:55 user nova-compute[73010]:       </nova:owner>
Aug 15 00:50:55 user nova-compute[73010]:       <nova:ports>
Aug 15 00:50:55 user nova-compute[73010]:         <nova:port uuid="03999c5a-8fca-4ceb-a7c4-f2361192421c">
Aug 15 00:50:55 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 00:50:55 user nova-compute[73010]:         </nova:port>
Aug 15 00:50:55 user nova-compute[73010]:       </nova:ports>
Aug 15 00:50:55 user nova-compute[73010]:     </nova:instance>
Aug 15 00:50:55 user nova-compute[73010]:   </metadata>
Aug 15 00:50:55 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:50:55 user nova-compute[73010]:     <system>
Aug 15 00:50:55 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:50:55 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:50:55 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:50:55 user nova-compute[73010]:       <entry name="serial">f08393c9-17c8-40c0-b8de-e8b8237e9109</entry>
Aug 15 00:50:55 user nova-compute[73010]:       <entry name="uuid">f08393c9-17c8-40c0-b8de-e8b8237e9109</entry>
Aug 15 00:50:55 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:50:55 user nova-compute[73010]:     </system>
Aug 15 00:50:55 user nova-compute[73010]:   </sysinfo>
Aug 15 00:50:55 user nova-compute[73010]:   <os>
Aug 15 00:50:55 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:50:55 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:50:55 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:50:55 user nova-compute[73010]:   </os>
Aug 15 00:50:55 user nova-compute[73010]:   <features>
Aug 15 00:50:55 user nova-compute[73010]:     <acpi/>
Aug 15 00:50:55 user nova-compute[73010]:     <apic/>
Aug 15 00:50:55 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:50:55 user nova-compute[73010]:   </features>
Aug 15 00:50:55 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:50:55 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:50:55 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:50:55 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:50:55 user nova-compute[73010]:   </clock>
Aug 15 00:50:55 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:50:55 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:50:55 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:50:55 user nova-compute[73010]:   </cpu>
Aug 15 00:50:55 user nova-compute[73010]:   <devices>
Aug 15 00:50:55 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 00:50:55 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:50:55 user nova-compute[73010]:       <source dev="/dev/sdd"/>
Aug 15 00:50:55 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:50:55 user nova-compute[73010]:       <serial>1f9498e6-7b0b-40c5-92cf-66016737f2e7</serial>
Aug 15 00:50:55 user nova-compute[73010]:     </disk>
Aug 15 00:50:55 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:50:55 user nova-compute[73010]:       <mac address="fa:16:3e:57:45:d7"/>
Aug 15 00:50:55 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:50:55 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:50:55 user nova-compute[73010]:       <target dev="tap03999c5a-8f"/>
Aug 15 00:50:55 user nova-compute[73010]:     </interface>
Aug 15 00:50:55 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:50:55 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/f08393c9-17c8-40c0-b8de-e8b8237e9109/console.log" append="off"/>
Aug 15 00:50:55 user nova-compute[73010]:     </serial>
Aug 15 00:50:55 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:50:55 user nova-compute[73010]:     <video>
Aug 15 00:50:55 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:50:55 user nova-compute[73010]:     </video>
Aug 15 00:50:55 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:50:55 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:50:55 user nova-compute[73010]:     </rng>
Aug 15 00:50:55 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:50:55 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:50:55 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:50:55 user nova-compute[73010]:     </memballoon>
Aug 15 00:50:55 user nova-compute[73010]:   </devices>
Aug 15 00:50:55 user nova-compute[73010]: </domain>
Aug 15 00:50:55 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:48:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-563603558',display_name='tempest-ServerActionsTestOtherA-server-563603558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-563603558',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqunjyZFkLpiNk80zhHJBMmI4Jlrza8ZHLYSe5RBsKwkkEoHKGeBKUwg/vA7wlV9hl0L81vzjguxDm4dKyFGA6ikNNXxOaicSODgz47pq/ht3X4FxrymmL8vELLfuQCog==',key_name='tempest-keypair-786587935',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:48:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='13115a64ccc24df68bdfda1fc72399c4',ramdisk_id='',reservation_id='r-z0n00zv0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-671712537',owner_user_name='tempest-ServerActionsTestOtherA-671712537-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:50:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0e48e71bb404f26926ac7a8176e04bb',uuid=f08393c9-17c8-40c0-b8de-e8b8237e9109,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "address": "fa:16:3e:57:45:d7", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-145498156-network", "vif_mac": "fa:16:3e:57:45:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03999c5a-8f", "ovs_interfaceid": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converting VIF {"id": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "address": "fa:16:3e:57:45:d7", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-145498156-network", "vif_mac": "fa:16:3e:57:45:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03999c5a-8f", "ovs_interfaceid": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:45:d7,bridge_name='br-int',has_traffic_filtering=True,id=03999c5a-8fca-4ceb-a7c4-f2361192421c,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03999c5a-8f') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG os_vif [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:45:d7,bridge_name='br-int',has_traffic_filtering=True,id=03999c5a-8fca-4ceb-a7c4-f2361192421c,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03999c5a-8f') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03999c5a-8f, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap03999c5a-8f, col_values=(('external_ids', {'iface-id': '03999c5a-8fca-4ceb-a7c4-f2361192421c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:45:d7', 'vm-uuid': 'f08393c9-17c8-40c0-b8de-e8b8237e9109'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:55 user nova-compute[73010]: INFO os_vif [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:45:d7,bridge_name='br-int',has_traffic_filtering=True,id=03999c5a-8fca-4ceb-a7c4-f2361192421c,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03999c5a-8f')
Aug 15 00:50:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:50:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] No VIF found with MAC fa:16:3e:57:45:d7, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:50:56 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: b94d5990-9053-4119-9228-fdbec348294f] Instance destroyed successfully.
Aug 15 00:50:56 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Attempting rescue
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73010) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Instance directory exists: not creating {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 00:50:56 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Creating image(s)
Aug 15 00:50:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "/opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "/opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "/opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.objects.instance [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'trusted_certs' on Instance uuid b94d5990-9053-4119-9228-fdbec348294f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.182s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk.rescue {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk.rescue" returned: 0 in 0.058s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.objects.instance [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'migration_context' on Instance uuid b94d5990-9053-4119-9228-fdbec348294f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Start _get_guest_xml network_info=[{"id": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "address": "fa:16:3e:54:79:b9", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "vif_mac": "fa:16:3e:54:79:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e5551e5-7a", "ovs_interfaceid": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.objects.instance [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'resources' on Instance uuid b94d5990-9053-4119-9228-fdbec348294f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.objects.instance [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'numa_topology' on Instance uuid b94d5990-9053-4119-9228-fdbec348294f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:50:56 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:50:56 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.objects.instance [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'vcpu_model' on Instance uuid b94d5990-9053-4119-9228-fdbec348294f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:48:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-220776850',display_name='tempest-ServerRescueNegativeTestJSON-server-220776850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-220776850',id=36,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3uU0TMyomtTWjjXAOQ1AeVnCevUTKc6xapS8CuxmyV7c2W8WToMj+nZgwdQH3bzcDsH/Zqc8aHV63MQJhBdeGcL5ye492+TxtxTBn8Qkgex996dW0hplq+S7MPfzxsFQ==',key_name='tempest-keypair-1985091748',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:48:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a564ea15194c4e059746d2fc6e7e1a07',ramdisk_id='',reservation_id='r-66d21cjz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-203744558',owner_user_name='tempest-ServerRescueNegativeTestJSON-203744558-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:48:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b85ef05658d64f1fbd78e509e2a606d8',uuid=b94d5990-9053-4119-9228-fdbec348294f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "address": "fa:16:3e:54:79:b9", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "vif_mac": "fa:16:3e:54:79:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e5551e5-7a", "ovs_interfaceid": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Converting VIF {"id": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "address": "fa:16:3e:54:79:b9", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "vif_mac": "fa:16:3e:54:79:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e5551e5-7a", "ovs_interfaceid": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:79:b9,bridge_name='br-int',has_traffic_filtering=True,id=3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9,network=Network(f4772ea6-9cb0-4ca8-b327-34f8dd08808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e5551e5-7a') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.objects.instance [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'pci_devices' on Instance uuid b94d5990-9053-4119-9228-fdbec348294f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:50:56 user nova-compute[73010]:   <uuid>b94d5990-9053-4119-9228-fdbec348294f</uuid>
Aug 15 00:50:56 user nova-compute[73010]:   <name>instance-00000024</name>
Aug 15 00:50:56 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:50:56 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:50:56 user nova-compute[73010]:   <metadata>
Aug 15 00:50:56 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:50:56 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:50:56 user nova-compute[73010]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-220776850</nova:name>
Aug 15 00:50:56 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:50:56</nova:creationTime>
Aug 15 00:50:56 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:50:56 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:50:56 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:50:56 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:50:56 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:50:56 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:50:56 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:50:56 user nova-compute[73010]:       <nova:owner>
Aug 15 00:50:56 user nova-compute[73010]:         <nova:user uuid="b85ef05658d64f1fbd78e509e2a606d8">tempest-ServerRescueNegativeTestJSON-203744558-project-member</nova:user>
Aug 15 00:50:56 user nova-compute[73010]:         <nova:project uuid="a564ea15194c4e059746d2fc6e7e1a07">tempest-ServerRescueNegativeTestJSON-203744558</nova:project>
Aug 15 00:50:56 user nova-compute[73010]:       </nova:owner>
Aug 15 00:50:56 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:50:56 user nova-compute[73010]:       <nova:ports>
Aug 15 00:50:56 user nova-compute[73010]:         <nova:port uuid="3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9">
Aug 15 00:50:56 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 00:50:56 user nova-compute[73010]:         </nova:port>
Aug 15 00:50:56 user nova-compute[73010]:       </nova:ports>
Aug 15 00:50:56 user nova-compute[73010]:     </nova:instance>
Aug 15 00:50:56 user nova-compute[73010]:   </metadata>
Aug 15 00:50:56 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:50:56 user nova-compute[73010]:     <system>
Aug 15 00:50:56 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:50:56 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:50:56 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:50:56 user nova-compute[73010]:       <entry name="serial">b94d5990-9053-4119-9228-fdbec348294f</entry>
Aug 15 00:50:56 user nova-compute[73010]:       <entry name="uuid">b94d5990-9053-4119-9228-fdbec348294f</entry>
Aug 15 00:50:56 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:50:56 user nova-compute[73010]:     </system>
Aug 15 00:50:56 user nova-compute[73010]:   </sysinfo>
Aug 15 00:50:56 user nova-compute[73010]:   <os>
Aug 15 00:50:56 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:50:56 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:50:56 user nova-compute[73010]:   </os>
Aug 15 00:50:56 user nova-compute[73010]:   <features>
Aug 15 00:50:56 user nova-compute[73010]:     <acpi/>
Aug 15 00:50:56 user nova-compute[73010]:     <apic/>
Aug 15 00:50:56 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:50:56 user nova-compute[73010]:   </features>
Aug 15 00:50:56 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:50:56 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:50:56 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:50:56 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:50:56 user nova-compute[73010]:   </clock>
Aug 15 00:50:56 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:50:56 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:50:56 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:50:56 user nova-compute[73010]:   </cpu>
Aug 15 00:50:56 user nova-compute[73010]:   <devices>
Aug 15 00:50:56 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:50:56 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:50:56 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk.rescue"/>
Aug 15 00:50:56 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:50:56 user nova-compute[73010]:     </disk>
Aug 15 00:50:56 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:50:56 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:50:56 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk"/>
Aug 15 00:50:56 user nova-compute[73010]:       <target dev="vdb" bus="virtio"/>
Aug 15 00:50:56 user nova-compute[73010]:     </disk>
Aug 15 00:50:56 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:50:56 user nova-compute[73010]:       <mac address="fa:16:3e:54:79:b9"/>
Aug 15 00:50:56 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:50:56 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:50:56 user nova-compute[73010]:       <target dev="tap3e5551e5-7a"/>
Aug 15 00:50:56 user nova-compute[73010]:     </interface>
Aug 15 00:50:56 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:50:56 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/console.log" append="off"/>
Aug 15 00:50:56 user nova-compute[73010]:     </serial>
Aug 15 00:50:56 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:50:56 user nova-compute[73010]:     <video>
Aug 15 00:50:56 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:50:56 user nova-compute[73010]:     </video>
Aug 15 00:50:56 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:50:56 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:50:56 user nova-compute[73010]:     </rng>
Aug 15 00:50:56 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:50:56 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:50:56 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:50:56 user nova-compute[73010]:     </memballoon>
Aug 15 00:50:56 user nova-compute[73010]:   </devices>
Aug 15 00:50:56 user nova-compute[73010]: </domain>
Aug 15 00:50:56 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:50:56 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: b94d5990-9053-4119-9228-fdbec348294f] Instance destroyed successfully.
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] No VIF found with MAC fa:16:3e:54:79:b9, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:50:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:57 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:50:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:50:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:50:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:50:57 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:50:57 user nova-compute[73010]: DEBUG nova.compute.manager [req-f3110c8d-a7dd-403d-8e82-27eccd353ca6 req-7b7f948a-3a2d-47f9-a543-5b96e66f39af service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received event network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:50:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f3110c8d-a7dd-403d-8e82-27eccd353ca6 req-7b7f948a-3a2d-47f9-a543-5b96e66f39af service nova] Acquiring lock "b94d5990-9053-4119-9228-fdbec348294f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:50:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f3110c8d-a7dd-403d-8e82-27eccd353ca6 req-7b7f948a-3a2d-47f9-a543-5b96e66f39af service nova] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:50:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f3110c8d-a7dd-403d-8e82-27eccd353ca6 req-7b7f948a-3a2d-47f9-a543-5b96e66f39af service nova] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:50:57 user nova-compute[73010]: DEBUG nova.compute.manager [req-f3110c8d-a7dd-403d-8e82-27eccd353ca6 req-7b7f948a-3a2d-47f9-a543-5b96e66f39af service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] No waiting events found dispatching network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:50:57 user nova-compute[73010]: WARNING nova.compute.manager [req-f3110c8d-a7dd-403d-8e82-27eccd353ca6 req-7b7f948a-3a2d-47f9-a543-5b96e66f39af service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received unexpected event network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 for instance with vm_state active and task_state rescuing.
Aug 15 00:50:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:50:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-7ed7d0dc-8f2f-4a03-b883-bad1f57624ea req-9954a4fb-2a87-4dfe-b9a5-4c40d1e7e480 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Received event network-vif-plugged-03999c5a-8fca-4ceb-a7c4-f2361192421c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:50:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7ed7d0dc-8f2f-4a03-b883-bad1f57624ea req-9954a4fb-2a87-4dfe-b9a5-4c40d1e7e480 service nova] Acquiring lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:50:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7ed7d0dc-8f2f-4a03-b883-bad1f57624ea req-9954a4fb-2a87-4dfe-b9a5-4c40d1e7e480 service nova] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:50:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7ed7d0dc-8f2f-4a03-b883-bad1f57624ea req-9954a4fb-2a87-4dfe-b9a5-4c40d1e7e480 service nova] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:50:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-7ed7d0dc-8f2f-4a03-b883-bad1f57624ea req-9954a4fb-2a87-4dfe-b9a5-4c40d1e7e480 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] No waiting events found dispatching network-vif-plugged-03999c5a-8fca-4ceb-a7c4-f2361192421c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:50:59 user nova-compute[73010]: WARNING nova.compute.manager [req-7ed7d0dc-8f2f-4a03-b883-bad1f57624ea req-9954a4fb-2a87-4dfe-b9a5-4c40d1e7e480 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Received unexpected event network-vif-plugged-03999c5a-8fca-4ceb-a7c4-f2361192421c for instance with vm_state active and task_state resize_finish.
Aug 15 00:50:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-7ed7d0dc-8f2f-4a03-b883-bad1f57624ea req-9954a4fb-2a87-4dfe-b9a5-4c40d1e7e480 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Received event network-vif-plugged-03999c5a-8fca-4ceb-a7c4-f2361192421c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:50:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7ed7d0dc-8f2f-4a03-b883-bad1f57624ea req-9954a4fb-2a87-4dfe-b9a5-4c40d1e7e480 service nova] Acquiring lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:50:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7ed7d0dc-8f2f-4a03-b883-bad1f57624ea req-9954a4fb-2a87-4dfe-b9a5-4c40d1e7e480 service nova] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:50:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7ed7d0dc-8f2f-4a03-b883-bad1f57624ea req-9954a4fb-2a87-4dfe-b9a5-4c40d1e7e480 service nova] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:50:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-7ed7d0dc-8f2f-4a03-b883-bad1f57624ea req-9954a4fb-2a87-4dfe-b9a5-4c40d1e7e480 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] No waiting events found dispatching network-vif-plugged-03999c5a-8fca-4ceb-a7c4-f2361192421c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:50:59 user nova-compute[73010]: WARNING nova.compute.manager [req-7ed7d0dc-8f2f-4a03-b883-bad1f57624ea req-9954a4fb-2a87-4dfe-b9a5-4c40d1e7e480 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Received unexpected event network-vif-plugged-03999c5a-8fca-4ceb-a7c4-f2361192421c for instance with vm_state active and task_state resize_finish.
Aug 15 00:50:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-7ed7d0dc-8f2f-4a03-b883-bad1f57624ea req-9954a4fb-2a87-4dfe-b9a5-4c40d1e7e480 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received event network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:50:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7ed7d0dc-8f2f-4a03-b883-bad1f57624ea req-9954a4fb-2a87-4dfe-b9a5-4c40d1e7e480 service nova] Acquiring lock "b94d5990-9053-4119-9228-fdbec348294f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:50:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7ed7d0dc-8f2f-4a03-b883-bad1f57624ea req-9954a4fb-2a87-4dfe-b9a5-4c40d1e7e480 service nova] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:50:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7ed7d0dc-8f2f-4a03-b883-bad1f57624ea req-9954a4fb-2a87-4dfe-b9a5-4c40d1e7e480 service nova] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:50:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-7ed7d0dc-8f2f-4a03-b883-bad1f57624ea req-9954a4fb-2a87-4dfe-b9a5-4c40d1e7e480 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] No waiting events found dispatching network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:50:59 user nova-compute[73010]: WARNING nova.compute.manager [req-7ed7d0dc-8f2f-4a03-b883-bad1f57624ea req-9954a4fb-2a87-4dfe-b9a5-4c40d1e7e480 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received unexpected event network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 for instance with vm_state active and task_state rescuing.
Aug 15 00:50:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-7ed7d0dc-8f2f-4a03-b883-bad1f57624ea req-9954a4fb-2a87-4dfe-b9a5-4c40d1e7e480 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received event network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:50:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7ed7d0dc-8f2f-4a03-b883-bad1f57624ea req-9954a4fb-2a87-4dfe-b9a5-4c40d1e7e480 service nova] Acquiring lock "b94d5990-9053-4119-9228-fdbec348294f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:50:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7ed7d0dc-8f2f-4a03-b883-bad1f57624ea req-9954a4fb-2a87-4dfe-b9a5-4c40d1e7e480 service nova] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:50:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7ed7d0dc-8f2f-4a03-b883-bad1f57624ea req-9954a4fb-2a87-4dfe-b9a5-4c40d1e7e480 service nova] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:50:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-7ed7d0dc-8f2f-4a03-b883-bad1f57624ea req-9954a4fb-2a87-4dfe-b9a5-4c40d1e7e480 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] No waiting events found dispatching network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:50:59 user nova-compute[73010]: WARNING nova.compute.manager [req-7ed7d0dc-8f2f-4a03-b883-bad1f57624ea req-9954a4fb-2a87-4dfe-b9a5-4c40d1e7e480 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received unexpected event network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 for instance with vm_state active and task_state rescuing.
Aug 15 00:51:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:01 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060661.4707284, f08393c9-17c8-40c0-b8de-e8b8237e9109 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:51:01 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] VM Resumed (Lifecycle Event)
Aug 15 00:51:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:51:01 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Instance running successfully.
Aug 15 00:51:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Failed to set time: agent not configured {{(pid=73010) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 15 00:51:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-64404ab5-78ae-4f57-be47-368e55c255fb tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] finish_migration finished successfully. {{(pid=73010) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 15 00:51:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:51:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:51:01 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 00:51:01 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060661.4760046, f08393c9-17c8-40c0-b8de-e8b8237e9109 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:51:01 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] VM Started (Lifecycle Event)
Aug 15 00:51:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:51:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-893749c0-925a-411f-b666-263ff68ec8ff tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:51:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:51:01 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 00:51:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Removed pending event for b94d5990-9053-4119-9228-fdbec348294f due to event {{(pid=73010) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 00:51:01 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060661.5665112, b94d5990-9053-4119-9228-fdbec348294f => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:51:01 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] VM Resumed (Lifecycle Event)
Aug 15 00:51:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:51:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:51:01 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060661.5681481, b94d5990-9053-4119-9228-fdbec348294f => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:51:01 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] VM Started (Lifecycle Event)
Aug 15 00:51:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:51:01 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:51:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:51:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:51:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ddb8ea1-8748-46ce-8387-c049819b67ce/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ddb8ea1-8748-46ce-8387-c049819b67ce/disk --force-share --output=json" returned: 0 in 0.329s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ddb8ea1-8748-46ce-8387-c049819b67ce/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ddb8ea1-8748-46ce-8387-c049819b67ce/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk.rescue --force-share --output=json" returned: 0 in 0.281s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk.rescue --force-share --output=json" returned: 0 in 0.306s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:51:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:06 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:51:06 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:51:06 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=7934MB free_disk=25.553909301757812GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:51:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:51:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:51:06 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Applying migration context for instance f08393c9-17c8-40c0-b8de-e8b8237e9109 as it has an incoming, in-progress migration 5ec820f0-cab3-43ca-97c3-c3b6db148a4a. Migration status is finished {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 00:51:06 user nova-compute[73010]: INFO nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Updating resource usage from migration 5ec820f0-cab3-43ca-97c3-c3b6db148a4a
Aug 15 00:51:06 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6dfc356b-953a-47b0-9da7-70cc59a80853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:51:06 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance eec545e8-eeda-443c-9892-980e19e7267a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:51:06 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4b489f97-c8d4-4a6a-8404-e1a05a990261 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:51:06 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:51:06 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 9105f21a-ae71-43de-9ec7-2911ed2f5a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:51:06 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance b94d5990-9053-4119-9228-fdbec348294f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:51:06 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 0ddb8ea1-8748-46ce-8387-c049819b67ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:51:06 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Migration 5ec820f0-cab3-43ca-97c3-c3b6db148a4a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 00:51:06 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance f08393c9-17c8-40c0-b8de-e8b8237e9109 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:51:06 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:51:06 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:51:06 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:51:06 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:51:07 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:51:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.805s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-380234da-634e-45a6-b121-50eecbc9e174 tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Acquiring lock "8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-380234da-634e-45a6-b121-50eecbc9e174 tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-380234da-634e-45a6-b121-50eecbc9e174 tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Acquiring lock "8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-380234da-634e-45a6-b121-50eecbc9e174 tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-380234da-634e-45a6-b121-50eecbc9e174 tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:51:08 user nova-compute[73010]: INFO nova.compute.manager [None req-380234da-634e-45a6-b121-50eecbc9e174 tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Terminating instance
Aug 15 00:51:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-380234da-634e-45a6-b121-50eecbc9e174 tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG nova.compute.manager [req-6374dddd-0ba4-4c80-a45f-9d9a12f982f7 req-8da4e8d8-43df-45f6-83d3-b0ac83873cc0 service nova] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Received event network-vif-unplugged-80cc26e3-8a79-465a-9976-59be5d7eeb72 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6374dddd-0ba4-4c80-a45f-9d9a12f982f7 req-8da4e8d8-43df-45f6-83d3-b0ac83873cc0 service nova] Acquiring lock "8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6374dddd-0ba4-4c80-a45f-9d9a12f982f7 req-8da4e8d8-43df-45f6-83d3-b0ac83873cc0 service nova] Lock "8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6374dddd-0ba4-4c80-a45f-9d9a12f982f7 req-8da4e8d8-43df-45f6-83d3-b0ac83873cc0 service nova] Lock "8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG nova.compute.manager [req-6374dddd-0ba4-4c80-a45f-9d9a12f982f7 req-8da4e8d8-43df-45f6-83d3-b0ac83873cc0 service nova] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] No waiting events found dispatching network-vif-unplugged-80cc26e3-8a79-465a-9976-59be5d7eeb72 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG nova.compute.manager [req-6374dddd-0ba4-4c80-a45f-9d9a12f982f7 req-8da4e8d8-43df-45f6-83d3-b0ac83873cc0 service nova] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Received event network-vif-unplugged-80cc26e3-8a79-465a-9976-59be5d7eeb72 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:51:08 user nova-compute[73010]: INFO nova.compute.manager [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Detaching volume 81778e1b-123c-4d7e-8519-d79c0f67dc77
Aug 15 00:51:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:51:08 user nova-compute[73010]: INFO nova.virt.block_device [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Attempting to driver detach volume 81778e1b-123c-4d7e-8519-d79c0f67dc77 from mountpoint /dev/vdb
Aug 15 00:51:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Attempting to detach device vdb from instance 9105f21a-ae71-43de-9ec7-2911ed2f5a01 from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:51:08 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:51:08 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:51:08 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:51:08 user nova-compute[73010]:   <serial>81778e1b-123c-4d7e-8519-d79c0f67dc77</serial>
Aug 15 00:51:08 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:51:08 user nova-compute[73010]: </disk>
Aug 15 00:51:08 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:51:08 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Successfully detached device vdb from instance 9105f21a-ae71-43de-9ec7-2911ed2f5a01 from the persistent domain config.
Aug 15 00:51:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9105f21a-ae71-43de-9ec7-2911ed2f5a01 from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:51:08 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:51:08 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:51:08 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:51:08 user nova-compute[73010]:   <serial>81778e1b-123c-4d7e-8519-d79c0f67dc77</serial>
Aug 15 00:51:08 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:51:08 user nova-compute[73010]: </disk>
Aug 15 00:51:08 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:51:08 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Instance destroyed successfully.
Aug 15 00:51:08 user nova-compute[73010]: DEBUG nova.objects.instance [None req-380234da-634e-45a6-b121-50eecbc9e174 tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lazy-loading 'resources' on Instance uuid 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-380234da-634e-45a6-b121-50eecbc9e174 tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:42:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-710548924',display_name='tempest-ServersNegativeTestJSON-server-710548924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-710548924',id=28,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:42:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09136fc9ddd9408892ac461a306a1618',ramdisk_id='',reservation_id='r-0ygzrpfr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-590131230',owner_user_name='tempest-ServersNegativeTestJSON-590131230-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:42:10Z,user_data=None,user_id='9515da5654394bf7b5175d74e7350a42',uuid=8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80cc26e3-8a79-465a-9976-59be5d7eeb72", "address": "fa:16:3e:5d:1f:42", "network": {"id": "2f9cb7ad-5cb3-4458-993a-780ab047d4e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-145440789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09136fc9ddd9408892ac461a306a1618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cc26e3-8a", "ovs_interfaceid": "80cc26e3-8a79-465a-9976-59be5d7eeb72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-380234da-634e-45a6-b121-50eecbc9e174 tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Converting VIF {"id": "80cc26e3-8a79-465a-9976-59be5d7eeb72", "address": "fa:16:3e:5d:1f:42", "network": {"id": "2f9cb7ad-5cb3-4458-993a-780ab047d4e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-145440789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09136fc9ddd9408892ac461a306a1618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cc26e3-8a", "ovs_interfaceid": "80cc26e3-8a79-465a-9976-59be5d7eeb72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-380234da-634e-45a6-b121-50eecbc9e174 tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:1f:42,bridge_name='br-int',has_traffic_filtering=True,id=80cc26e3-8a79-465a-9976-59be5d7eeb72,network=Network(2f9cb7ad-5cb3-4458-993a-780ab047d4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80cc26e3-8a') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG os_vif [None req-380234da-634e-45a6-b121-50eecbc9e174 tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:1f:42,bridge_name='br-int',has_traffic_filtering=True,id=80cc26e3-8a79-465a-9976-59be5d7eeb72,network=Network(2f9cb7ad-5cb3-4458-993a-780ab047d4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80cc26e3-8a') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80cc26e3-8a, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:51:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:51:09 user nova-compute[73010]: INFO os_vif [None req-380234da-634e-45a6-b121-50eecbc9e174 tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:1f:42,bridge_name='br-int',has_traffic_filtering=True,id=80cc26e3-8a79-465a-9976-59be5d7eeb72,network=Network(2f9cb7ad-5cb3-4458-993a-780ab047d4e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80cc26e3-8a')
Aug 15 00:51:09 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-380234da-634e-45a6-b121-50eecbc9e174 tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Deleting instance files /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09_del
Aug 15 00:51:09 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-380234da-634e-45a6-b121-50eecbc9e174 tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Deletion of /opt/stack/data/nova/instances/8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09_del complete
Aug 15 00:51:09 user nova-compute[73010]: INFO nova.compute.manager [None req-380234da-634e-45a6-b121-50eecbc9e174 tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-380234da-634e-45a6-b121-50eecbc9e174 tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692060669.4453216, 9105f21a-ae71-43de-9ec7-2911ed2f5a01 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9105f21a-ae71-43de-9ec7-2911ed2f5a01 {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:51:09 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Successfully detached device vdb from instance 9105f21a-ae71-43de-9ec7-2911ed2f5a01 from the live domain config.
Aug 15 00:51:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrycaJOD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:51:09 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:51:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[572268e5-1b2c-474d-bdb5-84e281122355]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c7af9d-7533-4877-acca-c3deb4aed4a2]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 (non-flash)
Aug 15 00:51:09 user nova-compute[73010]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)
Aug 15 00:51:09 user nova-compute[73010]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:51:09 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 (non-flash)
Aug 15 00:51:09 user nova-compute[73010]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)
Aug 15 00:51:09 user nova-compute[73010]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:51:09 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec30361bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77'): ({'sdb'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Removing single pathed devices sdb {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9973856b-3713-4ea6-8915-73346419f7bf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5439af15-59de-40af-bd4c-4b2a7c247981]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Flushing IO for device /dev/sdb {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b165b501-908b-4fdb-b589-2919c043ee3c]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a57557-5022-4b80-a47b-e8121826a4cc]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[de935118-82d5-4434-b59c-4be02afd5e22]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad06900-8474-4af9-9194-2fd91f182031]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77, portal: 172.16.0.220,3260]
Aug 15 00:51:09 user nova-compute[73010]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77, portal: 172.16.0.220,3260] successful.
Aug 15 00:51:09 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8d4ff2-5c71-4fe0-b9c2-0d30220b9161]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] <== disconnect_volume: return (369ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:51:09 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Took 0.81 seconds to deallocate network for instance.
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-380234da-634e-45a6-b121-50eecbc9e174 tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:51:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-380234da-634e-45a6-b121-50eecbc9e174 tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:51:10 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-380234da-634e-45a6-b121-50eecbc9e174 tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:51:10 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-380234da-634e-45a6-b121-50eecbc9e174 tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:51:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-380234da-634e-45a6-b121-50eecbc9e174 tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.525s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:51:10 user nova-compute[73010]: DEBUG nova.compute.manager [req-51bbea4f-2719-4774-948f-7b0b8f6c0c7f req-9ea1a53a-af9c-4986-a1fa-c3251b2c399e service nova] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Received event network-vif-plugged-80cc26e3-8a79-465a-9976-59be5d7eeb72 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:51:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-51bbea4f-2719-4774-948f-7b0b8f6c0c7f req-9ea1a53a-af9c-4986-a1fa-c3251b2c399e service nova] Acquiring lock "8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:51:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-51bbea4f-2719-4774-948f-7b0b8f6c0c7f req-9ea1a53a-af9c-4986-a1fa-c3251b2c399e service nova] Lock "8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:51:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-51bbea4f-2719-4774-948f-7b0b8f6c0c7f req-9ea1a53a-af9c-4986-a1fa-c3251b2c399e service nova] Lock "8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:51:10 user nova-compute[73010]: DEBUG nova.compute.manager [req-51bbea4f-2719-4774-948f-7b0b8f6c0c7f req-9ea1a53a-af9c-4986-a1fa-c3251b2c399e service nova] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] No waiting events found dispatching network-vif-plugged-80cc26e3-8a79-465a-9976-59be5d7eeb72 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:51:10 user nova-compute[73010]: WARNING nova.compute.manager [req-51bbea4f-2719-4774-948f-7b0b8f6c0c7f req-9ea1a53a-af9c-4986-a1fa-c3251b2c399e service nova] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Received unexpected event network-vif-plugged-80cc26e3-8a79-465a-9976-59be5d7eeb72 for instance with vm_state deleted and task_state None.
Aug 15 00:51:10 user nova-compute[73010]: DEBUG nova.compute.manager [req-51bbea4f-2719-4774-948f-7b0b8f6c0c7f req-9ea1a53a-af9c-4986-a1fa-c3251b2c399e service nova] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Received event network-vif-deleted-80cc26e3-8a79-465a-9976-59be5d7eeb72 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:51:10 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-380234da-634e-45a6-b121-50eecbc9e174 tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Deleted allocations for instance 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09
Aug 15 00:51:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-380234da-634e-45a6-b121-50eecbc9e174 tempest-ServersNegativeTestJSON-590131230 tempest-ServersNegativeTestJSON-590131230-project-member] Lock "8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.566s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:51:10 user nova-compute[73010]: DEBUG nova.objects.instance [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lazy-loading 'flavor' on Instance uuid 9105f21a-ae71-43de-9ec7-2911ed2f5a01 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:51:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0d16eb25-64de-4be9-960f-9a0b461bd97f tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.262s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:51:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.098s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:51:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:51:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:51:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:51:10 user nova-compute[73010]: INFO nova.compute.manager [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Terminating instance
Aug 15 00:51:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:51:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:11 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Instance destroyed successfully.
Aug 15 00:51:11 user nova-compute[73010]: DEBUG nova.objects.instance [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lazy-loading 'resources' on Instance uuid 9105f21a-ae71-43de-9ec7-2911ed2f5a01 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:48:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1436139801',display_name='tempest-VolumesSnapshotTestJSON-instance-1436139801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1436139801',id=34,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3qRKJiwD5suiltPFSjmuMOjbPJfLxy+UTEDxxYvoy6dZaPruh3b2TcYfEuikJsSQPaOvmX3JxRvSCEpCxH0CBxUeYsvauuRdA2PLoeZaUzTJOI0yH0Q7kPz90irlm4og==',key_name='tempest-keypair-1576826465',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:48:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca4dad0b4fa44c61b6cae2227e6b77d0',ramdisk_id='',reservation_id='r-yl57jn14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1973403028',owner_user_name='tempest-VolumesSnapshotTestJSON-1973403028-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:48:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d89d0afcfdc549b391c4c37c04b54b91',uuid=9105f21a-ae71-43de-9ec7-2911ed2f5a01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0b20ef5-895b-4455-a38d-a8cca288213f", "address": "fa:16:3e:ac:d2:eb", "network": {"id": "97be784b-67e7-46e9-949a-510d7c526338", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207062863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4dad0b4fa44c61b6cae2227e6b77d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b20ef5-89", "ovs_interfaceid": "a0b20ef5-895b-4455-a38d-a8cca288213f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Converting VIF {"id": "a0b20ef5-895b-4455-a38d-a8cca288213f", "address": "fa:16:3e:ac:d2:eb", "network": {"id": "97be784b-67e7-46e9-949a-510d7c526338", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207062863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4dad0b4fa44c61b6cae2227e6b77d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b20ef5-89", "ovs_interfaceid": "a0b20ef5-895b-4455-a38d-a8cca288213f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:d2:eb,bridge_name='br-int',has_traffic_filtering=True,id=a0b20ef5-895b-4455-a38d-a8cca288213f,network=Network(97be784b-67e7-46e9-949a-510d7c526338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b20ef5-89') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG os_vif [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:d2:eb,bridge_name='br-int',has_traffic_filtering=True,id=a0b20ef5-895b-4455-a38d-a8cca288213f,network=Network(97be784b-67e7-46e9-949a-510d7c526338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b20ef5-89') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0b20ef5-89, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:51:11 user nova-compute[73010]: INFO os_vif [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:d2:eb,bridge_name='br-int',has_traffic_filtering=True,id=a0b20ef5-895b-4455-a38d-a8cca288213f,network=Network(97be784b-67e7-46e9-949a-510d7c526338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b20ef5-89')
Aug 15 00:51:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrycaJOD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:51:11 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:51:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81778e1b-123c-4d7e-8519-d79c0f67dc77', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d65ce04-b6eb-430f-a79b-0d795e693d5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d523640-352d-4191-bd00-2dcd30d61b57]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)
Aug 15 00:51:11 user nova-compute[73010]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:51:11 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)
Aug 15 00:51:11 user nova-compute[73010]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:51:11 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec3064a560>, {}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Disconnecting from: [] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.058s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] <== disconnect_volume: return (59ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:51:11 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Deleting instance files /opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01_del
Aug 15 00:51:11 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Deletion of /opt/stack/data/nova/instances/9105f21a-ae71-43de-9ec7-2911ed2f5a01_del complete
Aug 15 00:51:11 user nova-compute[73010]: INFO nova.compute.manager [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 15 00:51:11 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:51:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-eec545e8-eeda-443c-9892-980e19e7267a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-eec545e8-eeda-443c-9892-980e19e7267a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "7eeadaaa-9d8b-44d2-a419-9bc5b595fc67" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "7eeadaaa-9d8b-44d2-a419-9bc5b595fc67" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG nova.compute.manager [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:51:12 user nova-compute[73010]: INFO nova.compute.claims [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Claim successful on node user
Aug 15 00:51:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-22475376-f649-4f77-9f0f-6a2e450bb934 req-0d56db6f-cea2-4735-b5d9-24525cfa3001 service nova] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Received event network-vif-unplugged-a0b20ef5-895b-4455-a38d-a8cca288213f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-22475376-f649-4f77-9f0f-6a2e450bb934 req-0d56db6f-cea2-4735-b5d9-24525cfa3001 service nova] Acquiring lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-22475376-f649-4f77-9f0f-6a2e450bb934 req-0d56db6f-cea2-4735-b5d9-24525cfa3001 service nova] Lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-22475376-f649-4f77-9f0f-6a2e450bb934 req-0d56db6f-cea2-4735-b5d9-24525cfa3001 service nova] Lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-22475376-f649-4f77-9f0f-6a2e450bb934 req-0d56db6f-cea2-4735-b5d9-24525cfa3001 service nova] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] No waiting events found dispatching network-vif-unplugged-a0b20ef5-895b-4455-a38d-a8cca288213f {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-22475376-f649-4f77-9f0f-6a2e450bb934 req-0d56db6f-cea2-4735-b5d9-24525cfa3001 service nova] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Received event network-vif-unplugged-a0b20ef5-895b-4455-a38d-a8cca288213f for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-22475376-f649-4f77-9f0f-6a2e450bb934 req-0d56db6f-cea2-4735-b5d9-24525cfa3001 service nova] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Received event network-vif-plugged-a0b20ef5-895b-4455-a38d-a8cca288213f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-22475376-f649-4f77-9f0f-6a2e450bb934 req-0d56db6f-cea2-4735-b5d9-24525cfa3001 service nova] Acquiring lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-22475376-f649-4f77-9f0f-6a2e450bb934 req-0d56db6f-cea2-4735-b5d9-24525cfa3001 service nova] Lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-22475376-f649-4f77-9f0f-6a2e450bb934 req-0d56db6f-cea2-4735-b5d9-24525cfa3001 service nova] Lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-22475376-f649-4f77-9f0f-6a2e450bb934 req-0d56db6f-cea2-4735-b5d9-24525cfa3001 service nova] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] No waiting events found dispatching network-vif-plugged-a0b20ef5-895b-4455-a38d-a8cca288213f {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:51:12 user nova-compute[73010]: WARNING nova.compute.manager [req-22475376-f649-4f77-9f0f-6a2e450bb934 req-0d56db6f-cea2-4735-b5d9-24525cfa3001 service nova] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Received unexpected event network-vif-plugged-a0b20ef5-895b-4455-a38d-a8cca288213f for instance with vm_state active and task_state deleting.
Aug 15 00:51:12 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Updating instance_info_cache with network_info: [{"id": "65b5e7b6-01af-4239-9386-e7b14c83e766", "address": "fa:16:3e:88:de:ee", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b5e7b6-01", "ovs_interfaceid": "65b5e7b6-01af-4239-9386-e7b14c83e766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-eec545e8-eeda-443c-9892-980e19e7267a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:51:12 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Took 1.02 seconds to deallocate network for instance.
Aug 15 00:51:12 user nova-compute[73010]: WARNING nova.volume.cinder [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Attachment f268c7d1-1200-4a4c-8585-a63d1a7b7b8d does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = f268c7d1-1200-4a4c-8585-a63d1a7b7b8d. (HTTP 404) (Request-ID: req-fb2e1105-2015-4a81-bdf9-c9e89b272554)
Aug 15 00:51:12 user nova-compute[73010]: INFO nova.compute.manager [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Took 0.03 seconds to detach 1 volumes for instance.
Aug 15 00:51:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG nova.compute.manager [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:51:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.067s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG nova.compute.manager [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG nova.network.neutron [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:51:13 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:51:13 user nova-compute[73010]: DEBUG nova.compute.manager [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:51:13 user nova-compute[73010]: INFO nova.virt.block_device [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Booting with volume 92121257-8985-42dc-9f37-4e382c7953ad at /dev/vda
Aug 15 00:51:13 user nova-compute[73010]: DEBUG nova.policy [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'daa4eb788f724a6fbf908b029315a02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67d1031d3cb4c8fb66342a7888ca1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG os_brick.utils [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67e779e-6f61-494d-9a14-23874bce7093]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6698d9-105c-44c7-8919-22f3b656e3fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a556f42e-2190-430f-97c3-d71f8485d880]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efaf9b7-e2ea-45bb-8f01-e3cbc1001a01]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:51:13 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:51:13 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[61700965-664d-474a-b322-c7ea7c38ac31]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG os_brick.utils [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] <== get_connector_properties: return (267ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Updating existing volume attachment record: b9c69523-7529-4934-b620-87678aac9c48 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:51:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.587s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:51:13 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Deleted allocations for instance 9105f21a-ae71-43de-9ec7-2911ed2f5a01
Aug 15 00:51:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-45228453-20be-46d7-8b9a-e9eb4433b571 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "9105f21a-ae71-43de-9ec7-2911ed2f5a01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.899s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:51:14 user nova-compute[73010]: DEBUG nova.network.neutron [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Successfully created port: dff813d1-422b-4b69-b896-85274bba5dbb {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:51:14 user nova-compute[73010]: DEBUG nova.compute.manager [req-571a443e-41aa-4f9d-bf75-738c759605bf req-2b679b6f-6d22-4e14-adf2-8a45cecc1011 service nova] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Received event network-vif-deleted-a0b20ef5-895b-4455-a38d-a8cca288213f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:51:14 user nova-compute[73010]: DEBUG nova.network.neutron [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Successfully updated port: dff813d1-422b-4b69-b896-85274bba5dbb {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:51:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "refresh_cache-7eeadaaa-9d8b-44d2-a419-9bc5b595fc67" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:51:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquired lock "refresh_cache-7eeadaaa-9d8b-44d2-a419-9bc5b595fc67" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:51:14 user nova-compute[73010]: DEBUG nova.network.neutron [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:51:15 user nova-compute[73010]: DEBUG nova.network.neutron [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:51:15 user nova-compute[73010]: DEBUG nova.network.neutron [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Updating instance_info_cache with network_info: [{"id": "dff813d1-422b-4b69-b896-85274bba5dbb", "address": "fa:16:3e:54:5d:c5", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff813d1-42", "ovs_interfaceid": "dff813d1-422b-4b69-b896-85274bba5dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:51:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Releasing lock "refresh_cache-7eeadaaa-9d8b-44d2-a419-9bc5b595fc67" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:51:15 user nova-compute[73010]: DEBUG nova.compute.manager [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Instance network_info: |[{"id": "dff813d1-422b-4b69-b896-85274bba5dbb", "address": "fa:16:3e:54:5d:c5", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff813d1-42", "ovs_interfaceid": "dff813d1-422b-4b69-b896-85274bba5dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:51:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:16 user nova-compute[73010]: DEBUG nova.compute.manager [req-814ca64a-20f5-44f5-9654-2c4a26361516 req-d152e2d8-2d0e-44ae-a4bb-e3269ee86743 service nova] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Received event network-changed-dff813d1-422b-4b69-b896-85274bba5dbb {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:51:16 user nova-compute[73010]: DEBUG nova.compute.manager [req-814ca64a-20f5-44f5-9654-2c4a26361516 req-d152e2d8-2d0e-44ae-a4bb-e3269ee86743 service nova] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Refreshing instance network info cache due to event network-changed-dff813d1-422b-4b69-b896-85274bba5dbb. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:51:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-814ca64a-20f5-44f5-9654-2c4a26361516 req-d152e2d8-2d0e-44ae-a4bb-e3269ee86743 service nova] Acquiring lock "refresh_cache-7eeadaaa-9d8b-44d2-a419-9bc5b595fc67" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:51:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-814ca64a-20f5-44f5-9654-2c4a26361516 req-d152e2d8-2d0e-44ae-a4bb-e3269ee86743 service nova] Acquired lock "refresh_cache-7eeadaaa-9d8b-44d2-a419-9bc5b595fc67" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:51:16 user nova-compute[73010]: DEBUG nova.network.neutron [req-814ca64a-20f5-44f5-9654-2c4a26361516 req-d152e2d8-2d0e-44ae-a4bb-e3269ee86743 service nova] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Refreshing network info cache for port dff813d1-422b-4b69-b896-85274bba5dbb {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:51:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:17 user nova-compute[73010]: DEBUG nova.network.neutron [req-814ca64a-20f5-44f5-9654-2c4a26361516 req-d152e2d8-2d0e-44ae-a4bb-e3269ee86743 service nova] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Updated VIF entry in instance network info cache for port dff813d1-422b-4b69-b896-85274bba5dbb. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:51:17 user nova-compute[73010]: DEBUG nova.network.neutron [req-814ca64a-20f5-44f5-9654-2c4a26361516 req-d152e2d8-2d0e-44ae-a4bb-e3269ee86743 service nova] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Updating instance_info_cache with network_info: [{"id": "dff813d1-422b-4b69-b896-85274bba5dbb", "address": "fa:16:3e:54:5d:c5", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff813d1-42", "ovs_interfaceid": "dff813d1-422b-4b69-b896-85274bba5dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:51:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-814ca64a-20f5-44f5-9654-2c4a26361516 req-d152e2d8-2d0e-44ae-a4bb-e3269ee86743 service nova] Releasing lock "refresh_cache-7eeadaaa-9d8b-44d2-a419-9bc5b595fc67" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:51:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG nova.compute.manager [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:51:22 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Creating image(s)
Aug 15 00:51:22 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Did not create local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Ensure instance console log exists: /opt/stack/data/nova/instances/7eeadaaa-9d8b-44d2-a419-9bc5b595fc67/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Start _get_guest_xml network_info=[{"id": "dff813d1-422b-4b69-b896-85274bba5dbb", "address": "fa:16:3e:54:5d:c5", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff813d1-42", "ovs_interfaceid": "dff813d1-422b-4b69-b896-85274bba5dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FzYETeKg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7eeadaaa-9d8b-44d2-a419-9bc5b595fc67', 'attached_at': '', 'detached_at': '', 'volume_id': '92121257-8985-42dc-9f37-4e382c7953ad', 'serial': '92121257-8985-42dc-9f37-4e382c7953ad'}, 'disk_bus': 'virtio', 'attachment_id': 'b9c69523-7529-4934-b620-87678aac9c48', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:51:22 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:51:22 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:51:22 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FzYETeKg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:51:22 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:51:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:51:22 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:51:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:51:22 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:51:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb44f2b-3fcc-49a2-9951-16add6a174b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:51:22 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b99034-07ae-4661-a8ea-330e43750e1c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad] added
Aug 15 00:51:22 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:51:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5937ff-d5ce-4ea6-af85-cb11aa803cb7]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[456e0983-c9ab-45fd-a46a-aac8908fe380]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FzYETeKg {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FzYETeKg" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d777e248-419d-435a-b458-9fdf9da10940]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FzYETeKg'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[93921521-343b-48a0-9c3c-e4d1c77a9352]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4673b8b6-844e-4a21-920f-55706cbd8c35]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)
Aug 15 00:51:23 user nova-compute[73010]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:51:23 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)
Aug 15 00:51:23 user nova-compute[73010]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:51:23 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[45528449-e21b-475e-bfc4-2f9a6e4b0f97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad, portal: 172.16.0.220,3260]
Aug 15 00:51:23 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad, portal: 172.16.0.220,3260] successful.
Aug 15 00:51:23 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3139291-d7f4-4e27-ae94-2e1a26987adf]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced8474e-46a1-4969-bad6-d096459aaa78]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)
Aug 15 00:51:23 user nova-compute[73010]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:51:23 user nova-compute[73010]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:51:23 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)
Aug 15 00:51:23 user nova-compute[73010]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:51:23 user nova-compute[73010]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:51:23 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f583500-1984-4faa-8929-90bba2f3c02e]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FzYETeKg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:51:23 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060668.9522448, 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:51:23 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] VM Stopped (Lifecycle Event)
Aug 15 00:51:23 user nova-compute[73010]: DEBUG nova.compute.manager [None req-bfbcfa15-9beb-408d-b759-2ef1a976a9c6 None None] [instance: 8de0bd2b-fbff-47ff-bedd-d9b0ddc54e09] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:51:24 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:51:24 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23630316663633531', 'path': '/dev/sdb'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:51:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630316663633531', 'path': '/dev/sdb'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:51:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:51:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1141133609',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1141133609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1141133609',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5Sgf+0oqA9BkZpJlDCbh9WN/cg/l+p7Ht464qdJ/GcNNAlJ4pwa2r2zD/3Ymb7xJ466HhjMWVnhnsnTXcxXjgPOA2stIR+KTXJcOmdZhfQwQhOqml1XKZPg+aGV33AKg==',key_name='tempest-keypair-924938164',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f67d1031d3cb4c8fb66342a7888ca1c4',ramdisk_id='',reservation_id='r-ldkjw8l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1953358779',owner_user_name='tempest-TestVolumeBootPattern-1953358779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:51:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='daa4eb788f724a6fbf908b029315a02b',uuid=7eeadaaa-9d8b-44d2-a419-9bc5b595fc67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dff813d1-422b-4b69-b896-85274bba5dbb", "address": "fa:16:3e:54:5d:c5", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff813d1-42", "ovs_interfaceid": "dff813d1-422b-4b69-b896-85274bba5dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:51:24 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converting VIF {"id": "dff813d1-422b-4b69-b896-85274bba5dbb", "address": "fa:16:3e:54:5d:c5", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff813d1-42", "ovs_interfaceid": "dff813d1-422b-4b69-b896-85274bba5dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:51:24 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:5d:c5,bridge_name='br-int',has_traffic_filtering=True,id=dff813d1-422b-4b69-b896-85274bba5dbb,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff813d1-42') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:51:24 user nova-compute[73010]: DEBUG nova.objects.instance [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lazy-loading 'pci_devices' on Instance uuid 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:51:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:51:24 user nova-compute[73010]:   <uuid>7eeadaaa-9d8b-44d2-a419-9bc5b595fc67</uuid>
Aug 15 00:51:24 user nova-compute[73010]:   <name>instance-00000026</name>
Aug 15 00:51:24 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:51:24 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:51:24 user nova-compute[73010]:   <metadata>
Aug 15 00:51:24 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:51:24 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:51:24 user nova-compute[73010]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1141133609</nova:name>
Aug 15 00:51:24 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:51:22</nova:creationTime>
Aug 15 00:51:24 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:51:24 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:51:24 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:51:24 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:51:24 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:51:24 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:51:24 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:51:24 user nova-compute[73010]:       <nova:owner>
Aug 15 00:51:24 user nova-compute[73010]:         <nova:user uuid="daa4eb788f724a6fbf908b029315a02b">tempest-TestVolumeBootPattern-1953358779-project-member</nova:user>
Aug 15 00:51:24 user nova-compute[73010]:         <nova:project uuid="f67d1031d3cb4c8fb66342a7888ca1c4">tempest-TestVolumeBootPattern-1953358779</nova:project>
Aug 15 00:51:24 user nova-compute[73010]:       </nova:owner>
Aug 15 00:51:24 user nova-compute[73010]:       <nova:ports>
Aug 15 00:51:24 user nova-compute[73010]:         <nova:port uuid="dff813d1-422b-4b69-b896-85274bba5dbb">
Aug 15 00:51:24 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 00:51:24 user nova-compute[73010]:         </nova:port>
Aug 15 00:51:24 user nova-compute[73010]:       </nova:ports>
Aug 15 00:51:24 user nova-compute[73010]:     </nova:instance>
Aug 15 00:51:24 user nova-compute[73010]:   </metadata>
Aug 15 00:51:24 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:51:24 user nova-compute[73010]:     <system>
Aug 15 00:51:24 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:51:24 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:51:24 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:51:24 user nova-compute[73010]:       <entry name="serial">7eeadaaa-9d8b-44d2-a419-9bc5b595fc67</entry>
Aug 15 00:51:24 user nova-compute[73010]:       <entry name="uuid">7eeadaaa-9d8b-44d2-a419-9bc5b595fc67</entry>
Aug 15 00:51:24 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:51:24 user nova-compute[73010]:     </system>
Aug 15 00:51:24 user nova-compute[73010]:   </sysinfo>
Aug 15 00:51:24 user nova-compute[73010]:   <os>
Aug 15 00:51:24 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:51:24 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:51:24 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:51:24 user nova-compute[73010]:   </os>
Aug 15 00:51:24 user nova-compute[73010]:   <features>
Aug 15 00:51:24 user nova-compute[73010]:     <acpi/>
Aug 15 00:51:24 user nova-compute[73010]:     <apic/>
Aug 15 00:51:24 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:51:24 user nova-compute[73010]:   </features>
Aug 15 00:51:24 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:51:24 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:51:24 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:51:24 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:51:24 user nova-compute[73010]:   </clock>
Aug 15 00:51:24 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:51:24 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:51:24 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:51:24 user nova-compute[73010]:   </cpu>
Aug 15 00:51:24 user nova-compute[73010]:   <devices>
Aug 15 00:51:24 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 00:51:24 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:51:24 user nova-compute[73010]:       <source dev="/dev/sdb"/>
Aug 15 00:51:24 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:51:24 user nova-compute[73010]:       <serial>92121257-8985-42dc-9f37-4e382c7953ad</serial>
Aug 15 00:51:24 user nova-compute[73010]:     </disk>
Aug 15 00:51:24 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:51:24 user nova-compute[73010]:       <mac address="fa:16:3e:54:5d:c5"/>
Aug 15 00:51:24 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:51:24 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:51:24 user nova-compute[73010]:       <target dev="tapdff813d1-42"/>
Aug 15 00:51:24 user nova-compute[73010]:     </interface>
Aug 15 00:51:24 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:51:24 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/7eeadaaa-9d8b-44d2-a419-9bc5b595fc67/console.log" append="off"/>
Aug 15 00:51:24 user nova-compute[73010]:     </serial>
Aug 15 00:51:24 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:51:24 user nova-compute[73010]:     <video>
Aug 15 00:51:24 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:51:24 user nova-compute[73010]:     </video>
Aug 15 00:51:24 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:51:24 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:51:24 user nova-compute[73010]:     </rng>
Aug 15 00:51:24 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:51:24 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:51:24 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:51:24 user nova-compute[73010]:     </memballoon>
Aug 15 00:51:24 user nova-compute[73010]:   </devices>
Aug 15 00:51:24 user nova-compute[73010]: </domain>
Aug 15 00:51:24 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:51:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:51:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1141133609',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1141133609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1141133609',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5Sgf+0oqA9BkZpJlDCbh9WN/cg/l+p7Ht464qdJ/GcNNAlJ4pwa2r2zD/3Ymb7xJ466HhjMWVnhnsnTXcxXjgPOA2stIR+KTXJcOmdZhfQwQhOqml1XKZPg+aGV33AKg==',key_name='tempest-keypair-924938164',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f67d1031d3cb4c8fb66342a7888ca1c4',ramdisk_id='',reservation_id='r-ldkjw8l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1953358779',owner_user_name='tempest-TestVolumeBootPattern-1953358779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:51:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='daa4eb788f724a6fbf908b029315a02b',uuid=7eeadaaa-9d8b-44d2-a419-9bc5b595fc67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dff813d1-422b-4b69-b896-85274bba5dbb", "address": "fa:16:3e:54:5d:c5", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff813d1-42", "ovs_interfaceid": "dff813d1-422b-4b69-b896-85274bba5dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:51:24 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converting VIF {"id": "dff813d1-422b-4b69-b896-85274bba5dbb", "address": "fa:16:3e:54:5d:c5", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff813d1-42", "ovs_interfaceid": "dff813d1-422b-4b69-b896-85274bba5dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:51:24 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:5d:c5,bridge_name='br-int',has_traffic_filtering=True,id=dff813d1-422b-4b69-b896-85274bba5dbb,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff813d1-42') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:51:24 user nova-compute[73010]: DEBUG os_vif [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:5d:c5,bridge_name='br-int',has_traffic_filtering=True,id=dff813d1-422b-4b69-b896-85274bba5dbb,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff813d1-42') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:51:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:51:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:51:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdff813d1-42, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:51:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdff813d1-42, col_values=(('external_ids', {'iface-id': 'dff813d1-422b-4b69-b896-85274bba5dbb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:5d:c5', 'vm-uuid': '7eeadaaa-9d8b-44d2-a419-9bc5b595fc67'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:51:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:51:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:24 user nova-compute[73010]: INFO os_vif [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:5d:c5,bridge_name='br-int',has_traffic_filtering=True,id=dff813d1-422b-4b69-b896-85274bba5dbb,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff813d1-42')
Aug 15 00:51:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:51:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] No VIF found with MAC fa:16:3e:54:5d:c5, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:51:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:26 user nova-compute[73010]: DEBUG nova.compute.manager [req-4af1eb38-ec0e-4a56-9bd1-7da107fac035 req-2b5ffaa0-14a5-4462-b5a7-832dc37e7374 service nova] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Received event network-vif-plugged-dff813d1-422b-4b69-b896-85274bba5dbb {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:51:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4af1eb38-ec0e-4a56-9bd1-7da107fac035 req-2b5ffaa0-14a5-4462-b5a7-832dc37e7374 service nova] Acquiring lock "7eeadaaa-9d8b-44d2-a419-9bc5b595fc67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:51:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4af1eb38-ec0e-4a56-9bd1-7da107fac035 req-2b5ffaa0-14a5-4462-b5a7-832dc37e7374 service nova] Lock "7eeadaaa-9d8b-44d2-a419-9bc5b595fc67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:51:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4af1eb38-ec0e-4a56-9bd1-7da107fac035 req-2b5ffaa0-14a5-4462-b5a7-832dc37e7374 service nova] Lock "7eeadaaa-9d8b-44d2-a419-9bc5b595fc67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:51:26 user nova-compute[73010]: DEBUG nova.compute.manager [req-4af1eb38-ec0e-4a56-9bd1-7da107fac035 req-2b5ffaa0-14a5-4462-b5a7-832dc37e7374 service nova] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] No waiting events found dispatching network-vif-plugged-dff813d1-422b-4b69-b896-85274bba5dbb {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:51:26 user nova-compute[73010]: WARNING nova.compute.manager [req-4af1eb38-ec0e-4a56-9bd1-7da107fac035 req-2b5ffaa0-14a5-4462-b5a7-832dc37e7374 service nova] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Received unexpected event network-vif-plugged-dff813d1-422b-4b69-b896-85274bba5dbb for instance with vm_state building and task_state spawning.
Aug 15 00:51:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:26 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060671.6107738, 9105f21a-ae71-43de-9ec7-2911ed2f5a01 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:51:26 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] VM Stopped (Lifecycle Event)
Aug 15 00:51:26 user nova-compute[73010]: DEBUG nova.compute.manager [None req-dd572b05-1f28-4796-9dbd-76441c34ca14 None None] [instance: 9105f21a-ae71-43de-9ec7-2911ed2f5a01] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:51:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:27 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060687.8097334, 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:51:27 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] VM Resumed (Lifecycle Event)
Aug 15 00:51:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:51:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:51:27 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Instance spawned successfully.
Aug 15 00:51:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:51:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:51:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:51:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:51:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:51:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:51:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:51:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:51:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:51:27 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:51:27 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060687.8109448, 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:51:27 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] VM Started (Lifecycle Event)
Aug 15 00:51:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:51:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:51:27 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:51:27 user nova-compute[73010]: INFO nova.compute.manager [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Took 5.08 seconds to spawn the instance on the hypervisor.
Aug 15 00:51:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:51:28 user nova-compute[73010]: INFO nova.compute.manager [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Took 15.56 seconds to build instance.
Aug 15 00:51:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ab156d01-ccea-4321-a446-f91bc1ae91be tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "7eeadaaa-9d8b-44d2-a419-9bc5b595fc67" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.675s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:51:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-89185667-7692-410e-8c69-89993c752305 req-3df8200e-fb0b-4d4f-af52-89cf87e363e3 service nova] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Received event network-vif-plugged-dff813d1-422b-4b69-b896-85274bba5dbb {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:51:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-89185667-7692-410e-8c69-89993c752305 req-3df8200e-fb0b-4d4f-af52-89cf87e363e3 service nova] Acquiring lock "7eeadaaa-9d8b-44d2-a419-9bc5b595fc67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:51:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-89185667-7692-410e-8c69-89993c752305 req-3df8200e-fb0b-4d4f-af52-89cf87e363e3 service nova] Lock "7eeadaaa-9d8b-44d2-a419-9bc5b595fc67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:51:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-89185667-7692-410e-8c69-89993c752305 req-3df8200e-fb0b-4d4f-af52-89cf87e363e3 service nova] Lock "7eeadaaa-9d8b-44d2-a419-9bc5b595fc67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:51:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-89185667-7692-410e-8c69-89993c752305 req-3df8200e-fb0b-4d4f-af52-89cf87e363e3 service nova] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] No waiting events found dispatching network-vif-plugged-dff813d1-422b-4b69-b896-85274bba5dbb {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:51:28 user nova-compute[73010]: WARNING nova.compute.manager [req-89185667-7692-410e-8c69-89993c752305 req-3df8200e-fb0b-4d4f-af52-89cf87e363e3 service nova] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Received unexpected event network-vif-plugged-dff813d1-422b-4b69-b896-85274bba5dbb for instance with vm_state active and task_state None.
Aug 15 00:51:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f2324ac1-d9b0-4585-8aa6-6ff825c51680 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Acquiring lock "0ddb8ea1-8748-46ce-8387-c049819b67ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:51:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f2324ac1-d9b0-4585-8aa6-6ff825c51680 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Lock "0ddb8ea1-8748-46ce-8387-c049819b67ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:51:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f2324ac1-d9b0-4585-8aa6-6ff825c51680 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Acquiring lock "0ddb8ea1-8748-46ce-8387-c049819b67ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:51:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f2324ac1-d9b0-4585-8aa6-6ff825c51680 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Lock "0ddb8ea1-8748-46ce-8387-c049819b67ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:51:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f2324ac1-d9b0-4585-8aa6-6ff825c51680 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Lock "0ddb8ea1-8748-46ce-8387-c049819b67ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:51:38 user nova-compute[73010]: INFO nova.compute.manager [None req-f2324ac1-d9b0-4585-8aa6-6ff825c51680 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Terminating instance
Aug 15 00:51:38 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f2324ac1-d9b0-4585-8aa6-6ff825c51680 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:51:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:38 user nova-compute[73010]: DEBUG nova.compute.manager [req-c4609ef9-b8d8-4a36-8add-6d16b55bb2ba req-eb271f45-234e-4860-82d7-d385cb571121 service nova] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Received event network-vif-unplugged-3d940fe5-e022-4c81-a974-e316ed2fbd12 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:51:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c4609ef9-b8d8-4a36-8add-6d16b55bb2ba req-eb271f45-234e-4860-82d7-d385cb571121 service nova] Acquiring lock "0ddb8ea1-8748-46ce-8387-c049819b67ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:51:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c4609ef9-b8d8-4a36-8add-6d16b55bb2ba req-eb271f45-234e-4860-82d7-d385cb571121 service nova] Lock "0ddb8ea1-8748-46ce-8387-c049819b67ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:51:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c4609ef9-b8d8-4a36-8add-6d16b55bb2ba req-eb271f45-234e-4860-82d7-d385cb571121 service nova] Lock "0ddb8ea1-8748-46ce-8387-c049819b67ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:51:38 user nova-compute[73010]: DEBUG nova.compute.manager [req-c4609ef9-b8d8-4a36-8add-6d16b55bb2ba req-eb271f45-234e-4860-82d7-d385cb571121 service nova] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] No waiting events found dispatching network-vif-unplugged-3d940fe5-e022-4c81-a974-e316ed2fbd12 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:51:38 user nova-compute[73010]: DEBUG nova.compute.manager [req-c4609ef9-b8d8-4a36-8add-6d16b55bb2ba req-eb271f45-234e-4860-82d7-d385cb571121 service nova] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Received event network-vif-unplugged-3d940fe5-e022-4c81-a974-e316ed2fbd12 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:51:39 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Instance destroyed successfully.
Aug 15 00:51:39 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f2324ac1-d9b0-4585-8aa6-6ff825c51680 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Lazy-loading 'resources' on Instance uuid 0ddb8ea1-8748-46ce-8387-c049819b67ce {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:51:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-f2324ac1-d9b0-4585-8aa6-6ff825c51680 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1622643275',display_name='tempest-VolumesNegativeTest-instance-1622643275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1622643275',id=37,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:49:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce51084b3aff47da8c4eb4ee37868735',ramdisk_id='',reservation_id='r-jrk2fce4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1407531594',owner_user_name='tempest-VolumesNegativeTest-1407531594-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:49:55Z,user_data=None,user_id='53dcd6b09aaa48d4afb2093800d4dceb',uuid=0ddb8ea1-8748-46ce-8387-c049819b67ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d940fe5-e022-4c81-a974-e316ed2fbd12", "address": "fa:16:3e:76:5c:b9", "network": {"id": "362d171b-1bf1-46f7-a351-944d47736dcd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6f986236872347e7ae70dcf280523096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d940fe5-e0", "ovs_interfaceid": "3d940fe5-e022-4c81-a974-e316ed2fbd12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:51:39 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f2324ac1-d9b0-4585-8aa6-6ff825c51680 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Converting VIF {"id": "3d940fe5-e022-4c81-a974-e316ed2fbd12", "address": "fa:16:3e:76:5c:b9", "network": {"id": "362d171b-1bf1-46f7-a351-944d47736dcd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6f986236872347e7ae70dcf280523096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d940fe5-e0", "ovs_interfaceid": "3d940fe5-e022-4c81-a974-e316ed2fbd12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:51:39 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-f2324ac1-d9b0-4585-8aa6-6ff825c51680 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:5c:b9,bridge_name='br-int',has_traffic_filtering=True,id=3d940fe5-e022-4c81-a974-e316ed2fbd12,network=Network(362d171b-1bf1-46f7-a351-944d47736dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d940fe5-e0') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:51:39 user nova-compute[73010]: DEBUG os_vif [None req-f2324ac1-d9b0-4585-8aa6-6ff825c51680 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:5c:b9,bridge_name='br-int',has_traffic_filtering=True,id=3d940fe5-e022-4c81-a974-e316ed2fbd12,network=Network(362d171b-1bf1-46f7-a351-944d47736dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d940fe5-e0') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:51:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d940fe5-e0, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:51:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:39 user nova-compute[73010]: INFO os_vif [None req-f2324ac1-d9b0-4585-8aa6-6ff825c51680 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:5c:b9,bridge_name='br-int',has_traffic_filtering=True,id=3d940fe5-e022-4c81-a974-e316ed2fbd12,network=Network(362d171b-1bf1-46f7-a351-944d47736dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d940fe5-e0')
Aug 15 00:51:39 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-f2324ac1-d9b0-4585-8aa6-6ff825c51680 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Deleting instance files /opt/stack/data/nova/instances/0ddb8ea1-8748-46ce-8387-c049819b67ce_del
Aug 15 00:51:39 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-f2324ac1-d9b0-4585-8aa6-6ff825c51680 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Deletion of /opt/stack/data/nova/instances/0ddb8ea1-8748-46ce-8387-c049819b67ce_del complete
Aug 15 00:51:39 user nova-compute[73010]: INFO nova.compute.manager [None req-f2324ac1-d9b0-4585-8aa6-6ff825c51680 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Took 0.77 seconds to destroy the instance on the hypervisor.
Aug 15 00:51:39 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-f2324ac1-d9b0-4585-8aa6-6ff825c51680 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:51:39 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:51:39 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:51:39 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:51:39 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Took 0.64 seconds to deallocate network for instance.
Aug 15 00:51:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f2324ac1-d9b0-4585-8aa6-6ff825c51680 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:51:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f2324ac1-d9b0-4585-8aa6-6ff825c51680 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:51:40 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f2324ac1-d9b0-4585-8aa6-6ff825c51680 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:51:40 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f2324ac1-d9b0-4585-8aa6-6ff825c51680 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:51:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f2324ac1-d9b0-4585-8aa6-6ff825c51680 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:51:40 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-f2324ac1-d9b0-4585-8aa6-6ff825c51680 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Deleted allocations for instance 0ddb8ea1-8748-46ce-8387-c049819b67ce
Aug 15 00:51:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f2324ac1-d9b0-4585-8aa6-6ff825c51680 tempest-VolumesNegativeTest-1407531594 tempest-VolumesNegativeTest-1407531594-project-member] Lock "0ddb8ea1-8748-46ce-8387-c049819b67ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.023s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:51:40 user nova-compute[73010]: DEBUG nova.compute.manager [req-ed08925f-38b2-4c6c-8698-ef94f33a9125 req-5b93241f-ff89-4d04-ba8b-7f74834bdea6 service nova] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Received event network-vif-plugged-3d940fe5-e022-4c81-a974-e316ed2fbd12 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:51:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ed08925f-38b2-4c6c-8698-ef94f33a9125 req-5b93241f-ff89-4d04-ba8b-7f74834bdea6 service nova] Acquiring lock "0ddb8ea1-8748-46ce-8387-c049819b67ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:51:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ed08925f-38b2-4c6c-8698-ef94f33a9125 req-5b93241f-ff89-4d04-ba8b-7f74834bdea6 service nova] Lock "0ddb8ea1-8748-46ce-8387-c049819b67ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:51:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ed08925f-38b2-4c6c-8698-ef94f33a9125 req-5b93241f-ff89-4d04-ba8b-7f74834bdea6 service nova] Lock "0ddb8ea1-8748-46ce-8387-c049819b67ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:51:40 user nova-compute[73010]: DEBUG nova.compute.manager [req-ed08925f-38b2-4c6c-8698-ef94f33a9125 req-5b93241f-ff89-4d04-ba8b-7f74834bdea6 service nova] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] No waiting events found dispatching network-vif-plugged-3d940fe5-e022-4c81-a974-e316ed2fbd12 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:51:40 user nova-compute[73010]: WARNING nova.compute.manager [req-ed08925f-38b2-4c6c-8698-ef94f33a9125 req-5b93241f-ff89-4d04-ba8b-7f74834bdea6 service nova] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Received unexpected event network-vif-plugged-3d940fe5-e022-4c81-a974-e316ed2fbd12 for instance with vm_state deleted and task_state None.
Aug 15 00:51:40 user nova-compute[73010]: DEBUG nova.compute.manager [req-ed08925f-38b2-4c6c-8698-ef94f33a9125 req-5b93241f-ff89-4d04-ba8b-7f74834bdea6 service nova] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Received event network-vif-deleted-3d940fe5-e022-4c81-a974-e316ed2fbd12 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:51:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:54 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060699.191868, 0ddb8ea1-8748-46ce-8387-c049819b67ce => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:51:54 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] VM Stopped (Lifecycle Event)
Aug 15 00:51:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-521c9741-af9c-42c5-986b-85397b7646b4 None None] [instance: 0ddb8ea1-8748-46ce-8387-c049819b67ce] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:51:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:57 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:51:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:51:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:51:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:51:57 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:51:57 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:51:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.243s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:51:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:51:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:51:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:51:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:52:00 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:52:00 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:52:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=7888MB free_disk=25.62458038330078GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:52:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:52:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:52:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Applying migration context for instance f08393c9-17c8-40c0-b8de-e8b8237e9109 as it has an incoming, in-progress migration 5ec820f0-cab3-43ca-97c3-c3b6db148a4a. Migration status is finished {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 00:52:00 user nova-compute[73010]: INFO nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Updating resource usage from migration 5ec820f0-cab3-43ca-97c3-c3b6db148a4a
Aug 15 00:52:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6dfc356b-953a-47b0-9da7-70cc59a80853 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:52:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance eec545e8-eeda-443c-9892-980e19e7267a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:52:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4b489f97-c8d4-4a6a-8404-e1a05a990261 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:52:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance b94d5990-9053-4119-9228-fdbec348294f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:52:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Migration 5ec820f0-cab3-43ca-97c3-c3b6db148a4a is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 00:52:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance f08393c9-17c8-40c0-b8de-e8b8237e9109 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:52:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:52:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:52:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:52:00 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:52:00 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:52:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:52:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:52:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:07 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:52:07 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:52:07 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:52:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-4b489f97-c8d4-4a6a-8404-e1a05a990261" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:52:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-4b489f97-c8d4-4a6a-8404-e1a05a990261" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:52:07 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 00:52:08 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Updating instance_info_cache with network_info: [{"id": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "address": "fa:16:3e:31:6a:22", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da1cffd-22", "ovs_interfaceid": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:52:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-4b489f97-c8d4-4a6a-8404-e1a05a990261" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:52:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 00:52:08 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:52:08 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:52:08 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:52:08 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:52:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:52:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:10 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:52:12 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:52:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:52:18 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:52:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:52:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:52:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 00:52:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:52:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:52:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d6468f6b-705e-4889-839c-5f675880229a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "f08393c9-17c8-40c0-b8de-e8b8237e9109" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:52:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d6468f6b-705e-4889-839c-5f675880229a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:52:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-d6468f6b-705e-4889-839c-5f675880229a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Going to confirm migration 2 {{(pid=73010) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 15 00:52:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d6468f6b-705e-4889-839c-5f675880229a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "refresh_cache-f08393c9-17c8-40c0-b8de-e8b8237e9109" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:52:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d6468f6b-705e-4889-839c-5f675880229a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquired lock "refresh_cache-f08393c9-17c8-40c0-b8de-e8b8237e9109" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:52:20 user nova-compute[73010]: DEBUG nova.network.neutron [None req-d6468f6b-705e-4889-839c-5f675880229a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:52:20 user nova-compute[73010]: DEBUG nova.objects.instance [None req-d6468f6b-705e-4889-839c-5f675880229a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lazy-loading 'info_cache' on Instance uuid f08393c9-17c8-40c0-b8de-e8b8237e9109 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:52:21 user nova-compute[73010]: DEBUG nova.network.neutron [None req-d6468f6b-705e-4889-839c-5f675880229a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Updating instance_info_cache with network_info: [{"id": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "address": "fa:16:3e:57:45:d7", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03999c5a-8f", "ovs_interfaceid": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:52:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d6468f6b-705e-4889-839c-5f675880229a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Releasing lock "refresh_cache-f08393c9-17c8-40c0-b8de-e8b8237e9109" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:52:21 user nova-compute[73010]: DEBUG nova.objects.instance [None req-d6468f6b-705e-4889-839c-5f675880229a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lazy-loading 'migration_context' on Instance uuid f08393c9-17c8-40c0-b8de-e8b8237e9109 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:52:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d6468f6b-705e-4889-839c-5f675880229a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:52:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d6468f6b-705e-4889-839c-5f675880229a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:52:21 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-d6468f6b-705e-4889-839c-5f675880229a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:52:21 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-d6468f6b-705e-4889-839c-5f675880229a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:52:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d6468f6b-705e-4889-839c-5f675880229a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.459s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:52:21 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-d6468f6b-705e-4889-839c-5f675880229a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Deleted allocation for migration 5ec820f0-cab3-43ca-97c3-c3b6db148a4a
Aug 15 00:52:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d6468f6b-705e-4889-839c-5f675880229a tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.614s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:52:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "a736c704-e72e-4009-87e6-e165c5abe5bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:52:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "a736c704-e72e-4009-87e6-e165c5abe5bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:52:30 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:52:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:52:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:52:30 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:52:30 user nova-compute[73010]: INFO nova.compute.claims [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Claim successful on node user
Aug 15 00:52:30 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:52:30 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:52:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:52:30 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:52:30 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:52:30 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:52:30 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:52:30 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:52:30 user nova-compute[73010]: DEBUG nova.policy [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd89d0afcfdc549b391c4c37c04b54b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4dad0b4fa44c61b6cae2227e6b77d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:52:30 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:52:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:52:30 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Creating image(s)
Aug 15 00:52:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "/opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:52:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "/opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:52:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "/opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:52:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:52:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.180s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:52:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:52:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:52:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:52:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.199s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:52:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:52:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd/disk 1073741824" returned: 0 in 0.130s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:52:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:52:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:52:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.194s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:52:31 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:52:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:52:31 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Successfully created port: feecf72a-c68a-4948-9134-21ec312e4cc9 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:52:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:52:31 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Cannot resize image /opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:52:31 user nova-compute[73010]: DEBUG nova.objects.instance [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lazy-loading 'migration_context' on Instance uuid a736c704-e72e-4009-87e6-e165c5abe5bd {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:52:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:52:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Ensure instance console log exists: /opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:52:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:52:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:52:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Successfully updated port: feecf72a-c68a-4948-9134-21ec312e4cc9 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "refresh_cache-a736c704-e72e-4009-87e6-e165c5abe5bd" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquired lock "refresh_cache-a736c704-e72e-4009-87e6-e165c5abe5bd" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.compute.manager [req-07df5ab1-e173-409e-8ba6-e3b47659ac7c req-c7f0e565-61fe-4b35-b33d-b2765f4d1368 service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Received event network-changed-feecf72a-c68a-4948-9134-21ec312e4cc9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.compute.manager [req-07df5ab1-e173-409e-8ba6-e3b47659ac7c req-c7f0e565-61fe-4b35-b33d-b2765f4d1368 service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Refreshing instance network info cache due to event network-changed-feecf72a-c68a-4948-9134-21ec312e4cc9. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-07df5ab1-e173-409e-8ba6-e3b47659ac7c req-c7f0e565-61fe-4b35-b33d-b2765f4d1368 service nova] Acquiring lock "refresh_cache-a736c704-e72e-4009-87e6-e165c5abe5bd" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Updating instance_info_cache with network_info: [{"id": "feecf72a-c68a-4948-9134-21ec312e4cc9", "address": "fa:16:3e:36:65:77", "network": {"id": "97be784b-67e7-46e9-949a-510d7c526338", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207062863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4dad0b4fa44c61b6cae2227e6b77d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeecf72a-c6", "ovs_interfaceid": "feecf72a-c68a-4948-9134-21ec312e4cc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Releasing lock "refresh_cache-a736c704-e72e-4009-87e6-e165c5abe5bd" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Instance network_info: |[{"id": "feecf72a-c68a-4948-9134-21ec312e4cc9", "address": "fa:16:3e:36:65:77", "network": {"id": "97be784b-67e7-46e9-949a-510d7c526338", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207062863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4dad0b4fa44c61b6cae2227e6b77d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeecf72a-c6", "ovs_interfaceid": "feecf72a-c68a-4948-9134-21ec312e4cc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-07df5ab1-e173-409e-8ba6-e3b47659ac7c req-c7f0e565-61fe-4b35-b33d-b2765f4d1368 service nova] Acquired lock "refresh_cache-a736c704-e72e-4009-87e6-e165c5abe5bd" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.network.neutron [req-07df5ab1-e173-409e-8ba6-e3b47659ac7c req-c7f0e565-61fe-4b35-b33d-b2765f4d1368 service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Refreshing network info cache for port feecf72a-c68a-4948-9134-21ec312e4cc9 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Start _get_guest_xml network_info=[{"id": "feecf72a-c68a-4948-9134-21ec312e4cc9", "address": "fa:16:3e:36:65:77", "network": {"id": "97be784b-67e7-46e9-949a-510d7c526338", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207062863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4dad0b4fa44c61b6cae2227e6b77d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeecf72a-c6", "ovs_interfaceid": "feecf72a-c68a-4948-9134-21ec312e4cc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:52:32 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:52:32 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:52:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1128031251',display_name='tempest-VolumesSnapshotTestJSON-instance-1128031251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1128031251',id=39,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2rCJW4a0GQq/DQpXU4P6Atlq1q7zXRtMrXucByzC0onm2zF+LiZyzam5179NIvLOvW1n6AtzyP6sMmDEtcsdCcSjpUUa/1I59cWwF4r7O4TUMIzNIezWA60P4dRKHclQ==',key_name='tempest-keypair-1076869984',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca4dad0b4fa44c61b6cae2227e6b77d0',ramdisk_id='',reservation_id='r-ahjkg08h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1973403028',owner_user_name='tempest-VolumesSnapshotTestJSON-1973403028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:52:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d89d0afcfdc549b391c4c37c04b54b91',uuid=a736c704-e72e-4009-87e6-e165c5abe5bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "feecf72a-c68a-4948-9134-21ec312e4cc9", "address": "fa:16:3e:36:65:77", "network": {"id": "97be784b-67e7-46e9-949a-510d7c526338", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207062863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4dad0b4fa44c61b6cae2227e6b77d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeecf72a-c6", "ovs_interfaceid": "feecf72a-c68a-4948-9134-21ec312e4cc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Converting VIF {"id": "feecf72a-c68a-4948-9134-21ec312e4cc9", "address": "fa:16:3e:36:65:77", "network": {"id": "97be784b-67e7-46e9-949a-510d7c526338", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207062863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4dad0b4fa44c61b6cae2227e6b77d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeecf72a-c6", "ovs_interfaceid": "feecf72a-c68a-4948-9134-21ec312e4cc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:65:77,bridge_name='br-int',has_traffic_filtering=True,id=feecf72a-c68a-4948-9134-21ec312e4cc9,network=Network(97be784b-67e7-46e9-949a-510d7c526338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeecf72a-c6') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.objects.instance [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lazy-loading 'pci_devices' on Instance uuid a736c704-e72e-4009-87e6-e165c5abe5bd {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:52:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:52:32 user nova-compute[73010]:   <uuid>a736c704-e72e-4009-87e6-e165c5abe5bd</uuid>
Aug 15 00:52:32 user nova-compute[73010]:   <name>instance-00000027</name>
Aug 15 00:52:32 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:52:32 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:52:32 user nova-compute[73010]:   <metadata>
Aug 15 00:52:32 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:52:32 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:52:32 user nova-compute[73010]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1128031251</nova:name>
Aug 15 00:52:32 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:52:32</nova:creationTime>
Aug 15 00:52:32 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:52:32 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:52:32 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:52:32 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:52:32 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:52:32 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:52:32 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:52:32 user nova-compute[73010]:       <nova:owner>
Aug 15 00:52:32 user nova-compute[73010]:         <nova:user uuid="d89d0afcfdc549b391c4c37c04b54b91">tempest-VolumesSnapshotTestJSON-1973403028-project-member</nova:user>
Aug 15 00:52:32 user nova-compute[73010]:         <nova:project uuid="ca4dad0b4fa44c61b6cae2227e6b77d0">tempest-VolumesSnapshotTestJSON-1973403028</nova:project>
Aug 15 00:52:32 user nova-compute[73010]:       </nova:owner>
Aug 15 00:52:32 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:52:32 user nova-compute[73010]:       <nova:ports>
Aug 15 00:52:32 user nova-compute[73010]:         <nova:port uuid="feecf72a-c68a-4948-9134-21ec312e4cc9">
Aug 15 00:52:32 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 00:52:32 user nova-compute[73010]:         </nova:port>
Aug 15 00:52:32 user nova-compute[73010]:       </nova:ports>
Aug 15 00:52:32 user nova-compute[73010]:     </nova:instance>
Aug 15 00:52:32 user nova-compute[73010]:   </metadata>
Aug 15 00:52:32 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:52:32 user nova-compute[73010]:     <system>
Aug 15 00:52:32 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:52:32 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:52:32 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:52:32 user nova-compute[73010]:       <entry name="serial">a736c704-e72e-4009-87e6-e165c5abe5bd</entry>
Aug 15 00:52:32 user nova-compute[73010]:       <entry name="uuid">a736c704-e72e-4009-87e6-e165c5abe5bd</entry>
Aug 15 00:52:32 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:52:32 user nova-compute[73010]:     </system>
Aug 15 00:52:32 user nova-compute[73010]:   </sysinfo>
Aug 15 00:52:32 user nova-compute[73010]:   <os>
Aug 15 00:52:32 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:52:32 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:52:32 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:52:32 user nova-compute[73010]:   </os>
Aug 15 00:52:32 user nova-compute[73010]:   <features>
Aug 15 00:52:32 user nova-compute[73010]:     <acpi/>
Aug 15 00:52:32 user nova-compute[73010]:     <apic/>
Aug 15 00:52:32 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:52:32 user nova-compute[73010]:   </features>
Aug 15 00:52:32 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:52:32 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:52:32 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:52:32 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:52:32 user nova-compute[73010]:   </clock>
Aug 15 00:52:32 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:52:32 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:52:32 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:52:32 user nova-compute[73010]:   </cpu>
Aug 15 00:52:32 user nova-compute[73010]:   <devices>
Aug 15 00:52:32 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:52:32 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:52:32 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd/disk"/>
Aug 15 00:52:32 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:52:32 user nova-compute[73010]:     </disk>
Aug 15 00:52:32 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:52:32 user nova-compute[73010]:       <mac address="fa:16:3e:36:65:77"/>
Aug 15 00:52:32 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:52:32 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:52:32 user nova-compute[73010]:       <target dev="tapfeecf72a-c6"/>
Aug 15 00:52:32 user nova-compute[73010]:     </interface>
Aug 15 00:52:32 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:52:32 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd/console.log" append="off"/>
Aug 15 00:52:32 user nova-compute[73010]:     </serial>
Aug 15 00:52:32 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:52:32 user nova-compute[73010]:     <video>
Aug 15 00:52:32 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:52:32 user nova-compute[73010]:     </video>
Aug 15 00:52:32 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:52:32 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:52:32 user nova-compute[73010]:     </rng>
Aug 15 00:52:32 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:52:32 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:52:32 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:52:32 user nova-compute[73010]:     </memballoon>
Aug 15 00:52:32 user nova-compute[73010]:   </devices>
Aug 15 00:52:32 user nova-compute[73010]: </domain>
Aug 15 00:52:32 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:52:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:52:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1128031251',display_name='tempest-VolumesSnapshotTestJSON-instance-1128031251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1128031251',id=39,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2rCJW4a0GQq/DQpXU4P6Atlq1q7zXRtMrXucByzC0onm2zF+LiZyzam5179NIvLOvW1n6AtzyP6sMmDEtcsdCcSjpUUa/1I59cWwF4r7O4TUMIzNIezWA60P4dRKHclQ==',key_name='tempest-keypair-1076869984',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca4dad0b4fa44c61b6cae2227e6b77d0',ramdisk_id='',reservation_id='r-ahjkg08h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1973403028',owner_user_name='tempest-VolumesSnapshotTestJSON-1973403028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:52:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d89d0afcfdc549b391c4c37c04b54b91',uuid=a736c704-e72e-4009-87e6-e165c5abe5bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "feecf72a-c68a-4948-9134-21ec312e4cc9", "address": "fa:16:3e:36:65:77", "network": {"id": "97be784b-67e7-46e9-949a-510d7c526338", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207062863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4dad0b4fa44c61b6cae2227e6b77d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeecf72a-c6", "ovs_interfaceid": "feecf72a-c68a-4948-9134-21ec312e4cc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:52:33 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Converting VIF {"id": "feecf72a-c68a-4948-9134-21ec312e4cc9", "address": "fa:16:3e:36:65:77", "network": {"id": "97be784b-67e7-46e9-949a-510d7c526338", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207062863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4dad0b4fa44c61b6cae2227e6b77d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeecf72a-c6", "ovs_interfaceid": "feecf72a-c68a-4948-9134-21ec312e4cc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:52:33 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:65:77,bridge_name='br-int',has_traffic_filtering=True,id=feecf72a-c68a-4948-9134-21ec312e4cc9,network=Network(97be784b-67e7-46e9-949a-510d7c526338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeecf72a-c6') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:52:33 user nova-compute[73010]: DEBUG os_vif [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:65:77,bridge_name='br-int',has_traffic_filtering=True,id=feecf72a-c68a-4948-9134-21ec312e4cc9,network=Network(97be784b-67e7-46e9-949a-510d7c526338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeecf72a-c6') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:52:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:52:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:52:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfeecf72a-c6, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:52:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfeecf72a-c6, col_values=(('external_ids', {'iface-id': 'feecf72a-c68a-4948-9134-21ec312e4cc9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:65:77', 'vm-uuid': 'a736c704-e72e-4009-87e6-e165c5abe5bd'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:52:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:52:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:33 user nova-compute[73010]: INFO os_vif [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:65:77,bridge_name='br-int',has_traffic_filtering=True,id=feecf72a-c68a-4948-9134-21ec312e4cc9,network=Network(97be784b-67e7-46e9-949a-510d7c526338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeecf72a-c6')
Aug 15 00:52:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:52:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] No VIF found with MAC fa:16:3e:36:65:77, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:52:33 user nova-compute[73010]: DEBUG nova.network.neutron [req-07df5ab1-e173-409e-8ba6-e3b47659ac7c req-c7f0e565-61fe-4b35-b33d-b2765f4d1368 service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Updated VIF entry in instance network info cache for port feecf72a-c68a-4948-9134-21ec312e4cc9. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:52:33 user nova-compute[73010]: DEBUG nova.network.neutron [req-07df5ab1-e173-409e-8ba6-e3b47659ac7c req-c7f0e565-61fe-4b35-b33d-b2765f4d1368 service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Updating instance_info_cache with network_info: [{"id": "feecf72a-c68a-4948-9134-21ec312e4cc9", "address": "fa:16:3e:36:65:77", "network": {"id": "97be784b-67e7-46e9-949a-510d7c526338", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207062863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4dad0b4fa44c61b6cae2227e6b77d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeecf72a-c6", "ovs_interfaceid": "feecf72a-c68a-4948-9134-21ec312e4cc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:52:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-07df5ab1-e173-409e-8ba6-e3b47659ac7c req-c7f0e565-61fe-4b35-b33d-b2765f4d1368 service nova] Releasing lock "refresh_cache-a736c704-e72e-4009-87e6-e165c5abe5bd" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:52:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:34 user nova-compute[73010]: DEBUG nova.compute.manager [req-0c945624-141d-4976-bba8-0356dba415ee req-cbef4a3d-385c-4e9c-b9e3-6cf122b36d7e service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Received event network-vif-plugged-feecf72a-c68a-4948-9134-21ec312e4cc9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:52:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0c945624-141d-4976-bba8-0356dba415ee req-cbef4a3d-385c-4e9c-b9e3-6cf122b36d7e service nova] Acquiring lock "a736c704-e72e-4009-87e6-e165c5abe5bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:52:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0c945624-141d-4976-bba8-0356dba415ee req-cbef4a3d-385c-4e9c-b9e3-6cf122b36d7e service nova] Lock "a736c704-e72e-4009-87e6-e165c5abe5bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:52:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0c945624-141d-4976-bba8-0356dba415ee req-cbef4a3d-385c-4e9c-b9e3-6cf122b36d7e service nova] Lock "a736c704-e72e-4009-87e6-e165c5abe5bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:52:34 user nova-compute[73010]: DEBUG nova.compute.manager [req-0c945624-141d-4976-bba8-0356dba415ee req-cbef4a3d-385c-4e9c-b9e3-6cf122b36d7e service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] No waiting events found dispatching network-vif-plugged-feecf72a-c68a-4948-9134-21ec312e4cc9 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:52:34 user nova-compute[73010]: WARNING nova.compute.manager [req-0c945624-141d-4976-bba8-0356dba415ee req-cbef4a3d-385c-4e9c-b9e3-6cf122b36d7e service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Received unexpected event network-vif-plugged-feecf72a-c68a-4948-9134-21ec312e4cc9 for instance with vm_state building and task_state spawning.
Aug 15 00:52:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:36 user nova-compute[73010]: DEBUG nova.compute.manager [req-1702601c-437c-4d78-81ca-1c698ad6af08 req-789de584-815e-4425-9da6-3d86471fbc05 service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Received event network-vif-plugged-feecf72a-c68a-4948-9134-21ec312e4cc9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:52:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1702601c-437c-4d78-81ca-1c698ad6af08 req-789de584-815e-4425-9da6-3d86471fbc05 service nova] Acquiring lock "a736c704-e72e-4009-87e6-e165c5abe5bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:52:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1702601c-437c-4d78-81ca-1c698ad6af08 req-789de584-815e-4425-9da6-3d86471fbc05 service nova] Lock "a736c704-e72e-4009-87e6-e165c5abe5bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:52:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1702601c-437c-4d78-81ca-1c698ad6af08 req-789de584-815e-4425-9da6-3d86471fbc05 service nova] Lock "a736c704-e72e-4009-87e6-e165c5abe5bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:52:36 user nova-compute[73010]: DEBUG nova.compute.manager [req-1702601c-437c-4d78-81ca-1c698ad6af08 req-789de584-815e-4425-9da6-3d86471fbc05 service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] No waiting events found dispatching network-vif-plugged-feecf72a-c68a-4948-9134-21ec312e4cc9 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:52:36 user nova-compute[73010]: WARNING nova.compute.manager [req-1702601c-437c-4d78-81ca-1c698ad6af08 req-789de584-815e-4425-9da6-3d86471fbc05 service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Received unexpected event network-vif-plugged-feecf72a-c68a-4948-9134-21ec312e4cc9 for instance with vm_state building and task_state spawning.
Aug 15 00:52:36 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060756.8891792, a736c704-e72e-4009-87e6-e165c5abe5bd => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:52:36 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] VM Resumed (Lifecycle Event)
Aug 15 00:52:36 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:52:36 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:52:36 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Instance spawned successfully.
Aug 15 00:52:36 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:52:36 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:52:36 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:52:36 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:52:36 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:52:36 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:52:36 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:52:36 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:52:36 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:52:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:36 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:52:36 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060756.8908541, a736c704-e72e-4009-87e6-e165c5abe5bd => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:52:36 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] VM Started (Lifecycle Event)
Aug 15 00:52:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:52:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:52:37 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:52:37 user nova-compute[73010]: INFO nova.compute.manager [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Took 6.08 seconds to spawn the instance on the hypervisor.
Aug 15 00:52:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:52:37 user nova-compute[73010]: INFO nova.compute.manager [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Took 6.81 seconds to build instance.
Aug 15 00:52:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c70335c5-5c49-4575-8f7c-4ca5b149dbfa tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "a736c704-e72e-4009-87e6-e165c5abe5bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.911s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:52:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:46 user nova-compute[73010]: INFO nova.compute.manager [None req-c00045bf-4e64-437e-8f0d-319973e269e9 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Unrescuing
Aug 15 00:52:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c00045bf-4e64-437e-8f0d-319973e269e9 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "refresh_cache-b94d5990-9053-4119-9228-fdbec348294f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:52:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c00045bf-4e64-437e-8f0d-319973e269e9 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquired lock "refresh_cache-b94d5990-9053-4119-9228-fdbec348294f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:52:46 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c00045bf-4e64-437e-8f0d-319973e269e9 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:52:46 user nova-compute[73010]: DEBUG nova.network.neutron [None req-c00045bf-4e64-437e-8f0d-319973e269e9 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Updating instance_info_cache with network_info: [{"id": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "address": "fa:16:3e:54:79:b9", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e5551e5-7a", "ovs_interfaceid": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:52:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c00045bf-4e64-437e-8f0d-319973e269e9 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Releasing lock "refresh_cache-b94d5990-9053-4119-9228-fdbec348294f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:52:46 user nova-compute[73010]: DEBUG nova.objects.instance [None req-c00045bf-4e64-437e-8f0d-319973e269e9 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'flavor' on Instance uuid b94d5990-9053-4119-9228-fdbec348294f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:52:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:47 user nova-compute[73010]: DEBUG nova.compute.manager [req-01d67615-783a-4d7b-b0de-276b6fa70cad req-48a08d4f-2072-437f-ab91-f51dded4832a service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received event network-vif-unplugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:52:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-01d67615-783a-4d7b-b0de-276b6fa70cad req-48a08d4f-2072-437f-ab91-f51dded4832a service nova] Acquiring lock "b94d5990-9053-4119-9228-fdbec348294f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:52:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-01d67615-783a-4d7b-b0de-276b6fa70cad req-48a08d4f-2072-437f-ab91-f51dded4832a service nova] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:52:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-01d67615-783a-4d7b-b0de-276b6fa70cad req-48a08d4f-2072-437f-ab91-f51dded4832a service nova] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:52:47 user nova-compute[73010]: DEBUG nova.compute.manager [req-01d67615-783a-4d7b-b0de-276b6fa70cad req-48a08d4f-2072-437f-ab91-f51dded4832a service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] No waiting events found dispatching network-vif-unplugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:52:47 user nova-compute[73010]: WARNING nova.compute.manager [req-01d67615-783a-4d7b-b0de-276b6fa70cad req-48a08d4f-2072-437f-ab91-f51dded4832a service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received unexpected event network-vif-unplugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 for instance with vm_state rescued and task_state unrescuing.
Aug 15 00:52:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:47 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: b94d5990-9053-4119-9228-fdbec348294f] Instance destroyed successfully.
Aug 15 00:52:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:49 user nova-compute[73010]: DEBUG nova.compute.manager [req-b6397a1b-1d75-40c0-8892-307a01410c3e req-6e50bdea-3030-420b-923b-c77aedad9841 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received event network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:52:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b6397a1b-1d75-40c0-8892-307a01410c3e req-6e50bdea-3030-420b-923b-c77aedad9841 service nova] Acquiring lock "b94d5990-9053-4119-9228-fdbec348294f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:52:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b6397a1b-1d75-40c0-8892-307a01410c3e req-6e50bdea-3030-420b-923b-c77aedad9841 service nova] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:52:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b6397a1b-1d75-40c0-8892-307a01410c3e req-6e50bdea-3030-420b-923b-c77aedad9841 service nova] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:52:49 user nova-compute[73010]: DEBUG nova.compute.manager [req-b6397a1b-1d75-40c0-8892-307a01410c3e req-6e50bdea-3030-420b-923b-c77aedad9841 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] No waiting events found dispatching network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:52:49 user nova-compute[73010]: WARNING nova.compute.manager [req-b6397a1b-1d75-40c0-8892-307a01410c3e req-6e50bdea-3030-420b-923b-c77aedad9841 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received unexpected event network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 for instance with vm_state rescued and task_state unrescuing.
Aug 15 00:52:49 user nova-compute[73010]: DEBUG nova.compute.manager [req-b6397a1b-1d75-40c0-8892-307a01410c3e req-6e50bdea-3030-420b-923b-c77aedad9841 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received event network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:52:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b6397a1b-1d75-40c0-8892-307a01410c3e req-6e50bdea-3030-420b-923b-c77aedad9841 service nova] Acquiring lock "b94d5990-9053-4119-9228-fdbec348294f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:52:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b6397a1b-1d75-40c0-8892-307a01410c3e req-6e50bdea-3030-420b-923b-c77aedad9841 service nova] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:52:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b6397a1b-1d75-40c0-8892-307a01410c3e req-6e50bdea-3030-420b-923b-c77aedad9841 service nova] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:52:49 user nova-compute[73010]: DEBUG nova.compute.manager [req-b6397a1b-1d75-40c0-8892-307a01410c3e req-6e50bdea-3030-420b-923b-c77aedad9841 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] No waiting events found dispatching network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:52:49 user nova-compute[73010]: WARNING nova.compute.manager [req-b6397a1b-1d75-40c0-8892-307a01410c3e req-6e50bdea-3030-420b-923b-c77aedad9841 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received unexpected event network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 for instance with vm_state rescued and task_state unrescuing.
Aug 15 00:52:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Removed pending event for b94d5990-9053-4119-9228-fdbec348294f due to event {{(pid=73010) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 00:52:51 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060771.2088058, b94d5990-9053-4119-9228-fdbec348294f => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:52:51 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] VM Resumed (Lifecycle Event)
Aug 15 00:52:51 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c00045bf-4e64-437e-8f0d-319973e269e9 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:52:51 user nova-compute[73010]: DEBUG nova.compute.manager [req-4c34d62a-01a0-44fa-ad27-c70d2a59b08d req-c7574df5-c5c4-4a46-85a9-945f300d4b86 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received event network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:52:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4c34d62a-01a0-44fa-ad27-c70d2a59b08d req-c7574df5-c5c4-4a46-85a9-945f300d4b86 service nova] Acquiring lock "b94d5990-9053-4119-9228-fdbec348294f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:52:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4c34d62a-01a0-44fa-ad27-c70d2a59b08d req-c7574df5-c5c4-4a46-85a9-945f300d4b86 service nova] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:52:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4c34d62a-01a0-44fa-ad27-c70d2a59b08d req-c7574df5-c5c4-4a46-85a9-945f300d4b86 service nova] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:52:51 user nova-compute[73010]: DEBUG nova.compute.manager [req-4c34d62a-01a0-44fa-ad27-c70d2a59b08d req-c7574df5-c5c4-4a46-85a9-945f300d4b86 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] No waiting events found dispatching network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:52:51 user nova-compute[73010]: WARNING nova.compute.manager [req-4c34d62a-01a0-44fa-ad27-c70d2a59b08d req-c7574df5-c5c4-4a46-85a9-945f300d4b86 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received unexpected event network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 for instance with vm_state rescued and task_state unrescuing.
Aug 15 00:52:51 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:52:51 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:52:51 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 00:52:51 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060771.2101314, b94d5990-9053-4119-9228-fdbec348294f => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:52:51 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] VM Started (Lifecycle Event)
Aug 15 00:52:51 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:52:51 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:52:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:57 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:52:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:52:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:52:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:52:57 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:52:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:52:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:52:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:52:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:52:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:52:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:52:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:52:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:52:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:52:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:52:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:52:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:52:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:52:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:52:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:52:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:52:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:52:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:52:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:52:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:52:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:52:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:52:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:52:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:53:00 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:53:00 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:53:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=7833MB free_disk=25.592548370361328GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:53:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:53:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:53:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6dfc356b-953a-47b0-9da7-70cc59a80853 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:53:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance eec545e8-eeda-443c-9892-980e19e7267a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:53:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4b489f97-c8d4-4a6a-8404-e1a05a990261 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:53:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance b94d5990-9053-4119-9228-fdbec348294f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:53:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance f08393c9-17c8-40c0-b8de-e8b8237e9109 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:53:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:53:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance a736c704-e72e-4009-87e6-e165c5abe5bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:53:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:53:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:53:01 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:53:01 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:53:01 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:53:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.425s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:53:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:04 user nova-compute[73010]: DEBUG nova.compute.manager [req-5dc5793f-a740-4e95-b7e4-2408b5e3a7de req-7ee5a8cf-bc7e-459b-bf7b-22304b330242 service nova] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Received event network-changed-dff813d1-422b-4b69-b896-85274bba5dbb {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:53:04 user nova-compute[73010]: DEBUG nova.compute.manager [req-5dc5793f-a740-4e95-b7e4-2408b5e3a7de req-7ee5a8cf-bc7e-459b-bf7b-22304b330242 service nova] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Refreshing instance network info cache due to event network-changed-dff813d1-422b-4b69-b896-85274bba5dbb. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:53:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5dc5793f-a740-4e95-b7e4-2408b5e3a7de req-7ee5a8cf-bc7e-459b-bf7b-22304b330242 service nova] Acquiring lock "refresh_cache-7eeadaaa-9d8b-44d2-a419-9bc5b595fc67" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:53:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5dc5793f-a740-4e95-b7e4-2408b5e3a7de req-7ee5a8cf-bc7e-459b-bf7b-22304b330242 service nova] Acquired lock "refresh_cache-7eeadaaa-9d8b-44d2-a419-9bc5b595fc67" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:53:04 user nova-compute[73010]: DEBUG nova.network.neutron [req-5dc5793f-a740-4e95-b7e4-2408b5e3a7de req-7ee5a8cf-bc7e-459b-bf7b-22304b330242 service nova] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Refreshing network info cache for port dff813d1-422b-4b69-b896-85274bba5dbb {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:53:04 user nova-compute[73010]: DEBUG nova.network.neutron [req-5dc5793f-a740-4e95-b7e4-2408b5e3a7de req-7ee5a8cf-bc7e-459b-bf7b-22304b330242 service nova] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Updated VIF entry in instance network info cache for port dff813d1-422b-4b69-b896-85274bba5dbb. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:53:04 user nova-compute[73010]: DEBUG nova.network.neutron [req-5dc5793f-a740-4e95-b7e4-2408b5e3a7de req-7ee5a8cf-bc7e-459b-bf7b-22304b330242 service nova] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Updating instance_info_cache with network_info: [{"id": "dff813d1-422b-4b69-b896-85274bba5dbb", "address": "fa:16:3e:54:5d:c5", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff813d1-42", "ovs_interfaceid": "dff813d1-422b-4b69-b896-85274bba5dbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:53:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5dc5793f-a740-4e95-b7e4-2408b5e3a7de req-7ee5a8cf-bc7e-459b-bf7b-22304b330242 service nova] Releasing lock "refresh_cache-7eeadaaa-9d8b-44d2-a419-9bc5b595fc67" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:53:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:07 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:53:07 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:53:07 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:53:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-f08393c9-17c8-40c0-b8de-e8b8237e9109" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:53:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-f08393c9-17c8-40c0-b8de-e8b8237e9109" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:53:07 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 00:53:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:08 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Updating instance_info_cache with network_info: [{"id": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "address": "fa:16:3e:57:45:d7", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03999c5a-8f", "ovs_interfaceid": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:53:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-f08393c9-17c8-40c0-b8de-e8b8237e9109" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:53:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 00:53:08 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:53:08 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:53:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Cleaning up deleted instances {{(pid=73010) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 00:53:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] There are 0 instances to clean {{(pid=73010) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 00:53:08 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:53:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:53:09 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:53:10 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:53:11 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:53:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:13 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:53:13 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:53:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "77e3348e-1697-45e0-9409-710017e0222c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:53:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "77e3348e-1697-45e0-9409-710017e0222c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:53:16 user nova-compute[73010]: DEBUG nova.compute.manager [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:53:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:53:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:53:16 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:53:16 user nova-compute[73010]: INFO nova.compute.claims [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Claim successful on node user
Aug 15 00:53:16 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:53:16 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:53:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:53:16 user nova-compute[73010]: DEBUG nova.compute.manager [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:53:16 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:53:16 user nova-compute[73010]: DEBUG nova.compute.manager [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:53:16 user nova-compute[73010]: DEBUG nova.network.neutron [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:53:16 user nova-compute[73010]: DEBUG nova.compute.manager [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:53:16 user nova-compute[73010]: INFO nova.virt.block_device [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Booting with volume snapshot b2fdb09f-710e-43d7-9430-7294a9e34d28 at /dev/vda
Aug 15 00:53:16 user nova-compute[73010]: DEBUG nova.policy [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'daa4eb788f724a6fbf908b029315a02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67d1031d3cb4c8fb66342a7888ca1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:53:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:17 user nova-compute[73010]: DEBUG nova.network.neutron [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Successfully created port: 54ab08b8-0782-47ee-851c-66ce82be651c {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:53:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:18 user nova-compute[73010]: DEBUG nova.network.neutron [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Successfully updated port: 54ab08b8-0782-47ee-851c-66ce82be651c {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:53:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "refresh_cache-77e3348e-1697-45e0-9409-710017e0222c" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:53:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquired lock "refresh_cache-77e3348e-1697-45e0-9409-710017e0222c" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:53:18 user nova-compute[73010]: DEBUG nova.network.neutron [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:53:18 user nova-compute[73010]: DEBUG nova.network.neutron [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:53:18 user nova-compute[73010]: DEBUG nova.network.neutron [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Updating instance_info_cache with network_info: [{"id": "54ab08b8-0782-47ee-851c-66ce82be651c", "address": "fa:16:3e:48:ef:e8", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ab08b8-07", "ovs_interfaceid": "54ab08b8-0782-47ee-851c-66ce82be651c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:53:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Releasing lock "refresh_cache-77e3348e-1697-45e0-9409-710017e0222c" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:53:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Instance network_info: |[{"id": "54ab08b8-0782-47ee-851c-66ce82be651c", "address": "fa:16:3e:48:ef:e8", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ab08b8-07", "ovs_interfaceid": "54ab08b8-0782-47ee-851c-66ce82be651c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:53:18 user nova-compute[73010]: DEBUG nova.compute.manager [req-0c4149c7-2095-44f8-828e-ddde78a08ccd req-ecfdc4d2-cf1f-467b-8618-8f07146bdcbe service nova] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Received event network-changed-54ab08b8-0782-47ee-851c-66ce82be651c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:53:18 user nova-compute[73010]: DEBUG nova.compute.manager [req-0c4149c7-2095-44f8-828e-ddde78a08ccd req-ecfdc4d2-cf1f-467b-8618-8f07146bdcbe service nova] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Refreshing instance network info cache due to event network-changed-54ab08b8-0782-47ee-851c-66ce82be651c. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:53:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0c4149c7-2095-44f8-828e-ddde78a08ccd req-ecfdc4d2-cf1f-467b-8618-8f07146bdcbe service nova] Acquiring lock "refresh_cache-77e3348e-1697-45e0-9409-710017e0222c" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:53:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0c4149c7-2095-44f8-828e-ddde78a08ccd req-ecfdc4d2-cf1f-467b-8618-8f07146bdcbe service nova] Acquired lock "refresh_cache-77e3348e-1697-45e0-9409-710017e0222c" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:53:18 user nova-compute[73010]: DEBUG nova.network.neutron [req-0c4149c7-2095-44f8-828e-ddde78a08ccd req-ecfdc4d2-cf1f-467b-8618-8f07146bdcbe service nova] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Refreshing network info cache for port 54ab08b8-0782-47ee-851c-66ce82be651c {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:53:19 user nova-compute[73010]: DEBUG nova.network.neutron [req-0c4149c7-2095-44f8-828e-ddde78a08ccd req-ecfdc4d2-cf1f-467b-8618-8f07146bdcbe service nova] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Updated VIF entry in instance network info cache for port 54ab08b8-0782-47ee-851c-66ce82be651c. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:53:19 user nova-compute[73010]: DEBUG nova.network.neutron [req-0c4149c7-2095-44f8-828e-ddde78a08ccd req-ecfdc4d2-cf1f-467b-8618-8f07146bdcbe service nova] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Updating instance_info_cache with network_info: [{"id": "54ab08b8-0782-47ee-851c-66ce82be651c", "address": "fa:16:3e:48:ef:e8", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ab08b8-07", "ovs_interfaceid": "54ab08b8-0782-47ee-851c-66ce82be651c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:53:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0c4149c7-2095-44f8-828e-ddde78a08ccd req-ecfdc4d2-cf1f-467b-8618-8f07146bdcbe service nova] Releasing lock "refresh_cache-77e3348e-1697-45e0-9409-710017e0222c" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:53:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:22 user nova-compute[73010]: DEBUG os_brick.utils [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:53:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[06940ae5-9626-4d45-ba6e-5a3f617f0730]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:53:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79c1898-9680-4b57-b6f6-2e96be159592]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:53:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f67f66-2610-4f52-8af5-68bc65cae25c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:53:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a54ced-d6cd-4e69-85e6-2b89c8457541]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:53:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:53:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:53:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:53:22 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:53:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd846b6-6171-4b19-82cd-024ad4f0f5d5]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:53:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:53:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:53:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:53:22 user nova-compute[73010]: DEBUG os_brick.utils [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:53:22 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Updating existing volume attachment record: a84d09fd-42e0-4205-ba11-e69f31ecee32 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:53:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:28 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:53:28 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73010) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG nova.compute.manager [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:53:31 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Creating image(s)
Aug 15 00:53:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Did not create local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Ensure instance console log exists: /opt/stack/data/nova/instances/77e3348e-1697-45e0-9409-710017e0222c/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Start _get_guest_xml network_info=[{"id": "54ab08b8-0782-47ee-851c-66ce82be651c", "address": "fa:16:3e:48:ef:e8", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ab08b8-07", "ovs_interfaceid": "54ab08b8-0782-47ee-851c-66ce82be651c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-15T00:53:06Z,direct_url=<?>,disk_format='qcow2',id=1ee0f786-5f48-4d66-98ea-b47552adfdd2,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2031200391',owner='f67d1031d3cb4c8fb66342a7888ca1c4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-15T00:53:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdyglYmZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '77e3348e-1697-45e0-9409-710017e0222c', 'attached_at': '', 'detached_at': '', 'volume_id': '35759a13-3c4d-4d7d-9460-86085588d841', 'serial': '35759a13-3c4d-4d7d-9460-86085588d841'}, 'disk_bus': 'virtio', 'attachment_id': 'a84d09fd-42e0-4205-ba11-e69f31ecee32', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:53:31 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:53:31 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:53:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-15T00:53:06Z,direct_url=<?>,disk_format='qcow2',id=1ee0f786-5f48-4d66-98ea-b47552adfdd2,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2031200391',owner='f67d1031d3cb4c8fb66342a7888ca1c4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-15T00:53:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdyglYmZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:53:31 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:53:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:53:31 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:53:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:53:31 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[66abb002-94ef-4d65-ae3d-6a246d4f3abe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:53:31 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ccc075-addd-4bfd-9ec1-fab9d727c0c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841] added
Aug 15 00:53:31 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c57cf22-3c99-46de-b873-9172861e6b84]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f5a16f-965a-4f62-a73a-f238b04644d8]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdyglYmZ {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdyglYmZ" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7788b4-f74a-412d-a4a3-71c012ee7219]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VdyglYmZ'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b957b4-d6e6-429e-9678-f0140ab2f36e]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2940ad86-dae9-4b0d-8b78-0bf3b19ac307]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)
Aug 15 00:53:31 user nova-compute[73010]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:53:31 user nova-compute[73010]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:53:31 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)
Aug 15 00:53:31 user nova-compute[73010]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:53:31 user nova-compute[73010]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:53:31 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfce734-c74e-4a40-a4cf-6c17322cbffc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841, portal: 172.16.0.220,3260]
Aug 15 00:53:31 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841, portal: 172.16.0.220,3260] successful.
Aug 15 00:53:31 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf77dc97-0967-495b-b40c-740e08e02be6]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf460b9-c3e9-4e9b-ad71-8de87d58cec8]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)
Aug 15 00:53:31 user nova-compute[73010]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:53:31 user nova-compute[73010]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:53:31 user nova-compute[73010]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 (non-flash)
Aug 15 00:53:31 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)
Aug 15 00:53:31 user nova-compute[73010]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:53:31 user nova-compute[73010]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:53:31 user nova-compute[73010]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 (non-flash)
Aug 15 00:53:31 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] HCTL ('36', '-', '-', 0) found on session 51 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[200ac8ab-731a-465b-99bc-9eecac6b3356]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:53:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdyglYmZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:53:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:53:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23662623664323061', 'path': '/dev/sde'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:53:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662623664323061', 'path': '/dev/sde'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:53:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1596887429',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1596887429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1596887429',id=40,image_ref='1ee0f786-5f48-4d66-98ea-b47552adfdd2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEgfQhaziRChQ57B6BHSa+YBa0BN3+whX95aE3YJZlMalJjdg+sRLqk7NsrtO/EYYkRl4hTzjc3ish2oVGI0z45tfnm3gCL1w9JWPkt1YvDI1PilzwytWn71CU+9D8Y8g==',key_name='tempest-keypair-1302091534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f67d1031d3cb4c8fb66342a7888ca1c4',ramdisk_id='',reservation_id='r-ur6qmdtt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1953358779',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1953358779-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1953358779',owner_user_name='tempest-TestVolumeBootPattern-1953358779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:53:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='daa4eb788f724a6fbf908b029315a02b',uuid=77e3348e-1697-45e0-9409-710017e0222c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54ab08b8-0782-47ee-851c-66ce82be651c", "address": "fa:16:3e:48:ef:e8", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ab08b8-07", "ovs_interfaceid": "54ab08b8-0782-47ee-851c-66ce82be651c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:53:32 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converting VIF {"id": "54ab08b8-0782-47ee-851c-66ce82be651c", "address": "fa:16:3e:48:ef:e8", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ab08b8-07", "ovs_interfaceid": "54ab08b8-0782-47ee-851c-66ce82be651c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:53:32 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:ef:e8,bridge_name='br-int',has_traffic_filtering=True,id=54ab08b8-0782-47ee-851c-66ce82be651c,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ab08b8-07') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:53:32 user nova-compute[73010]: DEBUG nova.objects.instance [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lazy-loading 'pci_devices' on Instance uuid 77e3348e-1697-45e0-9409-710017e0222c {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:53:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:53:32 user nova-compute[73010]:   <uuid>77e3348e-1697-45e0-9409-710017e0222c</uuid>
Aug 15 00:53:32 user nova-compute[73010]:   <name>instance-00000028</name>
Aug 15 00:53:32 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:53:32 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:53:32 user nova-compute[73010]:   <metadata>
Aug 15 00:53:32 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:53:32 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:53:32 user nova-compute[73010]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1596887429</nova:name>
Aug 15 00:53:32 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:53:31</nova:creationTime>
Aug 15 00:53:32 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:53:32 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:53:32 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:53:32 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:53:32 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:53:32 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:53:32 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:53:32 user nova-compute[73010]:       <nova:owner>
Aug 15 00:53:32 user nova-compute[73010]:         <nova:user uuid="daa4eb788f724a6fbf908b029315a02b">tempest-TestVolumeBootPattern-1953358779-project-member</nova:user>
Aug 15 00:53:32 user nova-compute[73010]:         <nova:project uuid="f67d1031d3cb4c8fb66342a7888ca1c4">tempest-TestVolumeBootPattern-1953358779</nova:project>
Aug 15 00:53:32 user nova-compute[73010]:       </nova:owner>
Aug 15 00:53:32 user nova-compute[73010]:       <nova:root type="image" uuid="1ee0f786-5f48-4d66-98ea-b47552adfdd2"/>
Aug 15 00:53:32 user nova-compute[73010]:       <nova:ports>
Aug 15 00:53:32 user nova-compute[73010]:         <nova:port uuid="54ab08b8-0782-47ee-851c-66ce82be651c">
Aug 15 00:53:32 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 00:53:32 user nova-compute[73010]:         </nova:port>
Aug 15 00:53:32 user nova-compute[73010]:       </nova:ports>
Aug 15 00:53:32 user nova-compute[73010]:     </nova:instance>
Aug 15 00:53:32 user nova-compute[73010]:   </metadata>
Aug 15 00:53:32 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:53:32 user nova-compute[73010]:     <system>
Aug 15 00:53:32 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:53:32 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:53:32 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:53:32 user nova-compute[73010]:       <entry name="serial">77e3348e-1697-45e0-9409-710017e0222c</entry>
Aug 15 00:53:32 user nova-compute[73010]:       <entry name="uuid">77e3348e-1697-45e0-9409-710017e0222c</entry>
Aug 15 00:53:32 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:53:32 user nova-compute[73010]:     </system>
Aug 15 00:53:32 user nova-compute[73010]:   </sysinfo>
Aug 15 00:53:32 user nova-compute[73010]:   <os>
Aug 15 00:53:32 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:53:32 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:53:32 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:53:32 user nova-compute[73010]:   </os>
Aug 15 00:53:32 user nova-compute[73010]:   <features>
Aug 15 00:53:32 user nova-compute[73010]:     <acpi/>
Aug 15 00:53:32 user nova-compute[73010]:     <apic/>
Aug 15 00:53:32 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:53:32 user nova-compute[73010]:   </features>
Aug 15 00:53:32 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:53:32 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:53:32 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:53:32 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:53:32 user nova-compute[73010]:   </clock>
Aug 15 00:53:32 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:53:32 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:53:32 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:53:32 user nova-compute[73010]:   </cpu>
Aug 15 00:53:32 user nova-compute[73010]:   <devices>
Aug 15 00:53:32 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 00:53:32 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:53:32 user nova-compute[73010]:       <source dev="/dev/sde"/>
Aug 15 00:53:32 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:53:32 user nova-compute[73010]:       <serial>35759a13-3c4d-4d7d-9460-86085588d841</serial>
Aug 15 00:53:32 user nova-compute[73010]:     </disk>
Aug 15 00:53:32 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:53:32 user nova-compute[73010]:       <mac address="fa:16:3e:48:ef:e8"/>
Aug 15 00:53:32 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:53:32 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:53:32 user nova-compute[73010]:       <target dev="tap54ab08b8-07"/>
Aug 15 00:53:32 user nova-compute[73010]:     </interface>
Aug 15 00:53:32 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:53:32 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/77e3348e-1697-45e0-9409-710017e0222c/console.log" append="off"/>
Aug 15 00:53:32 user nova-compute[73010]:     </serial>
Aug 15 00:53:32 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:53:32 user nova-compute[73010]:     <video>
Aug 15 00:53:32 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:53:32 user nova-compute[73010]:     </video>
Aug 15 00:53:32 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:53:32 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:53:32 user nova-compute[73010]:     </rng>
Aug 15 00:53:32 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:53:32 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:53:32 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:53:32 user nova-compute[73010]:     </memballoon>
Aug 15 00:53:32 user nova-compute[73010]:   </devices>
Aug 15 00:53:32 user nova-compute[73010]: </domain>
Aug 15 00:53:32 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:53:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1596887429',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1596887429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1596887429',id=40,image_ref='1ee0f786-5f48-4d66-98ea-b47552adfdd2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEgfQhaziRChQ57B6BHSa+YBa0BN3+whX95aE3YJZlMalJjdg+sRLqk7NsrtO/EYYkRl4hTzjc3ish2oVGI0z45tfnm3gCL1w9JWPkt1YvDI1PilzwytWn71CU+9D8Y8g==',key_name='tempest-keypair-1302091534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f67d1031d3cb4c8fb66342a7888ca1c4',ramdisk_id='',reservation_id='r-ur6qmdtt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1953358779',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1953358779-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1953358779',owner_user_name='tempest-TestVolumeBootPattern-1953358779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:53:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='daa4eb788f724a6fbf908b029315a02b',uuid=77e3348e-1697-45e0-9409-710017e0222c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54ab08b8-0782-47ee-851c-66ce82be651c", "address": "fa:16:3e:48:ef:e8", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ab08b8-07", "ovs_interfaceid": "54ab08b8-0782-47ee-851c-66ce82be651c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:53:32 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converting VIF {"id": "54ab08b8-0782-47ee-851c-66ce82be651c", "address": "fa:16:3e:48:ef:e8", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ab08b8-07", "ovs_interfaceid": "54ab08b8-0782-47ee-851c-66ce82be651c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:53:32 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:ef:e8,bridge_name='br-int',has_traffic_filtering=True,id=54ab08b8-0782-47ee-851c-66ce82be651c,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ab08b8-07') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:53:32 user nova-compute[73010]: DEBUG os_vif [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:ef:e8,bridge_name='br-int',has_traffic_filtering=True,id=54ab08b8-0782-47ee-851c-66ce82be651c,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ab08b8-07') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:53:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:53:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:53:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54ab08b8-07, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:53:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap54ab08b8-07, col_values=(('external_ids', {'iface-id': '54ab08b8-0782-47ee-851c-66ce82be651c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:ef:e8', 'vm-uuid': '77e3348e-1697-45e0-9409-710017e0222c'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:53:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:53:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:32 user nova-compute[73010]: INFO os_vif [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:ef:e8,bridge_name='br-int',has_traffic_filtering=True,id=54ab08b8-0782-47ee-851c-66ce82be651c,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ab08b8-07')
Aug 15 00:53:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:53:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] No VIF found with MAC fa:16:3e:48:ef:e8, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:53:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:34 user nova-compute[73010]: DEBUG nova.compute.manager [req-9ecf2c11-08c6-4693-bbb2-d24d04345be8 req-c98e0f4e-b4df-42c8-9fc5-7428f5359a95 service nova] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Received event network-vif-plugged-54ab08b8-0782-47ee-851c-66ce82be651c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:53:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9ecf2c11-08c6-4693-bbb2-d24d04345be8 req-c98e0f4e-b4df-42c8-9fc5-7428f5359a95 service nova] Acquiring lock "77e3348e-1697-45e0-9409-710017e0222c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:53:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9ecf2c11-08c6-4693-bbb2-d24d04345be8 req-c98e0f4e-b4df-42c8-9fc5-7428f5359a95 service nova] Lock "77e3348e-1697-45e0-9409-710017e0222c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:53:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9ecf2c11-08c6-4693-bbb2-d24d04345be8 req-c98e0f4e-b4df-42c8-9fc5-7428f5359a95 service nova] Lock "77e3348e-1697-45e0-9409-710017e0222c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:53:34 user nova-compute[73010]: DEBUG nova.compute.manager [req-9ecf2c11-08c6-4693-bbb2-d24d04345be8 req-c98e0f4e-b4df-42c8-9fc5-7428f5359a95 service nova] [instance: 77e3348e-1697-45e0-9409-710017e0222c] No waiting events found dispatching network-vif-plugged-54ab08b8-0782-47ee-851c-66ce82be651c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:53:34 user nova-compute[73010]: WARNING nova.compute.manager [req-9ecf2c11-08c6-4693-bbb2-d24d04345be8 req-c98e0f4e-b4df-42c8-9fc5-7428f5359a95 service nova] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Received unexpected event network-vif-plugged-54ab08b8-0782-47ee-851c-66ce82be651c for instance with vm_state building and task_state spawning.
Aug 15 00:53:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:36 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060816.291516, 77e3348e-1697-45e0-9409-710017e0222c => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:53:36 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 77e3348e-1697-45e0-9409-710017e0222c] VM Resumed (Lifecycle Event)
Aug 15 00:53:36 user nova-compute[73010]: DEBUG nova.compute.manager [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:53:36 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:53:36 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Instance spawned successfully.
Aug 15 00:53:36 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:53:36 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:53:36 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:53:36 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:53:36 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:53:36 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 77e3348e-1697-45e0-9409-710017e0222c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:53:36 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060816.2939339, 77e3348e-1697-45e0-9409-710017e0222c => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:53:36 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 77e3348e-1697-45e0-9409-710017e0222c] VM Started (Lifecycle Event)
Aug 15 00:53:36 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:53:36 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:53:36 user nova-compute[73010]: INFO nova.compute.manager [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Took 4.96 seconds to spawn the instance on the hypervisor.
Aug 15 00:53:36 user nova-compute[73010]: DEBUG nova.compute.manager [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:53:36 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 77e3348e-1697-45e0-9409-710017e0222c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:53:36 user nova-compute[73010]: INFO nova.compute.manager [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Took 20.31 seconds to build instance.
Aug 15 00:53:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-98b891d8-3792-4e03-b8db-d8cfca1987b9 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "77e3348e-1697-45e0-9409-710017e0222c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.407s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:53:36 user nova-compute[73010]: DEBUG nova.compute.manager [req-c9dc32e0-ee80-4068-85fb-1f2a4343dbf2 req-9a15936b-1026-48bb-8209-e1416f505084 service nova] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Received event network-vif-plugged-54ab08b8-0782-47ee-851c-66ce82be651c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:53:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c9dc32e0-ee80-4068-85fb-1f2a4343dbf2 req-9a15936b-1026-48bb-8209-e1416f505084 service nova] Acquiring lock "77e3348e-1697-45e0-9409-710017e0222c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:53:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c9dc32e0-ee80-4068-85fb-1f2a4343dbf2 req-9a15936b-1026-48bb-8209-e1416f505084 service nova] Lock "77e3348e-1697-45e0-9409-710017e0222c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:53:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c9dc32e0-ee80-4068-85fb-1f2a4343dbf2 req-9a15936b-1026-48bb-8209-e1416f505084 service nova] Lock "77e3348e-1697-45e0-9409-710017e0222c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:53:36 user nova-compute[73010]: DEBUG nova.compute.manager [req-c9dc32e0-ee80-4068-85fb-1f2a4343dbf2 req-9a15936b-1026-48bb-8209-e1416f505084 service nova] [instance: 77e3348e-1697-45e0-9409-710017e0222c] No waiting events found dispatching network-vif-plugged-54ab08b8-0782-47ee-851c-66ce82be651c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:53:36 user nova-compute[73010]: WARNING nova.compute.manager [req-c9dc32e0-ee80-4068-85fb-1f2a4343dbf2 req-9a15936b-1026-48bb-8209-e1416f505084 service nova] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Received unexpected event network-vif-plugged-54ab08b8-0782-47ee-851c-66ce82be651c for instance with vm_state active and task_state None.
Aug 15 00:53:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "08a1c553-db53-4559-bac1-4e84ac05e2ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:53:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:53:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:53:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:53:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:53:55 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:53:55 user nova-compute[73010]: INFO nova.compute.claims [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Claim successful on node user
Aug 15 00:53:55 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Refreshing inventories for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 00:53:55 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Updating ProviderTree inventory for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 00:53:55 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Updating inventory in ProviderTree for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 00:53:55 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Refreshing aggregate associations for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e, aggregates: None {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 00:53:55 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Refreshing trait associations for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 00:53:56 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:53:56 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:53:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:53:56 user nova-compute[73010]: DEBUG nova.compute.manager [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:53:56 user nova-compute[73010]: DEBUG nova.compute.manager [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:53:56 user nova-compute[73010]: DEBUG nova.network.neutron [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:53:56 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:53:56 user nova-compute[73010]: DEBUG nova.compute.manager [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:53:56 user nova-compute[73010]: DEBUG nova.policy [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58496cb5284e45788eb645d0bff01dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103787ed9304a92a5224610d2e8645a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:53:56 user nova-compute[73010]: DEBUG nova.compute.manager [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:53:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:53:56 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Creating image(s)
Aug 15 00:53:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "/opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:53:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "/opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:53:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "/opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:53:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:53:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:53:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836.part --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836.part --force-share --output=json" returned: 0 in 0.210s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:56 user nova-compute[73010]: DEBUG nova.virt.images [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] 8ed9cf2f-f5d5-45f1-a0d9-87b8e168ef81 was qcow2, converting to raw {{(pid=73010) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 00:53:56 user nova-compute[73010]: DEBUG nova.privsep.utils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73010) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 00:53:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836.part /opt/stack/data/nova/instances/_base/a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836.converted {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:57 user nova-compute[73010]: DEBUG nova.network.neutron [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Successfully created port: cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:53:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836.part /opt/stack/data/nova/instances/_base/a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836.converted" returned: 0 in 0.260s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836.converted --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:57 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:53:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836.converted --force-share --output=json" returned: 0 in 0.304s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.202s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:53:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:53:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:53:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:53:57 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:53:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836 --force-share --output=json" returned: 0 in 0.185s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:53:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:53:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836 --force-share --output=json" returned: 0 in 0.193s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836,backing_fmt=raw /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836,backing_fmt=raw /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk 1073741824" returned: 0 in 0.088s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.network.neutron [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Successfully updated port: cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquired lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.network.neutron [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.compute.manager [req-6ae2e968-7f5f-465f-aef8-b5b73c5bd5b4 req-a3c82b45-1821-4468-b227-8b77dd7b1b6e service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received event network-changed-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.compute.manager [req-6ae2e968-7f5f-465f-aef8-b5b73c5bd5b4 req-a3c82b45-1821-4468-b227-8b77dd7b1b6e service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Refreshing instance network info cache due to event network-changed-cefb1758-4282-491b-b86a-a7de5efd3cca. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6ae2e968-7f5f-465f-aef8-b5b73c5bd5b4 req-a3c82b45-1821-4468-b227-8b77dd7b1b6e service nova] Acquiring lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.network.neutron [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836 --force-share --output=json" returned: 0 in 0.208s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Cannot resize image /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.objects.instance [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lazy-loading 'migration_context' on Instance uuid 08a1c553-db53-4559-bac1-4e84ac05e2ab {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Ensure instance console log exists: /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.network.neutron [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Updating instance_info_cache with network_info: [{"id": "cefb1758-4282-491b-b86a-a7de5efd3cca", "address": "fa:16:3e:8b:f0:7a", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcefb1758-42", "ovs_interfaceid": "cefb1758-4282-491b-b86a-a7de5efd3cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Releasing lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Instance network_info: |[{"id": "cefb1758-4282-491b-b86a-a7de5efd3cca", "address": "fa:16:3e:8b:f0:7a", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcefb1758-42", "ovs_interfaceid": "cefb1758-4282-491b-b86a-a7de5efd3cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6ae2e968-7f5f-465f-aef8-b5b73c5bd5b4 req-a3c82b45-1821-4468-b227-8b77dd7b1b6e service nova] Acquired lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.network.neutron [req-6ae2e968-7f5f-465f-aef8-b5b73c5bd5b4 req-a3c82b45-1821-4468-b227-8b77dd7b1b6e service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Refreshing network info cache for port cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Start _get_guest_xml network_info=[{"id": "cefb1758-4282-491b-b86a-a7de5efd3cca", "address": "fa:16:3e:8b:f0:7a", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcefb1758-42", "ovs_interfaceid": "cefb1758-4282-491b-b86a-a7de5efd3cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:53:52Z,direct_url=<?>,disk_format='qcow2',id=8ed9cf2f-f5d5-45f1-a0d9-87b8e168ef81,min_disk=0,min_ram=0,name='tempest-scenario-img--1667630817',owner='3103787ed9304a92a5224610d2e8645a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:53:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '8ed9cf2f-f5d5-45f1-a0d9-87b8e168ef81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:53:58 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:53:58 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:53:52Z,direct_url=<?>,disk_format='qcow2',id=8ed9cf2f-f5d5-45f1-a0d9-87b8e168ef81,min_disk=0,min_ram=0,name='tempest-scenario-img--1667630817',owner='3103787ed9304a92a5224610d2e8645a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:53:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-755814511',display_name='tempest-TestMinimumBasicScenario-server-755814511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-755814511',id=41,image_ref='8ed9cf2f-f5d5-45f1-a0d9-87b8e168ef81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK72COEAmkJaS4ZoxaUBDOidQX264zJ9KoBQ1gaMrSk9Upn5O385tR1Ezk98nqb2IDrd6+Jtb3Gy7GorpLp76284Lqs1Se85dNWfEinFROG1uZw9ofBcEoskH2sMpUNiFg==',key_name='tempest-TestMinimumBasicScenario-1030082569',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3103787ed9304a92a5224610d2e8645a',ramdisk_id='',reservation_id='r-2hn5sxob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8ed9cf2f-f5d5-45f1-a0d9-87b8e168ef81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2145836143',owner_user_name='tempest-TestMinimumBasicScenario-2145836143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:53:56Z,user_data=None,user_id='58496cb5284e45788eb645d0bff01dc8',uuid=08a1c553-db53-4559-bac1-4e84ac05e2ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cefb1758-4282-491b-b86a-a7de5efd3cca", "address": "fa:16:3e:8b:f0:7a", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcefb1758-42", "ovs_interfaceid": "cefb1758-4282-491b-b86a-a7de5efd3cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Converting VIF {"id": "cefb1758-4282-491b-b86a-a7de5efd3cca", "address": "fa:16:3e:8b:f0:7a", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcefb1758-42", "ovs_interfaceid": "cefb1758-4282-491b-b86a-a7de5efd3cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f0:7a,bridge_name='br-int',has_traffic_filtering=True,id=cefb1758-4282-491b-b86a-a7de5efd3cca,network=Network(8aef7e84-aa84-4b82-beae-723c69281253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcefb1758-42') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.objects.instance [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lazy-loading 'pci_devices' on Instance uuid 08a1c553-db53-4559-bac1-4e84ac05e2ab {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:53:58 user nova-compute[73010]:   <uuid>08a1c553-db53-4559-bac1-4e84ac05e2ab</uuid>
Aug 15 00:53:58 user nova-compute[73010]:   <name>instance-00000029</name>
Aug 15 00:53:58 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:53:58 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:53:58 user nova-compute[73010]:   <metadata>
Aug 15 00:53:58 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:53:58 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:53:58 user nova-compute[73010]:       <nova:name>tempest-TestMinimumBasicScenario-server-755814511</nova:name>
Aug 15 00:53:58 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:53:58</nova:creationTime>
Aug 15 00:53:58 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:53:58 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:53:58 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:53:58 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:53:58 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:53:58 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:53:58 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:53:58 user nova-compute[73010]:       <nova:owner>
Aug 15 00:53:58 user nova-compute[73010]:         <nova:user uuid="58496cb5284e45788eb645d0bff01dc8">tempest-TestMinimumBasicScenario-2145836143-project-member</nova:user>
Aug 15 00:53:58 user nova-compute[73010]:         <nova:project uuid="3103787ed9304a92a5224610d2e8645a">tempest-TestMinimumBasicScenario-2145836143</nova:project>
Aug 15 00:53:58 user nova-compute[73010]:       </nova:owner>
Aug 15 00:53:58 user nova-compute[73010]:       <nova:root type="image" uuid="8ed9cf2f-f5d5-45f1-a0d9-87b8e168ef81"/>
Aug 15 00:53:58 user nova-compute[73010]:       <nova:ports>
Aug 15 00:53:58 user nova-compute[73010]:         <nova:port uuid="cefb1758-4282-491b-b86a-a7de5efd3cca">
Aug 15 00:53:58 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 00:53:58 user nova-compute[73010]:         </nova:port>
Aug 15 00:53:58 user nova-compute[73010]:       </nova:ports>
Aug 15 00:53:58 user nova-compute[73010]:     </nova:instance>
Aug 15 00:53:58 user nova-compute[73010]:   </metadata>
Aug 15 00:53:58 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:53:58 user nova-compute[73010]:     <system>
Aug 15 00:53:58 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:53:58 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:53:58 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:53:58 user nova-compute[73010]:       <entry name="serial">08a1c553-db53-4559-bac1-4e84ac05e2ab</entry>
Aug 15 00:53:58 user nova-compute[73010]:       <entry name="uuid">08a1c553-db53-4559-bac1-4e84ac05e2ab</entry>
Aug 15 00:53:58 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:53:58 user nova-compute[73010]:     </system>
Aug 15 00:53:58 user nova-compute[73010]:   </sysinfo>
Aug 15 00:53:58 user nova-compute[73010]:   <os>
Aug 15 00:53:58 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:53:58 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:53:58 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:53:58 user nova-compute[73010]:   </os>
Aug 15 00:53:58 user nova-compute[73010]:   <features>
Aug 15 00:53:58 user nova-compute[73010]:     <acpi/>
Aug 15 00:53:58 user nova-compute[73010]:     <apic/>
Aug 15 00:53:58 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:53:58 user nova-compute[73010]:   </features>
Aug 15 00:53:58 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:53:58 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:53:58 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:53:58 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:53:58 user nova-compute[73010]:   </clock>
Aug 15 00:53:58 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:53:58 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:53:58 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:53:58 user nova-compute[73010]:   </cpu>
Aug 15 00:53:58 user nova-compute[73010]:   <devices>
Aug 15 00:53:58 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:53:58 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:53:58 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk"/>
Aug 15 00:53:58 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:53:58 user nova-compute[73010]:     </disk>
Aug 15 00:53:58 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:53:58 user nova-compute[73010]:       <mac address="fa:16:3e:8b:f0:7a"/>
Aug 15 00:53:58 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:53:58 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:53:58 user nova-compute[73010]:       <target dev="tapcefb1758-42"/>
Aug 15 00:53:58 user nova-compute[73010]:     </interface>
Aug 15 00:53:58 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:53:58 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/console.log" append="off"/>
Aug 15 00:53:58 user nova-compute[73010]:     </serial>
Aug 15 00:53:58 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:53:58 user nova-compute[73010]:     <video>
Aug 15 00:53:58 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:53:58 user nova-compute[73010]:     </video>
Aug 15 00:53:58 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:53:58 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:53:58 user nova-compute[73010]:     </rng>
Aug 15 00:53:58 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:53:58 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:53:58 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:53:58 user nova-compute[73010]:     </memballoon>
Aug 15 00:53:58 user nova-compute[73010]:   </devices>
Aug 15 00:53:58 user nova-compute[73010]: </domain>
Aug 15 00:53:58 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-755814511',display_name='tempest-TestMinimumBasicScenario-server-755814511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-755814511',id=41,image_ref='8ed9cf2f-f5d5-45f1-a0d9-87b8e168ef81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK72COEAmkJaS4ZoxaUBDOidQX264zJ9KoBQ1gaMrSk9Upn5O385tR1Ezk98nqb2IDrd6+Jtb3Gy7GorpLp76284Lqs1Se85dNWfEinFROG1uZw9ofBcEoskH2sMpUNiFg==',key_name='tempest-TestMinimumBasicScenario-1030082569',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3103787ed9304a92a5224610d2e8645a',ramdisk_id='',reservation_id='r-2hn5sxob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8ed9cf2f-f5d5-45f1-a0d9-87b8e168ef81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2145836143',owner_user_name='tempest-TestMinimumBasicScenario-2145836143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:53:56Z,user_data=None,user_id='58496cb5284e45788eb645d0bff01dc8',uuid=08a1c553-db53-4559-bac1-4e84ac05e2ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cefb1758-4282-491b-b86a-a7de5efd3cca", "address": "fa:16:3e:8b:f0:7a", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcefb1758-42", "ovs_interfaceid": "cefb1758-4282-491b-b86a-a7de5efd3cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Converting VIF {"id": "cefb1758-4282-491b-b86a-a7de5efd3cca", "address": "fa:16:3e:8b:f0:7a", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcefb1758-42", "ovs_interfaceid": "cefb1758-4282-491b-b86a-a7de5efd3cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f0:7a,bridge_name='br-int',has_traffic_filtering=True,id=cefb1758-4282-491b-b86a-a7de5efd3cca,network=Network(8aef7e84-aa84-4b82-beae-723c69281253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcefb1758-42') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG os_vif [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f0:7a,bridge_name='br-int',has_traffic_filtering=True,id=cefb1758-4282-491b-b86a-a7de5efd3cca,network=Network(8aef7e84-aa84-4b82-beae-723c69281253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcefb1758-42') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcefb1758-42, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcefb1758-42, col_values=(('external_ids', {'iface-id': 'cefb1758-4282-491b-b86a-a7de5efd3cca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:f0:7a', 'vm-uuid': '08a1c553-db53-4559-bac1-4e84ac05e2ab'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:53:58 user nova-compute[73010]: INFO os_vif [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f0:7a,bridge_name='br-int',has_traffic_filtering=True,id=cefb1758-4282-491b-b86a-a7de5efd3cca,network=Network(8aef7e84-aa84-4b82-beae-723c69281253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcefb1758-42')
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] No VIF found with MAC fa:16:3e:8b:f0:7a, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:59 user nova-compute[73010]: DEBUG nova.network.neutron [req-6ae2e968-7f5f-465f-aef8-b5b73c5bd5b4 req-a3c82b45-1821-4468-b227-8b77dd7b1b6e service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Updated VIF entry in instance network info cache for port cefb1758-4282-491b-b86a-a7de5efd3cca. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:53:59 user nova-compute[73010]: DEBUG nova.network.neutron [req-6ae2e968-7f5f-465f-aef8-b5b73c5bd5b4 req-a3c82b45-1821-4468-b227-8b77dd7b1b6e service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Updating instance_info_cache with network_info: [{"id": "cefb1758-4282-491b-b86a-a7de5efd3cca", "address": "fa:16:3e:8b:f0:7a", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcefb1758-42", "ovs_interfaceid": "cefb1758-4282-491b-b86a-a7de5efd3cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:53:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6ae2e968-7f5f-465f-aef8-b5b73c5bd5b4 req-a3c82b45-1821-4468-b227-8b77dd7b1b6e service nova] Releasing lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:53:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:53:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:53:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:53:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:54:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:54:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060842.3111317, 08a1c553-db53-4559-bac1-4e84ac05e2ab => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:54:02 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] VM Resumed (Lifecycle Event)
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-4a4b26e1-4ee7-40ee-90b9-bb9796044b4c req-028cb73a-6a82-45f0-9502-921b2306f2b7 service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received event network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4a4b26e1-4ee7-40ee-90b9-bb9796044b4c req-028cb73a-6a82-45f0-9502-921b2306f2b7 service nova] Acquiring lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4a4b26e1-4ee7-40ee-90b9-bb9796044b4c req-028cb73a-6a82-45f0-9502-921b2306f2b7 service nova] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4a4b26e1-4ee7-40ee-90b9-bb9796044b4c req-028cb73a-6a82-45f0-9502-921b2306f2b7 service nova] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-4a4b26e1-4ee7-40ee-90b9-bb9796044b4c req-028cb73a-6a82-45f0-9502-921b2306f2b7 service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] No waiting events found dispatching network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:54:02 user nova-compute[73010]: WARNING nova.compute.manager [req-4a4b26e1-4ee7-40ee-90b9-bb9796044b4c req-028cb73a-6a82-45f0-9502-921b2306f2b7 service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received unexpected event network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca for instance with vm_state building and task_state spawning.
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-61bf3dbe-fa16-4ac4-afea-de991d955bfd req-e16bcec2-3719-4178-83f0-6d09cdecd894 service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received event network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-61bf3dbe-fa16-4ac4-afea-de991d955bfd req-e16bcec2-3719-4178-83f0-6d09cdecd894 service nova] Acquiring lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-61bf3dbe-fa16-4ac4-afea-de991d955bfd req-e16bcec2-3719-4178-83f0-6d09cdecd894 service nova] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-61bf3dbe-fa16-4ac4-afea-de991d955bfd req-e16bcec2-3719-4178-83f0-6d09cdecd894 service nova] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-61bf3dbe-fa16-4ac4-afea-de991d955bfd req-e16bcec2-3719-4178-83f0-6d09cdecd894 service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] No waiting events found dispatching network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:54:02 user nova-compute[73010]: WARNING nova.compute.manager [req-61bf3dbe-fa16-4ac4-afea-de991d955bfd req-e16bcec2-3719-4178-83f0-6d09cdecd894 service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received unexpected event network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca for instance with vm_state building and task_state spawning.
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:54:02 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Instance spawned successfully.
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:54:02 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:54:02 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=7739MB free_disk=25.516887664794922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:54:02 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060842.3114836, 08a1c553-db53-4559-bac1-4e84ac05e2ab => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:54:02 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] VM Started (Lifecycle Event)
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:54:02 user nova-compute[73010]: INFO nova.compute.manager [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Took 6.41 seconds to spawn the instance on the hypervisor.
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:54:02 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6dfc356b-953a-47b0-9da7-70cc59a80853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance eec545e8-eeda-443c-9892-980e19e7267a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4b489f97-c8d4-4a6a-8404-e1a05a990261 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance b94d5990-9053-4119-9228-fdbec348294f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance f08393c9-17c8-40c0-b8de-e8b8237e9109 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance a736c704-e72e-4009-87e6-e165c5abe5bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 77e3348e-1697-45e0-9409-710017e0222c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 08a1c553-db53-4559-bac1-4e84ac05e2ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:54:02 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:54:02 user nova-compute[73010]: INFO nova.compute.manager [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Took 7.40 seconds to build instance.
Aug 15 00:54:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ff83e83-f556-4340-8b22-eea79610c7d0 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.544s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:54:03 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:54:03 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:54:03 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:54:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.484s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:54:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:54:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:54:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:54:10 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:54:10 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:54:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:54:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-b94d5990-9053-4119-9228-fdbec348294f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:54:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-b94d5990-9053-4119-9228-fdbec348294f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:54:10 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 00:54:10 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] Updating instance_info_cache with network_info: [{"id": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "address": "fa:16:3e:54:79:b9", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e5551e5-7a", "ovs_interfaceid": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:54:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-b94d5990-9053-4119-9228-fdbec348294f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:54:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 00:54:10 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:54:10 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:54:10 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:54:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:54:11 user nova-compute[73010]: INFO nova.compute.manager [None req-e8548802-8a23-4259-9d28-cb2841da3d97 tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Get console output
Aug 15 00:54:11 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:54:11 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:54:11 user nova-compute[73010]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 15 00:54:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:54:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:54:14 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:54:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:54:18 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:54:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:54:21 user nova-compute[73010]: DEBUG nova.compute.manager [req-b585f908-7b5c-497c-8d76-752372717753 req-8cf2da67-766e-4d5c-a340-ee2a7bde94ed service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Received event network-changed-feecf72a-c68a-4948-9134-21ec312e4cc9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:54:21 user nova-compute[73010]: DEBUG nova.compute.manager [req-b585f908-7b5c-497c-8d76-752372717753 req-8cf2da67-766e-4d5c-a340-ee2a7bde94ed service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Refreshing instance network info cache due to event network-changed-feecf72a-c68a-4948-9134-21ec312e4cc9. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:54:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b585f908-7b5c-497c-8d76-752372717753 req-8cf2da67-766e-4d5c-a340-ee2a7bde94ed service nova] Acquiring lock "refresh_cache-a736c704-e72e-4009-87e6-e165c5abe5bd" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:54:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b585f908-7b5c-497c-8d76-752372717753 req-8cf2da67-766e-4d5c-a340-ee2a7bde94ed service nova] Acquired lock "refresh_cache-a736c704-e72e-4009-87e6-e165c5abe5bd" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:54:21 user nova-compute[73010]: DEBUG nova.network.neutron [req-b585f908-7b5c-497c-8d76-752372717753 req-8cf2da67-766e-4d5c-a340-ee2a7bde94ed service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Refreshing network info cache for port feecf72a-c68a-4948-9134-21ec312e4cc9 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:54:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "a736c704-e72e-4009-87e6-e165c5abe5bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:54:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "a736c704-e72e-4009-87e6-e165c5abe5bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:54:21 user nova-compute[73010]: DEBUG nova.objects.instance [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lazy-loading 'flavor' on Instance uuid a736c704-e72e-4009-87e6-e165c5abe5bd {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:54:21 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Ignoring supplied device name: /dev/vdb
Aug 15 00:54:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "a736c704-e72e-4009-87e6-e165c5abe5bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "a736c704-e72e-4009-87e6-e165c5abe5bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "a736c704-e72e-4009-87e6-e165c5abe5bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:54:22 user nova-compute[73010]: INFO nova.compute.manager [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Attaching volume 4ef2e281-2b80-450a-90d6-b350059cc35c to /dev/vdb
Aug 15 00:54:22 user nova-compute[73010]: DEBUG os_brick.utils [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG nova.network.neutron [req-b585f908-7b5c-497c-8d76-752372717753 req-8cf2da67-766e-4d5c-a340-ee2a7bde94ed service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Updated VIF entry in instance network info cache for port feecf72a-c68a-4948-9134-21ec312e4cc9. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG nova.network.neutron [req-b585f908-7b5c-497c-8d76-752372717753 req-8cf2da67-766e-4d5c-a340-ee2a7bde94ed service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Updating instance_info_cache with network_info: [{"id": "feecf72a-c68a-4948-9134-21ec312e4cc9", "address": "fa:16:3e:36:65:77", "network": {"id": "97be784b-67e7-46e9-949a-510d7c526338", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207062863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4dad0b4fa44c61b6cae2227e6b77d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeecf72a-c6", "ovs_interfaceid": "feecf72a-c68a-4948-9134-21ec312e4cc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bf7dbe-7a66-4395-bb3d-14dd2e37ea23]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b585f908-7b5c-497c-8d76-752372717753 req-8cf2da67-766e-4d5c-a340-ee2a7bde94ed service nova] Releasing lock "refresh_cache-a736c704-e72e-4009-87e6-e165c5abe5bd" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60c1a8a-052e-491f-bb23-edfd0082dcba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d5df43-50aa-4774-bc1b-94a6297a3d23]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a1784f-5d13-4d6e-977e-46b2bd1cf3c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:54:22 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:54:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cfde99-35d6-4614-9997-7ae9a85fdb8c]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG os_brick.utils [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:54:22 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Updating existing volume attachment record: 217d32ef-57c8-4e50-a4ec-7a9621da0a43 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:54:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:54:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:54:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScmIQTCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:54:31 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:54:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:54:31 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:54:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:54:31 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3eb0b2d-12e4-41c4-ac92-3faf3f5a0eca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:54:31 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3957a95a-e775-40c2-9c91-3ae15a2582e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c] added
Aug 15 00:54:31 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1158a93a-05ea-4100-a174-0f1d5397ca7d]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc0533a-7182-44bf-aec1-bd22f898f70d]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ScmIQTCb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ScmIQTCb" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e234e0-3786-4667-8f89-d0d87d8cdba7]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ScmIQTCb'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[350761cd-d149-4e94-9866-8cd3608b9d11]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee47bf0-5ac0-4449-9f9c-0409fa8d6786]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)
Aug 15 00:54:31 user nova-compute[73010]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:54:31 user nova-compute[73010]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:54:31 user nova-compute[73010]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 (non-flash)
Aug 15 00:54:31 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)
Aug 15 00:54:31 user nova-compute[73010]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:54:31 user nova-compute[73010]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:54:31 user nova-compute[73010]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 (non-flash)
Aug 15 00:54:31 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1f0208-40d5-456d-bfb5-d9de0d244ed3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c, portal: 172.16.0.220,3260]
Aug 15 00:54:31 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c, portal: 172.16.0.220,3260] successful.
Aug 15 00:54:31 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ab94dc-b66d-406c-b364-3d5d6865dccb]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb607031-ac1f-4e7e-bf27-6404caca7568]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)
Aug 15 00:54:31 user nova-compute[73010]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:54:31 user nova-compute[73010]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:54:31 user nova-compute[73010]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 (non-flash)
Aug 15 00:54:31 user nova-compute[73010]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c (non-flash)
Aug 15 00:54:31 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)
Aug 15 00:54:31 user nova-compute[73010]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:54:31 user nova-compute[73010]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:54:31 user nova-compute[73010]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 (non-flash)
Aug 15 00:54:31 user nova-compute[73010]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c (non-flash)
Aug 15 00:54:31 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] HCTL ('37', '-', '-', 0) found on session 52 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab9d5a5-a9e4-46a8-9103-6bc1d459d042]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Searching for a device in session 52 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:54:31 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScmIQTCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:54:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:54:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:54:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26463616665383330', 'path': '/dev/sdf'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:54:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463616665383330', 'path': '/dev/sdf'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:54:32 user nova-compute[73010]: DEBUG nova.objects.instance [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lazy-loading 'flavor' on Instance uuid a736c704-e72e-4009-87e6-e165c5abe5bd {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:54:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:54:32 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:54:32 user nova-compute[73010]:   <source dev="/dev/sdf"/>
Aug 15 00:54:32 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:54:32 user nova-compute[73010]:   <serial>4ef2e281-2b80-450a-90d6-b350059cc35c</serial>
Aug 15 00:54:32 user nova-compute[73010]: </disk>
Aug 15 00:54:32 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:54:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:54:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:54:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] No VIF found with MAC fa:16:3e:36:65:77, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:54:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4fae997-0f90-4b44-9a52-4d4bee4f6e49 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "a736c704-e72e-4009-87e6-e165c5abe5bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.476s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:54:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:54:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:54:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:54:38 user nova-compute[73010]: DEBUG nova.compute.manager [req-5c77e1ae-7bee-494b-8d6f-e273fd56c0eb req-9edc0b3f-8eae-4af2-9e4a-214aa3c78b74 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received event network-changed-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:54:38 user nova-compute[73010]: DEBUG nova.compute.manager [req-5c77e1ae-7bee-494b-8d6f-e273fd56c0eb req-9edc0b3f-8eae-4af2-9e4a-214aa3c78b74 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Refreshing instance network info cache due to event network-changed-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:54:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5c77e1ae-7bee-494b-8d6f-e273fd56c0eb req-9edc0b3f-8eae-4af2-9e4a-214aa3c78b74 service nova] Acquiring lock "refresh_cache-b94d5990-9053-4119-9228-fdbec348294f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:54:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5c77e1ae-7bee-494b-8d6f-e273fd56c0eb req-9edc0b3f-8eae-4af2-9e4a-214aa3c78b74 service nova] Acquired lock "refresh_cache-b94d5990-9053-4119-9228-fdbec348294f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:54:38 user nova-compute[73010]: DEBUG nova.network.neutron [req-5c77e1ae-7bee-494b-8d6f-e273fd56c0eb req-9edc0b3f-8eae-4af2-9e4a-214aa3c78b74 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Refreshing network info cache for port 3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:54:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:54:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "b94d5990-9053-4119-9228-fdbec348294f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:54:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "b94d5990-9053-4119-9228-fdbec348294f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:54:38 user nova-compute[73010]: INFO nova.compute.manager [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Detaching volume a29dea1e-c77f-4c31-b003-6a86a332180f
Aug 15 00:54:38 user nova-compute[73010]: INFO nova.virt.block_device [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Attempting to driver detach volume a29dea1e-c77f-4c31-b003-6a86a332180f from mountpoint /dev/vdb
Aug 15 00:54:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Attempting to detach device vdb from instance b94d5990-9053-4119-9228-fdbec348294f from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:54:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:54:38 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:54:38 user nova-compute[73010]:   <source dev="/dev/sdc"/>
Aug 15 00:54:38 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:54:38 user nova-compute[73010]:   <serial>a29dea1e-c77f-4c31-b003-6a86a332180f</serial>
Aug 15 00:54:38 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:54:38 user nova-compute[73010]: </disk>
Aug 15 00:54:38 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:54:38 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Successfully detached device vdb from instance b94d5990-9053-4119-9228-fdbec348294f from the persistent domain config.
Aug 15 00:54:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b94d5990-9053-4119-9228-fdbec348294f from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:54:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:54:38 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:54:38 user nova-compute[73010]:   <source dev="/dev/sdc"/>
Aug 15 00:54:38 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:54:38 user nova-compute[73010]:   <serial>a29dea1e-c77f-4c31-b003-6a86a332180f</serial>
Aug 15 00:54:38 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:54:38 user nova-compute[73010]: </disk>
Aug 15 00:54:38 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG nova.network.neutron [req-5c77e1ae-7bee-494b-8d6f-e273fd56c0eb req-9edc0b3f-8eae-4af2-9e4a-214aa3c78b74 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Updated VIF entry in instance network info cache for port 3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG nova.network.neutron [req-5c77e1ae-7bee-494b-8d6f-e273fd56c0eb req-9edc0b3f-8eae-4af2-9e4a-214aa3c78b74 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Updating instance_info_cache with network_info: [{"id": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "address": "fa:16:3e:54:79:b9", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e5551e5-7a", "ovs_interfaceid": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5c77e1ae-7bee-494b-8d6f-e273fd56c0eb req-9edc0b3f-8eae-4af2-9e4a-214aa3c78b74 service nova] Releasing lock "refresh_cache-b94d5990-9053-4119-9228-fdbec348294f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692060879.4116757, b94d5990-9053-4119-9228-fdbec348294f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b94d5990-9053-4119-9228-fdbec348294f {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:54:39 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Successfully detached device vdb from instance b94d5990-9053-4119-9228-fdbec348294f from the live domain config.
Aug 15 00:54:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TtdbxhMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:54:39 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:54:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0697d35-3b46-4ea1-a7fa-c60f3071ea47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e0884c-a14d-4af7-b52c-7d32737e218f]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)
Aug 15 00:54:39 user nova-compute[73010]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:54:39 user nova-compute[73010]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:54:39 user nova-compute[73010]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 (non-flash)
Aug 15 00:54:39 user nova-compute[73010]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c (non-flash)
Aug 15 00:54:39 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f (non-flash)
Aug 15 00:54:39 user nova-compute[73010]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:54:39 user nova-compute[73010]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:54:39 user nova-compute[73010]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 (non-flash)
Aug 15 00:54:39 user nova-compute[73010]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c (non-flash)
Aug 15 00:54:39 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec503a5360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f'): ({'sdc'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Removing single pathed devices sdc {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bdce70-ab48-4bec-8d1c-e2b7a7e1cb93]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6ebfbd-1ee7-49df-8be5-c200c5534913]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Flushing IO for device /dev/sdc {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3366fc45-acd5-410f-961a-bfddce330205]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0306555d-921d-4ed6-8a60-141e37b7c80f]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] SCSI volumes sdc have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[60037313-b389-4ecb-a215-08f9a4d3bfa6]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[450a19b3-2a83-41c6-88ae-769d020a5ea9]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f, portal: 172.16.0.220,3260]
Aug 15 00:54:39 user nova-compute[73010]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f, portal: 172.16.0.220,3260] successful.
Aug 15 00:54:39 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a29dea1e-c77f-4c31-b003-6a86a332180f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eca4b17-5106-411b-a75a-81bf3dd1ab88]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] <== disconnect_volume: return (290ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:54:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:54:40 user nova-compute[73010]: DEBUG nova.compute.manager [req-aa541cac-9270-4464-91bd-7fe5ad66541b req-9a919150-e96a-4e84-9345-1ea326430bd5 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received event network-changed-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:54:40 user nova-compute[73010]: DEBUG nova.compute.manager [req-aa541cac-9270-4464-91bd-7fe5ad66541b req-9a919150-e96a-4e84-9345-1ea326430bd5 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Refreshing instance network info cache due to event network-changed-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:54:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-aa541cac-9270-4464-91bd-7fe5ad66541b req-9a919150-e96a-4e84-9345-1ea326430bd5 service nova] Acquiring lock "refresh_cache-b94d5990-9053-4119-9228-fdbec348294f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:54:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-aa541cac-9270-4464-91bd-7fe5ad66541b req-9a919150-e96a-4e84-9345-1ea326430bd5 service nova] Acquired lock "refresh_cache-b94d5990-9053-4119-9228-fdbec348294f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:54:40 user nova-compute[73010]: DEBUG nova.network.neutron [req-aa541cac-9270-4464-91bd-7fe5ad66541b req-9a919150-e96a-4e84-9345-1ea326430bd5 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Refreshing network info cache for port 3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:54:40 user nova-compute[73010]: DEBUG nova.objects.instance [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'flavor' on Instance uuid b94d5990-9053-4119-9228-fdbec348294f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:54:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-13c9cb3c-9372-4a22-956f-9dc83ce34dba tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "b94d5990-9053-4119-9228-fdbec348294f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.670s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:54:40 user nova-compute[73010]: DEBUG nova.network.neutron [req-aa541cac-9270-4464-91bd-7fe5ad66541b req-9a919150-e96a-4e84-9345-1ea326430bd5 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Updated VIF entry in instance network info cache for port 3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:54:40 user nova-compute[73010]: DEBUG nova.network.neutron [req-aa541cac-9270-4464-91bd-7fe5ad66541b req-9a919150-e96a-4e84-9345-1ea326430bd5 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Updating instance_info_cache with network_info: [{"id": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "address": "fa:16:3e:54:79:b9", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e5551e5-7a", "ovs_interfaceid": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:54:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-aa541cac-9270-4464-91bd-7fe5ad66541b req-9a919150-e96a-4e84-9345-1ea326430bd5 service nova] Releasing lock "refresh_cache-b94d5990-9053-4119-9228-fdbec348294f" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:54:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:54:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:54:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:54:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:54:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:54:57 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:54:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:54:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:54:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:54:57 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:54:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:54:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:54:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:54:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:54:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:54:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:54:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:54:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:00 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:55:00 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:55:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=7613MB free_disk=25.4703369140625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:55:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6dfc356b-953a-47b0-9da7-70cc59a80853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:55:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance eec545e8-eeda-443c-9892-980e19e7267a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:55:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4b489f97-c8d4-4a6a-8404-e1a05a990261 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:55:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance b94d5990-9053-4119-9228-fdbec348294f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:55:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance f08393c9-17c8-40c0-b8de-e8b8237e9109 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:55:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:55:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance a736c704-e72e-4009-87e6-e165c5abe5bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:55:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 77e3348e-1697-45e0-9409-710017e0222c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:55:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 08a1c553-db53-4559-bac1-4e84ac05e2ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:55:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:55:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:55:01 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:55:01 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:55:01 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:55:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.478s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:55:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:55:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 00:55:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:55:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:55:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:08 user nova-compute[73010]: DEBUG nova.compute.manager [req-3341a7cd-51d2-498e-b5fa-1aa6ae1e2da7 req-d7ea8348-cd6a-427e-aaea-40602b3073a6 service nova] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Received event network-changed-54ab08b8-0782-47ee-851c-66ce82be651c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:55:08 user nova-compute[73010]: DEBUG nova.compute.manager [req-3341a7cd-51d2-498e-b5fa-1aa6ae1e2da7 req-d7ea8348-cd6a-427e-aaea-40602b3073a6 service nova] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Refreshing instance network info cache due to event network-changed-54ab08b8-0782-47ee-851c-66ce82be651c. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:55:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3341a7cd-51d2-498e-b5fa-1aa6ae1e2da7 req-d7ea8348-cd6a-427e-aaea-40602b3073a6 service nova] Acquiring lock "refresh_cache-77e3348e-1697-45e0-9409-710017e0222c" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:55:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3341a7cd-51d2-498e-b5fa-1aa6ae1e2da7 req-d7ea8348-cd6a-427e-aaea-40602b3073a6 service nova] Acquired lock "refresh_cache-77e3348e-1697-45e0-9409-710017e0222c" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:55:08 user nova-compute[73010]: DEBUG nova.network.neutron [req-3341a7cd-51d2-498e-b5fa-1aa6ae1e2da7 req-d7ea8348-cd6a-427e-aaea-40602b3073a6 service nova] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Refreshing network info cache for port 54ab08b8-0782-47ee-851c-66ce82be651c {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:55:08 user nova-compute[73010]: DEBUG nova.network.neutron [req-3341a7cd-51d2-498e-b5fa-1aa6ae1e2da7 req-d7ea8348-cd6a-427e-aaea-40602b3073a6 service nova] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Updated VIF entry in instance network info cache for port 54ab08b8-0782-47ee-851c-66ce82be651c. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:55:08 user nova-compute[73010]: DEBUG nova.network.neutron [req-3341a7cd-51d2-498e-b5fa-1aa6ae1e2da7 req-d7ea8348-cd6a-427e-aaea-40602b3073a6 service nova] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Updating instance_info_cache with network_info: [{"id": "54ab08b8-0782-47ee-851c-66ce82be651c", "address": "fa:16:3e:48:ef:e8", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ab08b8-07", "ovs_interfaceid": "54ab08b8-0782-47ee-851c-66ce82be651c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:55:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3341a7cd-51d2-498e-b5fa-1aa6ae1e2da7 req-d7ea8348-cd6a-427e-aaea-40602b3073a6 service nova] Releasing lock "refresh_cache-77e3348e-1697-45e0-9409-710017e0222c" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:55:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:55:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 00:55:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:55:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:55:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "77e3348e-1697-45e0-9409-710017e0222c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "77e3348e-1697-45e0-9409-710017e0222c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "77e3348e-1697-45e0-9409-710017e0222c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "77e3348e-1697-45e0-9409-710017e0222c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "77e3348e-1697-45e0-9409-710017e0222c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:55:09 user nova-compute[73010]: INFO nova.compute.manager [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Terminating instance
Aug 15 00:55:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:55:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:09 user nova-compute[73010]: DEBUG nova.compute.manager [req-331f8c30-564a-4aa8-9df8-ecffbac42807 req-3b33a1ed-b1c2-466e-971c-6fb6b1e6aa0b service nova] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Received event network-vif-unplugged-54ab08b8-0782-47ee-851c-66ce82be651c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:55:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-331f8c30-564a-4aa8-9df8-ecffbac42807 req-3b33a1ed-b1c2-466e-971c-6fb6b1e6aa0b service nova] Acquiring lock "77e3348e-1697-45e0-9409-710017e0222c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-331f8c30-564a-4aa8-9df8-ecffbac42807 req-3b33a1ed-b1c2-466e-971c-6fb6b1e6aa0b service nova] Lock "77e3348e-1697-45e0-9409-710017e0222c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-331f8c30-564a-4aa8-9df8-ecffbac42807 req-3b33a1ed-b1c2-466e-971c-6fb6b1e6aa0b service nova] Lock "77e3348e-1697-45e0-9409-710017e0222c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:55:09 user nova-compute[73010]: DEBUG nova.compute.manager [req-331f8c30-564a-4aa8-9df8-ecffbac42807 req-3b33a1ed-b1c2-466e-971c-6fb6b1e6aa0b service nova] [instance: 77e3348e-1697-45e0-9409-710017e0222c] No waiting events found dispatching network-vif-unplugged-54ab08b8-0782-47ee-851c-66ce82be651c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:55:09 user nova-compute[73010]: DEBUG nova.compute.manager [req-331f8c30-564a-4aa8-9df8-ecffbac42807 req-3b33a1ed-b1c2-466e-971c-6fb6b1e6aa0b service nova] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Received event network-vif-unplugged-54ab08b8-0782-47ee-851c-66ce82be651c for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:55:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Didn't find any instances for network info cache update. {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:55:10 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Instance destroyed successfully.
Aug 15 00:55:10 user nova-compute[73010]: DEBUG nova.objects.instance [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lazy-loading 'resources' on Instance uuid 77e3348e-1697-45e0-9409-710017e0222c {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1596887429',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1596887429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1596887429',id=40,image_ref='1ee0f786-5f48-4d66-98ea-b47552adfdd2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEgfQhaziRChQ57B6BHSa+YBa0BN3+whX95aE3YJZlMalJjdg+sRLqk7NsrtO/EYYkRl4hTzjc3ish2oVGI0z45tfnm3gCL1w9JWPkt1YvDI1PilzwytWn71CU+9D8Y8g==',key_name='tempest-keypair-1302091534',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:53:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f67d1031d3cb4c8fb66342a7888ca1c4',ramdisk_id='',reservation_id='r-ur6qmdtt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1953358779',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1953358779-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1953358779',owner_user_name='tempest-TestVolumeBootPattern-1953358779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:53:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='daa4eb788f724a6fbf908b029315a02b',uuid=77e3348e-1697-45e0-9409-710017e0222c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54ab08b8-0782-47ee-851c-66ce82be651c", "address": "fa:16:3e:48:ef:e8", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ab08b8-07", "ovs_interfaceid": "54ab08b8-0782-47ee-851c-66ce82be651c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converting VIF {"id": "54ab08b8-0782-47ee-851c-66ce82be651c", "address": "fa:16:3e:48:ef:e8", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ab08b8-07", "ovs_interfaceid": "54ab08b8-0782-47ee-851c-66ce82be651c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:ef:e8,bridge_name='br-int',has_traffic_filtering=True,id=54ab08b8-0782-47ee-851c-66ce82be651c,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ab08b8-07') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG os_vif [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:ef:e8,bridge_name='br-int',has_traffic_filtering=True,id=54ab08b8-0782-47ee-851c-66ce82be651c,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ab08b8-07') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54ab08b8-07, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:55:10 user nova-compute[73010]: INFO os_vif [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:ef:e8,bridge_name='br-int',has_traffic_filtering=True,id=54ab08b8-0782-47ee-851c-66ce82be651c,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ab08b8-07')
Aug 15 00:55:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdyglYmZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:55:10 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:55:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b592269-3be0-47cf-a7a5-3555c8636342]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6b273c-2236-483d-ad12-de4b05fe36fd]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:55:10 user nova-compute[73010]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:55:10 user nova-compute[73010]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 (non-flash)
Aug 15 00:55:10 user nova-compute[73010]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c (non-flash)
Aug 15 00:55:10 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:55:10 user nova-compute[73010]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:55:10 user nova-compute[73010]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 (non-flash)
Aug 15 00:55:10 user nova-compute[73010]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c (non-flash)
Aug 15 00:55:10 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec50457d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841'): ({'sde'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Removing single pathed devices sde {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f9aad9-391b-4ca0-bcb6-9b3d6c0313e4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7508bb-d4d5-4725-a06e-eee5fe0e3ade]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Flushing IO for device /dev/sde {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[67da4ed9-5f8c-4ff0-9552-e06846083032]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05f7239-a8f0-405f-9de2-1739d122e6bf]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] SCSI volumes sde have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_485167a7',) {{(pid=84080) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba0d665-bca5-4217-aaf1-4d9d443bbad0]: (4, None) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8306a14-7fdc-41f0-97f5-e286daf1295c]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3829e0d1-a568-4f78-8ec3-49eab31af450]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841, portal: 172.16.0.220,3260]
Aug 15 00:55:10 user nova-compute[73010]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841, portal: 172.16.0.220,3260] successful.
Aug 15 00:55:10 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35759a13-3c4d-4d7d-9460-86085588d841 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cb4845-680e-42a8-a6cd-b6798dec1660]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] <== disconnect_volume: return (316ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:55:10 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Deleting instance files /opt/stack/data/nova/instances/77e3348e-1697-45e0-9409-710017e0222c_del
Aug 15 00:55:10 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Deletion of /opt/stack/data/nova/instances/77e3348e-1697-45e0-9409-710017e0222c_del complete
Aug 15 00:55:10 user nova-compute[73010]: INFO nova.compute.manager [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 15 00:55:10 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:55:10 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 77e3348e-1697-45e0-9409-710017e0222c] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:55:11 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:55:11 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:55:11 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Took 0.87 seconds to deallocate network for instance.
Aug 15 00:55:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-aebb81c1-cbd5-4eff-82d4-8e99672510c5 req-7b71d433-b60d-4213-aa84-2569c82b9776 service nova] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Received event network-vif-deleted-54ab08b8-0782-47ee-851c-66ce82be651c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:55:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-0b9e95f2-a4fa-4b97-a0b4-3ed246e0db56 req-14ce1482-a9b8-466f-a607-86a3a2acb47d service nova] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Received event network-vif-plugged-54ab08b8-0782-47ee-851c-66ce82be651c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:55:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0b9e95f2-a4fa-4b97-a0b4-3ed246e0db56 req-14ce1482-a9b8-466f-a607-86a3a2acb47d service nova] Acquiring lock "77e3348e-1697-45e0-9409-710017e0222c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0b9e95f2-a4fa-4b97-a0b4-3ed246e0db56 req-14ce1482-a9b8-466f-a607-86a3a2acb47d service nova] Lock "77e3348e-1697-45e0-9409-710017e0222c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0b9e95f2-a4fa-4b97-a0b4-3ed246e0db56 req-14ce1482-a9b8-466f-a607-86a3a2acb47d service nova] Lock "77e3348e-1697-45e0-9409-710017e0222c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:55:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-0b9e95f2-a4fa-4b97-a0b4-3ed246e0db56 req-14ce1482-a9b8-466f-a607-86a3a2acb47d service nova] [instance: 77e3348e-1697-45e0-9409-710017e0222c] No waiting events found dispatching network-vif-plugged-54ab08b8-0782-47ee-851c-66ce82be651c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:55:11 user nova-compute[73010]: WARNING nova.compute.manager [req-0b9e95f2-a4fa-4b97-a0b4-3ed246e0db56 req-14ce1482-a9b8-466f-a607-86a3a2acb47d service nova] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Received unexpected event network-vif-plugged-54ab08b8-0782-47ee-851c-66ce82be651c for instance with vm_state active and task_state deleting.
Aug 15 00:55:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "f08393c9-17c8-40c0-b8de-e8b8237e9109" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:55:12 user nova-compute[73010]: INFO nova.compute.manager [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Terminating instance
Aug 15 00:55:12 user nova-compute[73010]: DEBUG nova.compute.manager [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-4ee76823-9d16-4f47-860a-81e710a0919c req-467476e0-f102-4c55-9ffe-fcde15bb7ddb service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Received event network-vif-unplugged-03999c5a-8fca-4ceb-a7c4-f2361192421c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4ee76823-9d16-4f47-860a-81e710a0919c req-467476e0-f102-4c55-9ffe-fcde15bb7ddb service nova] Acquiring lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4ee76823-9d16-4f47-860a-81e710a0919c req-467476e0-f102-4c55-9ffe-fcde15bb7ddb service nova] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4ee76823-9d16-4f47-860a-81e710a0919c req-467476e0-f102-4c55-9ffe-fcde15bb7ddb service nova] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-4ee76823-9d16-4f47-860a-81e710a0919c req-467476e0-f102-4c55-9ffe-fcde15bb7ddb service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] No waiting events found dispatching network-vif-unplugged-03999c5a-8fca-4ceb-a7c4-f2361192421c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-4ee76823-9d16-4f47-860a-81e710a0919c req-467476e0-f102-4c55-9ffe-fcde15bb7ddb service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Received event network-vif-unplugged-03999c5a-8fca-4ceb-a7c4-f2361192421c for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:12 user nova-compute[73010]: INFO nova.compute.manager [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Took 0.87 seconds to detach 1 volumes for instance.
Aug 15 00:55:12 user nova-compute[73010]: DEBUG nova.compute.manager [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Deleting volume: 35759a13-3c4d-4d7d-9460-86085588d841 {{(pid=73010) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:12 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Instance destroyed successfully.
Aug 15 00:55:12 user nova-compute[73010]: DEBUG nova.objects.instance [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lazy-loading 'resources' on Instance uuid f08393c9-17c8-40c0-b8de-e8b8237e9109 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:48:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-563603558',display_name='tempest-ServerActionsTestOtherA-server-563603558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-563603558',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqunjyZFkLpiNk80zhHJBMmI4Jlrza8ZHLYSe5RBsKwkkEoHKGeBKUwg/vA7wlV9hl0L81vzjguxDm4dKyFGA6ikNNXxOaicSODgz47pq/ht3X4FxrymmL8vELLfuQCog==',key_name='tempest-keypair-786587935',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:51:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13115a64ccc24df68bdfda1fc72399c4',ramdisk_id='',reservation_id='r-z0n00zv0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-671712537',owner_user_name='tempest-ServerActionsTestOtherA-671712537-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:52:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0e48e71bb404f26926ac7a8176e04bb',uuid=f08393c9-17c8-40c0-b8de-e8b8237e9109,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "address": "fa:16:3e:57:45:d7", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03999c5a-8f", "ovs_interfaceid": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converting VIF {"id": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "address": "fa:16:3e:57:45:d7", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03999c5a-8f", "ovs_interfaceid": "03999c5a-8fca-4ceb-a7c4-f2361192421c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:45:d7,bridge_name='br-int',has_traffic_filtering=True,id=03999c5a-8fca-4ceb-a7c4-f2361192421c,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03999c5a-8f') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG os_vif [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:45:d7,bridge_name='br-int',has_traffic_filtering=True,id=03999c5a-8fca-4ceb-a7c4-f2361192421c,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03999c5a-8f') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03999c5a-8f, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:55:12 user nova-compute[73010]: INFO os_vif [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:45:d7,bridge_name='br-int',has_traffic_filtering=True,id=03999c5a-8fca-4ceb-a7c4-f2361192421c,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03999c5a-8f')
Aug 15 00:55:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:55:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EWMXpDGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:55:13 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:55:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8208d2-6ee4-4c52-b8c9-4dfbb6b76ba7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:13 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Deleted allocations for instance 77e3348e-1697-45e0-9409-710017e0222c
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f41dece-2ab6-4afa-a4ca-14cfb0e507f1]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:55:13 user nova-compute[73010]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:55:13 user nova-compute[73010]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c (non-flash)
Aug 15 00:55:13 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 (non-flash)
Aug 15 00:55:13 user nova-compute[73010]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:55:13 user nova-compute[73010]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c (non-flash)
Aug 15 00:55:13 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec503a72e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7'): ({'sdd'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Removing single pathed devices sdd {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[891f43b2-0ec3-42f9-99df-fb8bfdf2b01c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b783e057-2ac3-4994-aa63-cb76880ede1f]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Flushing IO for device /dev/sdd {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1b7e7bda-1642-4a2e-a32a-7a701855efad tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "77e3348e-1697-45e0-9409-710017e0222c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.547s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[990afec1-5914-4cfc-b1d4-c92f2d03111d]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[34344240-7e38-4c16-a94c-cc77d932d8a4]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] SCSI volumes sdd have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4ef269-bad9-4f60-a77a-dcd3bac6b569]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[458a07a4-20ec-45ad-8502-eaf641435dba]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7, portal: 172.16.0.220,3260]
Aug 15 00:55:13 user nova-compute[73010]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7, portal: 172.16.0.220,3260] successful.
Aug 15 00:55:13 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9498e6-7b0b-40c5-92cf-66016737f2e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c05a0f8-2f4d-4b9a-8fa0-fbc40d8a391a]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] <== disconnect_volume: return (303ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:55:13 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Deleting instance files /opt/stack/data/nova/instances/f08393c9-17c8-40c0-b8de-e8b8237e9109_del
Aug 15 00:55:13 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Deletion of /opt/stack/data/nova/instances/f08393c9-17c8-40c0-b8de-e8b8237e9109_del complete
Aug 15 00:55:13 user nova-compute[73010]: INFO nova.compute.manager [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:55:13 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:55:14 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:55:14 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Took 0.81 seconds to deallocate network for instance.
Aug 15 00:55:14 user nova-compute[73010]: DEBUG nova.compute.manager [req-e382a7bd-d359-4d21-ac27-d9de29682081 req-cd44b8cd-863f-483f-b0ee-c1445043a06b service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Received event network-vif-deleted-03999c5a-8fca-4ceb-a7c4-f2361192421c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:55:14 user nova-compute[73010]: INFO nova.compute.manager [req-e382a7bd-d359-4d21-ac27-d9de29682081 req-cd44b8cd-863f-483f-b0ee-c1445043a06b service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Neutron deleted interface 03999c5a-8fca-4ceb-a7c4-f2361192421c; detaching it from the instance and deleting it from the info cache
Aug 15 00:55:14 user nova-compute[73010]: DEBUG nova.network.neutron [req-e382a7bd-d359-4d21-ac27-d9de29682081 req-cd44b8cd-863f-483f-b0ee-c1445043a06b service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:55:14 user nova-compute[73010]: DEBUG nova.compute.manager [req-e382a7bd-d359-4d21-ac27-d9de29682081 req-cd44b8cd-863f-483f-b0ee-c1445043a06b service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Detach interface failed, port_id=03999c5a-8fca-4ceb-a7c4-f2361192421c, reason: Instance f08393c9-17c8-40c0-b8de-e8b8237e9109 could not be found. {{(pid=73010) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 00:55:14 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:55:14 user nova-compute[73010]: DEBUG nova.compute.manager [req-1ac57d6a-d794-491a-8117-f67e286cb0ca req-9baf27e6-eee4-4603-9666-d4a8d62c00e5 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Received event network-vif-plugged-03999c5a-8fca-4ceb-a7c4-f2361192421c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:55:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1ac57d6a-d794-491a-8117-f67e286cb0ca req-9baf27e6-eee4-4603-9666-d4a8d62c00e5 service nova] Acquiring lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1ac57d6a-d794-491a-8117-f67e286cb0ca req-9baf27e6-eee4-4603-9666-d4a8d62c00e5 service nova] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1ac57d6a-d794-491a-8117-f67e286cb0ca req-9baf27e6-eee4-4603-9666-d4a8d62c00e5 service nova] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:55:14 user nova-compute[73010]: DEBUG nova.compute.manager [req-1ac57d6a-d794-491a-8117-f67e286cb0ca req-9baf27e6-eee4-4603-9666-d4a8d62c00e5 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] No waiting events found dispatching network-vif-plugged-03999c5a-8fca-4ceb-a7c4-f2361192421c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:55:14 user nova-compute[73010]: WARNING nova.compute.manager [req-1ac57d6a-d794-491a-8117-f67e286cb0ca req-9baf27e6-eee4-4603-9666-d4a8d62c00e5 service nova] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Received unexpected event network-vif-plugged-03999c5a-8fca-4ceb-a7c4-f2361192421c for instance with vm_state active and task_state deleting.
Aug 15 00:55:14 user nova-compute[73010]: INFO nova.compute.manager [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Took 0.80 seconds to detach 1 volumes for instance.
Aug 15 00:55:14 user nova-compute[73010]: DEBUG nova.compute.manager [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Deleting volume: 1f9498e6-7b0b-40c5-92cf-66016737f2e7 {{(pid=73010) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 00:55:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:15 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:55:15 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:55:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:55:15 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Deleted allocations for instance f08393c9-17c8-40c0-b8de-e8b8237e9109
Aug 15 00:55:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-56303c72-72e9-4262-901b-942c78d46a8f tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "f08393c9-17c8-40c0-b8de-e8b8237e9109" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.362s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:55:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:55:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 00:55:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:55:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:55:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "a736c704-e72e-4009-87e6-e165c5abe5bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "a736c704-e72e-4009-87e6-e165c5abe5bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:25 user nova-compute[73010]: INFO nova.compute.manager [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Detaching volume 4ef2e281-2b80-450a-90d6-b350059cc35c
Aug 15 00:55:25 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060910.3265848, 77e3348e-1697-45e0-9409-710017e0222c => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:55:25 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 77e3348e-1697-45e0-9409-710017e0222c] VM Stopped (Lifecycle Event)
Aug 15 00:55:25 user nova-compute[73010]: INFO nova.virt.block_device [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Attempting to driver detach volume 4ef2e281-2b80-450a-90d6-b350059cc35c from mountpoint /dev/vdb
Aug 15 00:55:25 user nova-compute[73010]: DEBUG nova.compute.manager [None req-9078ef15-789e-4b68-9d96-18f2995406d3 None None] [instance: 77e3348e-1697-45e0-9409-710017e0222c] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Attempting to detach device vdb from instance a736c704-e72e-4009-87e6-e165c5abe5bd from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:55:25 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:55:25 user nova-compute[73010]:   <source dev="/dev/sdf"/>
Aug 15 00:55:25 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:55:25 user nova-compute[73010]:   <serial>4ef2e281-2b80-450a-90d6-b350059cc35c</serial>
Aug 15 00:55:25 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:55:25 user nova-compute[73010]: </disk>
Aug 15 00:55:25 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:55:25 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Successfully detached device vdb from instance a736c704-e72e-4009-87e6-e165c5abe5bd from the persistent domain config.
Aug 15 00:55:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a736c704-e72e-4009-87e6-e165c5abe5bd from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:55:25 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:55:25 user nova-compute[73010]:   <source dev="/dev/sdf"/>
Aug 15 00:55:25 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:55:25 user nova-compute[73010]:   <serial>4ef2e281-2b80-450a-90d6-b350059cc35c</serial>
Aug 15 00:55:25 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 00:55:25 user nova-compute[73010]: </disk>
Aug 15 00:55:25 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "a736c704-e72e-4009-87e6-e165c5abe5bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692060925.7985075, a736c704-e72e-4009-87e6-e165c5abe5bd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a736c704-e72e-4009-87e6-e165c5abe5bd {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:55:25 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Successfully detached device vdb from instance a736c704-e72e-4009-87e6-e165c5abe5bd from the live domain config.
Aug 15 00:55:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScmIQTCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:55:25 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:55:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f97f749-ce61-47ab-89c1-652f26e2af5d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbc42ce-ec1d-4c4c-9135-637546ac43d3]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:55:25 user nova-compute[73010]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c (non-flash)
Aug 15 00:55:25 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:55:25 user nova-compute[73010]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c (non-flash)
Aug 15 00:55:25 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec3042dea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c'): ({'sdf'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Removing single pathed devices sdf {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d620f62-6ac1-4e36-b556-7dfe1fdaae06]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3b772a-d134-4abe-8f6f-cc1765060b7c]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Flushing IO for device /dev/sdf {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[325e84cd-9534-435f-9a53-971a35da233e]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff92c4b-59cc-4fe2-a289-b2a312b085c5]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] SCSI volumes sdf have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[905f5595-ca9e-4b55-9ae5-9d32bb622b65]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:55:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:26 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:26 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af1f8d8-0c41-4ce9-a7b5-243263e411d5]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:26 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c, portal: 172.16.0.220,3260]
Aug 15 00:55:26 user nova-compute[73010]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c, portal: 172.16.0.220,3260] successful.
Aug 15 00:55:26 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:55:26 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:26 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:26 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[40732752-5212-400f-b078-659f7c7d147a]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:26 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:55:26 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:55:26 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] <== disconnect_volume: return (270ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:55:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:55:26 user nova-compute[73010]: DEBUG nova.objects.instance [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lazy-loading 'flavor' on Instance uuid a736c704-e72e-4009-87e6-e165c5abe5bd {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:55:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-26149aa1-96c1-446d-a0f5-4848a0eab1a1 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "a736c704-e72e-4009-87e6-e165c5abe5bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.587s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:55:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "a736c704-e72e-4009-87e6-e165c5abe5bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.471s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "a736c704-e72e-4009-87e6-e165c5abe5bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "a736c704-e72e-4009-87e6-e165c5abe5bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "a736c704-e72e-4009-87e6-e165c5abe5bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:55:26 user nova-compute[73010]: INFO nova.compute.manager [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Terminating instance
Aug 15 00:55:26 user nova-compute[73010]: DEBUG nova.compute.manager [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:55:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG nova.compute.manager [req-d9aa0057-98d3-4de5-afe6-3b66dfbc2cdb req-fca40aa9-bd7c-4044-9f4a-e1a712fdd6de service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Received event network-vif-unplugged-feecf72a-c68a-4948-9134-21ec312e4cc9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d9aa0057-98d3-4de5-afe6-3b66dfbc2cdb req-fca40aa9-bd7c-4044-9f4a-e1a712fdd6de service nova] Acquiring lock "a736c704-e72e-4009-87e6-e165c5abe5bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d9aa0057-98d3-4de5-afe6-3b66dfbc2cdb req-fca40aa9-bd7c-4044-9f4a-e1a712fdd6de service nova] Lock "a736c704-e72e-4009-87e6-e165c5abe5bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d9aa0057-98d3-4de5-afe6-3b66dfbc2cdb req-fca40aa9-bd7c-4044-9f4a-e1a712fdd6de service nova] Lock "a736c704-e72e-4009-87e6-e165c5abe5bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG nova.compute.manager [req-d9aa0057-98d3-4de5-afe6-3b66dfbc2cdb req-fca40aa9-bd7c-4044-9f4a-e1a712fdd6de service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] No waiting events found dispatching network-vif-unplugged-feecf72a-c68a-4948-9134-21ec312e4cc9 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG nova.compute.manager [req-d9aa0057-98d3-4de5-afe6-3b66dfbc2cdb req-fca40aa9-bd7c-4044-9f4a-e1a712fdd6de service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Received event network-vif-unplugged-feecf72a-c68a-4948-9134-21ec312e4cc9 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:55:27 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Instance destroyed successfully.
Aug 15 00:55:27 user nova-compute[73010]: DEBUG nova.objects.instance [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lazy-loading 'resources' on Instance uuid a736c704-e72e-4009-87e6-e165c5abe5bd {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:52:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1128031251',display_name='tempest-VolumesSnapshotTestJSON-instance-1128031251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1128031251',id=39,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2rCJW4a0GQq/DQpXU4P6Atlq1q7zXRtMrXucByzC0onm2zF+LiZyzam5179NIvLOvW1n6AtzyP6sMmDEtcsdCcSjpUUa/1I59cWwF4r7O4TUMIzNIezWA60P4dRKHclQ==',key_name='tempest-keypair-1076869984',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:52:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca4dad0b4fa44c61b6cae2227e6b77d0',ramdisk_id='',reservation_id='r-ahjkg08h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1973403028',owner_user_name='tempest-VolumesSnapshotTestJSON-1973403028-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d89d0afcfdc549b391c4c37c04b54b91',uuid=a736c704-e72e-4009-87e6-e165c5abe5bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "feecf72a-c68a-4948-9134-21ec312e4cc9", "address": "fa:16:3e:36:65:77", "network": {"id": "97be784b-67e7-46e9-949a-510d7c526338", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207062863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4dad0b4fa44c61b6cae2227e6b77d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeecf72a-c6", "ovs_interfaceid": "feecf72a-c68a-4948-9134-21ec312e4cc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Converting VIF {"id": "feecf72a-c68a-4948-9134-21ec312e4cc9", "address": "fa:16:3e:36:65:77", "network": {"id": "97be784b-67e7-46e9-949a-510d7c526338", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207062863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4dad0b4fa44c61b6cae2227e6b77d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeecf72a-c6", "ovs_interfaceid": "feecf72a-c68a-4948-9134-21ec312e4cc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:65:77,bridge_name='br-int',has_traffic_filtering=True,id=feecf72a-c68a-4948-9134-21ec312e4cc9,network=Network(97be784b-67e7-46e9-949a-510d7c526338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeecf72a-c6') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG os_vif [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:65:77,bridge_name='br-int',has_traffic_filtering=True,id=feecf72a-c68a-4948-9134-21ec312e4cc9,network=Network(97be784b-67e7-46e9-949a-510d7c526338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeecf72a-c6') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfeecf72a-c6, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:55:27 user nova-compute[73010]: INFO os_vif [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:65:77,bridge_name='br-int',has_traffic_filtering=True,id=feecf72a-c68a-4948-9134-21ec312e4cc9,network=Network(97be784b-67e7-46e9-949a-510d7c526338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeecf72a-c6')
Aug 15 00:55:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScmIQTCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:55:27 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:55:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ef2e281-2b80-450a-90d6-b350059cc35c', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8ba531-d496-4dd8-b456-cfefcce2daf5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ece914b-069c-4969-a49f-c2a083a5cb73]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:55:27 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:55:27 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec50247400>, {}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Disconnecting from: [] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.046s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] <== disconnect_volume: return (46ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:55:27 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Deleting instance files /opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd_del
Aug 15 00:55:27 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Deletion of /opt/stack/data/nova/instances/a736c704-e72e-4009-87e6-e165c5abe5bd_del complete
Aug 15 00:55:27 user nova-compute[73010]: INFO nova.compute.manager [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 15 00:55:27 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:55:27 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060912.9250793, f08393c9-17c8-40c0-b8de-e8b8237e9109 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:55:27 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] VM Stopped (Lifecycle Event)
Aug 15 00:55:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-aca39b72-e4be-47ce-997b-b81ac8910449 None None] [instance: f08393c9-17c8-40c0-b8de-e8b8237e9109] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:55:28 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:55:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-4071502b-4fe5-4162-9858-e4b4edfd6ccb req-3249b0ad-8db5-4ac2-a06f-1a9de37f295f service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Received event network-vif-deleted-feecf72a-c68a-4948-9134-21ec312e4cc9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:55:28 user nova-compute[73010]: INFO nova.compute.manager [req-4071502b-4fe5-4162-9858-e4b4edfd6ccb req-3249b0ad-8db5-4ac2-a06f-1a9de37f295f service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Neutron deleted interface feecf72a-c68a-4948-9134-21ec312e4cc9; detaching it from the instance and deleting it from the info cache
Aug 15 00:55:28 user nova-compute[73010]: DEBUG nova.network.neutron [req-4071502b-4fe5-4162-9858-e4b4edfd6ccb req-3249b0ad-8db5-4ac2-a06f-1a9de37f295f service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:55:28 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Took 0.90 seconds to deallocate network for instance.
Aug 15 00:55:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-4071502b-4fe5-4162-9858-e4b4edfd6ccb req-3249b0ad-8db5-4ac2-a06f-1a9de37f295f service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Detach interface failed, port_id=feecf72a-c68a-4948-9134-21ec312e4cc9, reason: Instance a736c704-e72e-4009-87e6-e165c5abe5bd could not be found. {{(pid=73010) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 00:55:28 user nova-compute[73010]: WARNING nova.volume.cinder [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Attachment 217d32ef-57c8-4e50-a4ec-7a9621da0a43 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 217d32ef-57c8-4e50-a4ec-7a9621da0a43. (HTTP 404) (Request-ID: req-27a110e3-a1e6-41b6-af21-1f77a1d62fff)
Aug 15 00:55:28 user nova-compute[73010]: INFO nova.compute.manager [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Took 0.03 seconds to detach 1 volumes for instance.
Aug 15 00:55:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:28 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:55:28 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:55:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:55:29 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Deleted allocations for instance a736c704-e72e-4009-87e6-e165c5abe5bd
Aug 15 00:55:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-13dc7e02-3a59-4725-8d11-7e48098db5b0 tempest-VolumesSnapshotTestJSON-1973403028 tempest-VolumesSnapshotTestJSON-1973403028-project-member] Lock "a736c704-e72e-4009-87e6-e165c5abe5bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.287s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:55:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-60af7f83-26d9-4d9a-a0cc-fe22c40699ab tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "b94d5990-9053-4119-9228-fdbec348294f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-60af7f83-26d9-4d9a-a0cc-fe22c40699ab tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "b94d5990-9053-4119-9228-fdbec348294f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-60af7f83-26d9-4d9a-a0cc-fe22c40699ab tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "b94d5990-9053-4119-9228-fdbec348294f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-60af7f83-26d9-4d9a-a0cc-fe22c40699ab tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-60af7f83-26d9-4d9a-a0cc-fe22c40699ab tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:55:29 user nova-compute[73010]: INFO nova.compute.manager [None req-60af7f83-26d9-4d9a-a0cc-fe22c40699ab tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Terminating instance
Aug 15 00:55:29 user nova-compute[73010]: DEBUG nova.compute.manager [None req-60af7f83-26d9-4d9a-a0cc-fe22c40699ab tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:55:29 user nova-compute[73010]: DEBUG nova.compute.manager [req-d4fb5604-57e7-4a8c-be69-8740f4681d58 req-9af7cb8a-ee7f-4c7f-af26-3d6a2c3b610e service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Received event network-vif-plugged-feecf72a-c68a-4948-9134-21ec312e4cc9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:55:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d4fb5604-57e7-4a8c-be69-8740f4681d58 req-9af7cb8a-ee7f-4c7f-af26-3d6a2c3b610e service nova] Acquiring lock "a736c704-e72e-4009-87e6-e165c5abe5bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d4fb5604-57e7-4a8c-be69-8740f4681d58 req-9af7cb8a-ee7f-4c7f-af26-3d6a2c3b610e service nova] Lock "a736c704-e72e-4009-87e6-e165c5abe5bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d4fb5604-57e7-4a8c-be69-8740f4681d58 req-9af7cb8a-ee7f-4c7f-af26-3d6a2c3b610e service nova] Lock "a736c704-e72e-4009-87e6-e165c5abe5bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:55:29 user nova-compute[73010]: DEBUG nova.compute.manager [req-d4fb5604-57e7-4a8c-be69-8740f4681d58 req-9af7cb8a-ee7f-4c7f-af26-3d6a2c3b610e service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] No waiting events found dispatching network-vif-plugged-feecf72a-c68a-4948-9134-21ec312e4cc9 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:55:29 user nova-compute[73010]: WARNING nova.compute.manager [req-d4fb5604-57e7-4a8c-be69-8740f4681d58 req-9af7cb8a-ee7f-4c7f-af26-3d6a2c3b610e service nova] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Received unexpected event network-vif-plugged-feecf72a-c68a-4948-9134-21ec312e4cc9 for instance with vm_state deleted and task_state None.
Aug 15 00:55:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:29 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: b94d5990-9053-4119-9228-fdbec348294f] Instance destroyed successfully.
Aug 15 00:55:29 user nova-compute[73010]: DEBUG nova.objects.instance [None req-60af7f83-26d9-4d9a-a0cc-fe22c40699ab tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'resources' on Instance uuid b94d5990-9053-4119-9228-fdbec348294f {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:55:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-60af7f83-26d9-4d9a-a0cc-fe22c40699ab tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:48:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-220776850',display_name='tempest-ServerRescueNegativeTestJSON-server-220776850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-220776850',id=36,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3uU0TMyomtTWjjXAOQ1AeVnCevUTKc6xapS8CuxmyV7c2W8WToMj+nZgwdQH3bzcDsH/Zqc8aHV63MQJhBdeGcL5ye492+TxtxTBn8Qkgex996dW0hplq+S7MPfzxsFQ==',key_name='tempest-keypair-1985091748',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:51:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a564ea15194c4e059746d2fc6e7e1a07',ramdisk_id='',reservation_id='r-66d21cjz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-203744558',owner_user_name='tempest-ServerRescueNegativeTestJSON-203744558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:52:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b85ef05658d64f1fbd78e509e2a606d8',uuid=b94d5990-9053-4119-9228-fdbec348294f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "address": "fa:16:3e:54:79:b9", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e5551e5-7a", "ovs_interfaceid": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:55:29 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-60af7f83-26d9-4d9a-a0cc-fe22c40699ab tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Converting VIF {"id": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "address": "fa:16:3e:54:79:b9", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e5551e5-7a", "ovs_interfaceid": "3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:55:29 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-60af7f83-26d9-4d9a-a0cc-fe22c40699ab tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:79:b9,bridge_name='br-int',has_traffic_filtering=True,id=3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9,network=Network(f4772ea6-9cb0-4ca8-b327-34f8dd08808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e5551e5-7a') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:55:29 user nova-compute[73010]: DEBUG os_vif [None req-60af7f83-26d9-4d9a-a0cc-fe22c40699ab tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:79:b9,bridge_name='br-int',has_traffic_filtering=True,id=3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9,network=Network(f4772ea6-9cb0-4ca8-b327-34f8dd08808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e5551e5-7a') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:55:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e5551e5-7a, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:55:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:55:29 user nova-compute[73010]: INFO os_vif [None req-60af7f83-26d9-4d9a-a0cc-fe22c40699ab tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:79:b9,bridge_name='br-int',has_traffic_filtering=True,id=3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9,network=Network(f4772ea6-9cb0-4ca8-b327-34f8dd08808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e5551e5-7a')
Aug 15 00:55:29 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-60af7f83-26d9-4d9a-a0cc-fe22c40699ab tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Deleting instance files /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f_del
Aug 15 00:55:29 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-60af7f83-26d9-4d9a-a0cc-fe22c40699ab tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Deletion of /opt/stack/data/nova/instances/b94d5990-9053-4119-9228-fdbec348294f_del complete
Aug 15 00:55:30 user nova-compute[73010]: INFO nova.compute.manager [None req-60af7f83-26d9-4d9a-a0cc-fe22c40699ab tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: b94d5990-9053-4119-9228-fdbec348294f] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 15 00:55:30 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-60af7f83-26d9-4d9a-a0cc-fe22c40699ab tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:55:30 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: b94d5990-9053-4119-9228-fdbec348294f] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:55:30 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: b94d5990-9053-4119-9228-fdbec348294f] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:55:30 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: b94d5990-9053-4119-9228-fdbec348294f] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:55:30 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: b94d5990-9053-4119-9228-fdbec348294f] Took 0.82 seconds to deallocate network for instance.
Aug 15 00:55:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-0a33a4e0-7127-4246-bcb6-04fc288c7e90 req-0f3c5d6b-6106-4ee5-98f2-887f34c190f6 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received event network-vif-deleted-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:55:30 user nova-compute[73010]: INFO nova.compute.manager [req-0a33a4e0-7127-4246-bcb6-04fc288c7e90 req-0f3c5d6b-6106-4ee5-98f2-887f34c190f6 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Neutron deleted interface 3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9; detaching it from the instance and deleting it from the info cache
Aug 15 00:55:30 user nova-compute[73010]: DEBUG nova.network.neutron [req-0a33a4e0-7127-4246-bcb6-04fc288c7e90 req-0f3c5d6b-6106-4ee5-98f2-887f34c190f6 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:55:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-0a33a4e0-7127-4246-bcb6-04fc288c7e90 req-0f3c5d6b-6106-4ee5-98f2-887f34c190f6 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Detach interface failed, port_id=3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9, reason: Instance b94d5990-9053-4119-9228-fdbec348294f could not be found. {{(pid=73010) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 00:55:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-60af7f83-26d9-4d9a-a0cc-fe22c40699ab tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-60af7f83-26d9-4d9a-a0cc-fe22c40699ab tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:31 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-60af7f83-26d9-4d9a-a0cc-fe22c40699ab tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:55:31 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-60af7f83-26d9-4d9a-a0cc-fe22c40699ab tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:55:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-60af7f83-26d9-4d9a-a0cc-fe22c40699ab tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:55:31 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-60af7f83-26d9-4d9a-a0cc-fe22c40699ab tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Deleted allocations for instance b94d5990-9053-4119-9228-fdbec348294f
Aug 15 00:55:31 user nova-compute[73010]: DEBUG nova.compute.manager [req-6fa42dfa-2cbe-4304-9e89-8878388f1b21 req-f99462a0-dabc-4c83-b04a-544ace19fb96 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received event network-vif-unplugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:55:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6fa42dfa-2cbe-4304-9e89-8878388f1b21 req-f99462a0-dabc-4c83-b04a-544ace19fb96 service nova] Acquiring lock "b94d5990-9053-4119-9228-fdbec348294f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6fa42dfa-2cbe-4304-9e89-8878388f1b21 req-f99462a0-dabc-4c83-b04a-544ace19fb96 service nova] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6fa42dfa-2cbe-4304-9e89-8878388f1b21 req-f99462a0-dabc-4c83-b04a-544ace19fb96 service nova] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:55:31 user nova-compute[73010]: DEBUG nova.compute.manager [req-6fa42dfa-2cbe-4304-9e89-8878388f1b21 req-f99462a0-dabc-4c83-b04a-544ace19fb96 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] No waiting events found dispatching network-vif-unplugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:55:31 user nova-compute[73010]: WARNING nova.compute.manager [req-6fa42dfa-2cbe-4304-9e89-8878388f1b21 req-f99462a0-dabc-4c83-b04a-544ace19fb96 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received unexpected event network-vif-unplugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 for instance with vm_state deleted and task_state None.
Aug 15 00:55:31 user nova-compute[73010]: DEBUG nova.compute.manager [req-6fa42dfa-2cbe-4304-9e89-8878388f1b21 req-f99462a0-dabc-4c83-b04a-544ace19fb96 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received event network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:55:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6fa42dfa-2cbe-4304-9e89-8878388f1b21 req-f99462a0-dabc-4c83-b04a-544ace19fb96 service nova] Acquiring lock "b94d5990-9053-4119-9228-fdbec348294f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6fa42dfa-2cbe-4304-9e89-8878388f1b21 req-f99462a0-dabc-4c83-b04a-544ace19fb96 service nova] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6fa42dfa-2cbe-4304-9e89-8878388f1b21 req-f99462a0-dabc-4c83-b04a-544ace19fb96 service nova] Lock "b94d5990-9053-4119-9228-fdbec348294f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:55:31 user nova-compute[73010]: DEBUG nova.compute.manager [req-6fa42dfa-2cbe-4304-9e89-8878388f1b21 req-f99462a0-dabc-4c83-b04a-544ace19fb96 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] No waiting events found dispatching network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:55:31 user nova-compute[73010]: WARNING nova.compute.manager [req-6fa42dfa-2cbe-4304-9e89-8878388f1b21 req-f99462a0-dabc-4c83-b04a-544ace19fb96 service nova] [instance: b94d5990-9053-4119-9228-fdbec348294f] Received unexpected event network-vif-plugged-3e5551e5-7a8a-4c13-9c7e-47fbb223ccd9 for instance with vm_state deleted and task_state None.
Aug 15 00:55:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-60af7f83-26d9-4d9a-a0cc-fe22c40699ab tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "b94d5990-9053-4119-9228-fdbec348294f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.098s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:55:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:55:42 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060927.6152918, a736c704-e72e-4009-87e6-e165c5abe5bd => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:55:42 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] VM Stopped (Lifecycle Event)
Aug 15 00:55:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-a1de6089-8bb1-42e8-88fe-e45336be7db7 None None] [instance: a736c704-e72e-4009-87e6-e165c5abe5bd] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:55:44 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060929.9355662, b94d5990-9053-4119-9228-fdbec348294f => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:55:44 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: b94d5990-9053-4119-9228-fdbec348294f] VM Stopped (Lifecycle Event)
Aug 15 00:55:44 user nova-compute[73010]: DEBUG nova.compute.manager [None req-3f8194a1-9f64-4b1e-b4e9-d66947944b3b None None] [instance: b94d5990-9053-4119-9228-fdbec348294f] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:55:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:55:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "08a1c553-db53-4559-bac1-4e84ac05e2ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG nova.objects.instance [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lazy-loading 'flavor' on Instance uuid 08a1c553-db53-4559-bac1-4e84ac05e2ab {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "08a1c553-db53-4559-bac1-4e84ac05e2ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:50 user nova-compute[73010]: INFO nova.compute.manager [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Attaching volume 5695d185-a59c-4e3f-a2e0-a16b899772a6 to /dev/vdb
Aug 15 00:55:50 user nova-compute[73010]: DEBUG os_brick.utils [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f19eab8-bffa-4bba-b1f9-a5ff95dc765c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[88276421-b50d-40ac-b738-f5ca178ef903]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[265ec9d1-72f7-4e29-9c44-920c4ae22cab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3190d15f-0b29-4049-a7f6-51742eb6d07b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:55:50 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:55:50 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b5bd32-d7ab-46e6-aa06-dcee8c3b120d]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG os_brick.utils [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:55:50 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Updating existing volume attachment record: 163d74da-d8cf-4cd6-b51c-b227de530e91 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:55:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:55:57 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:55:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:55:57 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:55:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcaoVkfv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:55:59 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:55:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:55:59 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:55:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:55:59 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da2cdd4-9351-431f-8c02-acf8ee0c6d47]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:55:59 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55779de-15ec-4f15-bc99-0d2e87cc1134]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6] added
Aug 15 00:55:59 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9503f9b3-dc13-41c6-b1f4-c74f7fe7e227]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3c7e87-ad0f-4b44-a0e6-0702de942fe5]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dcaoVkfv {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dcaoVkfv" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a7f514-4036-4123-8ed4-c5cff1687a8c]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dcaoVkfv'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b539a6ed-0664-41c1-81ba-ce41f7e1f65b]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a0e187-1960-4d19-b99e-e3ca4ad84037]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:55:59 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:55:59 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c42b844-e364-4ae5-bac7-b76383211cc7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6, portal: 172.16.0.220,3260]
Aug 15 00:55:59 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6, portal: 172.16.0.220,3260] successful.
Aug 15 00:55:59 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae751fc-6825-40aa-8b9d-53b300a47a73]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dff8d2-a7c6-4c33-bf18-85ff9bb0e38e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:55:59 user nova-compute[73010]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 (non-flash)
Aug 15 00:55:59 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:55:59 user nova-compute[73010]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 (non-flash)
Aug 15 00:55:59 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[195488c2-bf24-47ff-88ca-74360538fce3]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:55:59 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:55:59 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:55:59 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8244MB free_disk=25.52404022216797GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:55:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:56:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6dfc356b-953a-47b0-9da7-70cc59a80853 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:56:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance eec545e8-eeda-443c-9892-980e19e7267a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:56:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 4b489f97-c8d4-4a6a-8404-e1a05a990261 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:56:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:56:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 08a1c553-db53-4559-bac1-4e84ac05e2ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:56:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:56:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:56:00 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:56:00 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:56:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:56:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:56:00 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:56:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcaoVkfv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:56:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:56:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23864646534353464', 'path': '/dev/sdc'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:56:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864646534353464', 'path': '/dev/sdc'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:56:00 user nova-compute[73010]: DEBUG nova.objects.instance [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lazy-loading 'flavor' on Instance uuid 08a1c553-db53-4559-bac1-4e84ac05e2ab {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:56:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 00:56:00 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:56:00 user nova-compute[73010]:   <source dev="/dev/sdc"/>
Aug 15 00:56:00 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:56:00 user nova-compute[73010]:   <serial>5695d185-a59c-4e3f-a2e0-a16b899772a6</serial>
Aug 15 00:56:00 user nova-compute[73010]: </disk>
Aug 15 00:56:00 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 00:56:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:56:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:56:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] No VIF found with MAC fa:16:3e:8b:f0:7a, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:56:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-75604a6a-2c95-4d84-91e2-d859611ff4a2 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.512s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:56:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "7eeadaaa-9d8b-44d2-a419-9bc5b595fc67" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:56:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "7eeadaaa-9d8b-44d2-a419-9bc5b595fc67" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:56:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "7eeadaaa-9d8b-44d2-a419-9bc5b595fc67-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:56:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "7eeadaaa-9d8b-44d2-a419-9bc5b595fc67-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:56:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "7eeadaaa-9d8b-44d2-a419-9bc5b595fc67-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:56:05 user nova-compute[73010]: INFO nova.compute.manager [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Terminating instance
Aug 15 00:56:05 user nova-compute[73010]: DEBUG nova.compute.manager [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:56:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:05 user nova-compute[73010]: DEBUG nova.compute.manager [req-e0c22684-18c9-47e2-9027-95f889a6812c req-3e966138-1180-4a3e-a503-71e8c19ea0b9 service nova] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Received event network-vif-unplugged-dff813d1-422b-4b69-b896-85274bba5dbb {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:56:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e0c22684-18c9-47e2-9027-95f889a6812c req-3e966138-1180-4a3e-a503-71e8c19ea0b9 service nova] Acquiring lock "7eeadaaa-9d8b-44d2-a419-9bc5b595fc67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:56:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e0c22684-18c9-47e2-9027-95f889a6812c req-3e966138-1180-4a3e-a503-71e8c19ea0b9 service nova] Lock "7eeadaaa-9d8b-44d2-a419-9bc5b595fc67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:56:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e0c22684-18c9-47e2-9027-95f889a6812c req-3e966138-1180-4a3e-a503-71e8c19ea0b9 service nova] Lock "7eeadaaa-9d8b-44d2-a419-9bc5b595fc67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:56:05 user nova-compute[73010]: DEBUG nova.compute.manager [req-e0c22684-18c9-47e2-9027-95f889a6812c req-3e966138-1180-4a3e-a503-71e8c19ea0b9 service nova] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] No waiting events found dispatching network-vif-unplugged-dff813d1-422b-4b69-b896-85274bba5dbb {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:56:05 user nova-compute[73010]: DEBUG nova.compute.manager [req-e0c22684-18c9-47e2-9027-95f889a6812c req-3e966138-1180-4a3e-a503-71e8c19ea0b9 service nova] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Received event network-vif-unplugged-dff813d1-422b-4b69-b896-85274bba5dbb for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:06 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Instance destroyed successfully.
Aug 15 00:56:06 user nova-compute[73010]: DEBUG nova.objects.instance [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lazy-loading 'resources' on Instance uuid 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:51:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1141133609',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1141133609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1141133609',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5Sgf+0oqA9BkZpJlDCbh9WN/cg/l+p7Ht464qdJ/GcNNAlJ4pwa2r2zD/3Ymb7xJ466HhjMWVnhnsnTXcxXjgPOA2stIR+KTXJcOmdZhfQwQhOqml1XKZPg+aGV33AKg==',key_name='tempest-keypair-924938164',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:51:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f67d1031d3cb4c8fb66342a7888ca1c4',ramdisk_id='',reservation_id='r-ldkjw8l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1953358779',owner_user_name='tempest-TestVolumeBootPattern-1953358779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:51:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='daa4eb788f724a6fbf908b029315a02b',uuid=7eeadaaa-9d8b-44d2-a419-9bc5b595fc67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dff813d1-422b-4b69-b896-85274bba5dbb", "address": "fa:16:3e:54:5d:c5", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff813d1-42", "ovs_interfaceid": "dff813d1-422b-4b69-b896-85274bba5dbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converting VIF {"id": "dff813d1-422b-4b69-b896-85274bba5dbb", "address": "fa:16:3e:54:5d:c5", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff813d1-42", "ovs_interfaceid": "dff813d1-422b-4b69-b896-85274bba5dbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:5d:c5,bridge_name='br-int',has_traffic_filtering=True,id=dff813d1-422b-4b69-b896-85274bba5dbb,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff813d1-42') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG os_vif [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:5d:c5,bridge_name='br-int',has_traffic_filtering=True,id=dff813d1-422b-4b69-b896-85274bba5dbb,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff813d1-42') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdff813d1-42, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:56:06 user nova-compute[73010]: INFO os_vif [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:5d:c5,bridge_name='br-int',has_traffic_filtering=True,id=dff813d1-422b-4b69-b896-85274bba5dbb,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff813d1-42')
Aug 15 00:56:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FzYETeKg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:56:06 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:56:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f8b227-f428-40d9-9096-030f80f46964]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[997f4e64-b2a2-403b-aab0-0e3256b27e68]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:56:06 user nova-compute[73010]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 (non-flash)
Aug 15 00:56:06 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad (non-flash)
Aug 15 00:56:06 user nova-compute[73010]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 (non-flash)
Aug 15 00:56:06 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec50455000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad'): ({'sdb'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Removing single pathed devices sdb {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b0a03b-b780-4536-a2da-f74c630161ee]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8141e68d-1a3b-4e9d-a160-8862a7cb18d6]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Flushing IO for device /dev/sdb {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[42181adf-15ca-4b9c-9a1e-93cc933c96e9]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41274ef-26d1-4a0c-b9e5-72c42c85b865]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO38e8a502-601fcc519248d9f9', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_38e8a502', '/dev/disk/by-id/scsi-23630316663633531') {{(pid=84080) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[419c71ef-0b3f-4492-a646-6ef5a3fd8248]: (4, None) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ad301d-a012-4bd7-8412-63f8b9ca5199]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3664fcd5-add5-4a1b-a48d-40e1e7a088d2]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad, portal: 172.16.0.220,3260]
Aug 15 00:56:06 user nova-compute[73010]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad, portal: 172.16.0.220,3260] successful.
Aug 15 00:56:06 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92121257-8985-42dc-9f37-4e382c7953ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e07b6d-1a0c-4312-aa62-816aa891bc4a]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] <== disconnect_volume: return (331ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:56:06 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Deleting instance files /opt/stack/data/nova/instances/7eeadaaa-9d8b-44d2-a419-9bc5b595fc67_del
Aug 15 00:56:06 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Deletion of /opt/stack/data/nova/instances/7eeadaaa-9d8b-44d2-a419-9bc5b595fc67_del complete
Aug 15 00:56:06 user nova-compute[73010]: INFO nova.compute.manager [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Took 1.34 seconds to destroy the instance on the hypervisor.
Aug 15 00:56:06 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:56:06 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:56:07 user nova-compute[73010]: DEBUG nova.compute.manager [req-0b8a8e3f-14e3-429f-813a-fdec2f4d1a15 req-e5765ac7-5108-4442-a9d4-eea3077ec278 service nova] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Received event network-vif-plugged-dff813d1-422b-4b69-b896-85274bba5dbb {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:56:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0b8a8e3f-14e3-429f-813a-fdec2f4d1a15 req-e5765ac7-5108-4442-a9d4-eea3077ec278 service nova] Acquiring lock "7eeadaaa-9d8b-44d2-a419-9bc5b595fc67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:56:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0b8a8e3f-14e3-429f-813a-fdec2f4d1a15 req-e5765ac7-5108-4442-a9d4-eea3077ec278 service nova] Lock "7eeadaaa-9d8b-44d2-a419-9bc5b595fc67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:56:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0b8a8e3f-14e3-429f-813a-fdec2f4d1a15 req-e5765ac7-5108-4442-a9d4-eea3077ec278 service nova] Lock "7eeadaaa-9d8b-44d2-a419-9bc5b595fc67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:56:07 user nova-compute[73010]: DEBUG nova.compute.manager [req-0b8a8e3f-14e3-429f-813a-fdec2f4d1a15 req-e5765ac7-5108-4442-a9d4-eea3077ec278 service nova] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] No waiting events found dispatching network-vif-plugged-dff813d1-422b-4b69-b896-85274bba5dbb {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:56:07 user nova-compute[73010]: WARNING nova.compute.manager [req-0b8a8e3f-14e3-429f-813a-fdec2f4d1a15 req-e5765ac7-5108-4442-a9d4-eea3077ec278 service nova] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Received unexpected event network-vif-plugged-dff813d1-422b-4b69-b896-85274bba5dbb for instance with vm_state active and task_state deleting.
Aug 15 00:56:08 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:56:08 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Took 1.30 seconds to deallocate network for instance.
Aug 15 00:56:08 user nova-compute[73010]: DEBUG nova.compute.manager [req-2ce08144-f770-4f9e-a94e-56ba25d45dd8 req-0612a3d2-3539-4333-84fb-e2b90f1251fe service nova] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Received event network-vif-deleted-dff813d1-422b-4b69-b896-85274bba5dbb {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:56:08 user nova-compute[73010]: INFO nova.compute.manager [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Took 0.74 seconds to detach 1 volumes for instance.
Aug 15 00:56:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Deleting volume: 92121257-8985-42dc-9f37-4e382c7953ad {{(pid=73010) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 00:56:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:56:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:56:09 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:56:09 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:56:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:56:09 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Deleted allocations for instance 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67
Aug 15 00:56:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e5ab4e91-ca18-45b7-8e56-c9ef44efadaa tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "6dfc356b-953a-47b0-9da7-70cc59a80853" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:56:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e5ab4e91-ca18-45b7-8e56-c9ef44efadaa tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "6dfc356b-953a-47b0-9da7-70cc59a80853" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:56:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e5ab4e91-ca18-45b7-8e56-c9ef44efadaa tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "6dfc356b-953a-47b0-9da7-70cc59a80853-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:56:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e5ab4e91-ca18-45b7-8e56-c9ef44efadaa tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "6dfc356b-953a-47b0-9da7-70cc59a80853-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:56:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e5ab4e91-ca18-45b7-8e56-c9ef44efadaa tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "6dfc356b-953a-47b0-9da7-70cc59a80853-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:56:09 user nova-compute[73010]: INFO nova.compute.manager [None req-e5ab4e91-ca18-45b7-8e56-c9ef44efadaa tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Terminating instance
Aug 15 00:56:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-e5ab4e91-ca18-45b7-8e56-c9ef44efadaa tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:56:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-78fa6e05-469a-4518-bf35-7696d2c6f809 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "7eeadaaa-9d8b-44d2-a419-9bc5b595fc67" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.850s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:56:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:09 user nova-compute[73010]: DEBUG nova.compute.manager [req-930d6a24-3d6b-489a-abd2-630a99a9e939 req-6447738d-0b5a-4a32-9a5a-3c34c6750823 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Received event network-vif-unplugged-4ff59e78-ba56-4896-8f62-3cd1cc2465b4 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:56:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-930d6a24-3d6b-489a-abd2-630a99a9e939 req-6447738d-0b5a-4a32-9a5a-3c34c6750823 service nova] Acquiring lock "6dfc356b-953a-47b0-9da7-70cc59a80853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:56:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-930d6a24-3d6b-489a-abd2-630a99a9e939 req-6447738d-0b5a-4a32-9a5a-3c34c6750823 service nova] Lock "6dfc356b-953a-47b0-9da7-70cc59a80853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:56:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-930d6a24-3d6b-489a-abd2-630a99a9e939 req-6447738d-0b5a-4a32-9a5a-3c34c6750823 service nova] Lock "6dfc356b-953a-47b0-9da7-70cc59a80853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:56:09 user nova-compute[73010]: DEBUG nova.compute.manager [req-930d6a24-3d6b-489a-abd2-630a99a9e939 req-6447738d-0b5a-4a32-9a5a-3c34c6750823 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] No waiting events found dispatching network-vif-unplugged-4ff59e78-ba56-4896-8f62-3cd1cc2465b4 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:56:09 user nova-compute[73010]: DEBUG nova.compute.manager [req-930d6a24-3d6b-489a-abd2-630a99a9e939 req-6447738d-0b5a-4a32-9a5a-3c34c6750823 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Received event network-vif-unplugged-4ff59e78-ba56-4896-8f62-3cd1cc2465b4 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:56:09 user nova-compute[73010]: DEBUG nova.compute.manager [req-930d6a24-3d6b-489a-abd2-630a99a9e939 req-6447738d-0b5a-4a32-9a5a-3c34c6750823 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Received event network-vif-plugged-4ff59e78-ba56-4896-8f62-3cd1cc2465b4 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:56:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-930d6a24-3d6b-489a-abd2-630a99a9e939 req-6447738d-0b5a-4a32-9a5a-3c34c6750823 service nova] Acquiring lock "6dfc356b-953a-47b0-9da7-70cc59a80853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:56:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-930d6a24-3d6b-489a-abd2-630a99a9e939 req-6447738d-0b5a-4a32-9a5a-3c34c6750823 service nova] Lock "6dfc356b-953a-47b0-9da7-70cc59a80853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:56:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-930d6a24-3d6b-489a-abd2-630a99a9e939 req-6447738d-0b5a-4a32-9a5a-3c34c6750823 service nova] Lock "6dfc356b-953a-47b0-9da7-70cc59a80853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:56:09 user nova-compute[73010]: DEBUG nova.compute.manager [req-930d6a24-3d6b-489a-abd2-630a99a9e939 req-6447738d-0b5a-4a32-9a5a-3c34c6750823 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] No waiting events found dispatching network-vif-plugged-4ff59e78-ba56-4896-8f62-3cd1cc2465b4 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:56:09 user nova-compute[73010]: WARNING nova.compute.manager [req-930d6a24-3d6b-489a-abd2-630a99a9e939 req-6447738d-0b5a-4a32-9a5a-3c34c6750823 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Received unexpected event network-vif-plugged-4ff59e78-ba56-4896-8f62-3cd1cc2465b4 for instance with vm_state active and task_state deleting.
Aug 15 00:56:09 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Instance destroyed successfully.
Aug 15 00:56:09 user nova-compute[73010]: DEBUG nova.objects.instance [None req-e5ab4e91-ca18-45b7-8e56-c9ef44efadaa tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lazy-loading 'resources' on Instance uuid 6dfc356b-953a-47b0-9da7-70cc59a80853 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-e5ab4e91-ca18-45b7-8e56-c9ef44efadaa tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-560646446',display_name='tempest-ServerActionsTestOtherA-server-560646446',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-560646446',id=17,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqunjyZFkLpiNk80zhHJBMmI4Jlrza8ZHLYSe5RBsKwkkEoHKGeBKUwg/vA7wlV9hl0L81vzjguxDm4dKyFGA6ikNNXxOaicSODgz47pq/ht3X4FxrymmL8vELLfuQCog==',key_name='tempest-keypair-786587935',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:37:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13115a64ccc24df68bdfda1fc72399c4',ramdisk_id='',reservation_id='r-cep35jzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-671712537',owner_user_name='tempest-ServerActionsTestOtherA-671712537-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:37:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0e48e71bb404f26926ac7a8176e04bb',uuid=6dfc356b-953a-47b0-9da7-70cc59a80853,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "address": "fa:16:3e:63:99:69", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff59e78-ba", "ovs_interfaceid": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-e5ab4e91-ca18-45b7-8e56-c9ef44efadaa tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converting VIF {"id": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "address": "fa:16:3e:63:99:69", "network": {"id": "0110712f-b532-42a5-a6a2-d2f2b833e969", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-145498156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13115a64ccc24df68bdfda1fc72399c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff59e78-ba", "ovs_interfaceid": "4ff59e78-ba56-4896-8f62-3cd1cc2465b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-e5ab4e91-ca18-45b7-8e56-c9ef44efadaa tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:99:69,bridge_name='br-int',has_traffic_filtering=True,id=4ff59e78-ba56-4896-8f62-3cd1cc2465b4,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff59e78-ba') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG os_vif [None req-e5ab4e91-ca18-45b7-8e56-c9ef44efadaa tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:99:69,bridge_name='br-int',has_traffic_filtering=True,id=4ff59e78-ba56-4896-8f62-3cd1cc2465b4,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff59e78-ba') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ff59e78-ba, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:56:10 user nova-compute[73010]: INFO os_vif [None req-e5ab4e91-ca18-45b7-8e56-c9ef44efadaa tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:99:69,bridge_name='br-int',has_traffic_filtering=True,id=4ff59e78-ba56-4896-8f62-3cd1cc2465b4,network=Network(0110712f-b532-42a5-a6a2-d2f2b833e969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff59e78-ba')
Aug 15 00:56:10 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-e5ab4e91-ca18-45b7-8e56-c9ef44efadaa tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Deleting instance files /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853_del
Aug 15 00:56:10 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-e5ab4e91-ca18-45b7-8e56-c9ef44efadaa tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Deletion of /opt/stack/data/nova/instances/6dfc356b-953a-47b0-9da7-70cc59a80853_del complete
Aug 15 00:56:10 user nova-compute[73010]: INFO nova.compute.manager [None req-e5ab4e91-ca18-45b7-8e56-c9ef44efadaa tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 15 00:56:10 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-e5ab4e91-ca18-45b7-8e56-c9ef44efadaa tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Skipping network cache update for instance because it is being deleted. {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-eec545e8-eeda-443c-9892-980e19e7267a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-eec545e8-eeda-443c-9892-980e19e7267a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lazy-loading 'info_cache' on Instance uuid eec545e8-eeda-443c-9892-980e19e7267a {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:56:10 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Took 0.48 seconds to deallocate network for instance.
Aug 15 00:56:10 user nova-compute[73010]: DEBUG nova.compute.manager [req-6a2436eb-fda6-476a-8590-3578b4eecc68 req-65d87372-3304-4238-8447-60e6f7886e65 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Received event network-vif-deleted-4ff59e78-ba56-4896-8f62-3cd1cc2465b4 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:56:10 user nova-compute[73010]: INFO nova.compute.manager [req-6a2436eb-fda6-476a-8590-3578b4eecc68 req-65d87372-3304-4238-8447-60e6f7886e65 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Neutron deleted interface 4ff59e78-ba56-4896-8f62-3cd1cc2465b4; detaching it from the instance and deleting it from the info cache
Aug 15 00:56:10 user nova-compute[73010]: DEBUG nova.network.neutron [req-6a2436eb-fda6-476a-8590-3578b4eecc68 req-65d87372-3304-4238-8447-60e6f7886e65 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG nova.compute.manager [req-6a2436eb-fda6-476a-8590-3578b4eecc68 req-65d87372-3304-4238-8447-60e6f7886e65 service nova] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Detach interface failed, port_id=4ff59e78-ba56-4896-8f62-3cd1cc2465b4, reason: Instance 6dfc356b-953a-47b0-9da7-70cc59a80853 could not be found. {{(pid=73010) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e5ab4e91-ca18-45b7-8e56-c9ef44efadaa tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e5ab4e91-ca18-45b7-8e56-c9ef44efadaa tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-e5ab4e91-ca18-45b7-8e56-c9ef44efadaa tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-e5ab4e91-ca18-45b7-8e56-c9ef44efadaa tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e5ab4e91-ca18-45b7-8e56-c9ef44efadaa tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Updating instance_info_cache with network_info: [{"id": "65b5e7b6-01af-4239-9386-e7b14c83e766", "address": "fa:16:3e:88:de:ee", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b5e7b6-01", "ovs_interfaceid": "65b5e7b6-01af-4239-9386-e7b14c83e766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-eec545e8-eeda-443c-9892-980e19e7267a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 00:56:10 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:56:10 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-e5ab4e91-ca18-45b7-8e56-c9ef44efadaa tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Deleted allocations for instance 6dfc356b-953a-47b0-9da7-70cc59a80853
Aug 15 00:56:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e5ab4e91-ca18-45b7-8e56-c9ef44efadaa tempest-ServerActionsTestOtherA-671712537 tempest-ServerActionsTestOtherA-671712537-project-member] Lock "6dfc356b-953a-47b0-9da7-70cc59a80853" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.737s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:56:11 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:56:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-d1986a2e-3f7d-4294-96c8-626e02483c74 req-91e0ac26-d06a-460c-a598-c09c57977deb service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received event network-changed-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:56:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-d1986a2e-3f7d-4294-96c8-626e02483c74 req-91e0ac26-d06a-460c-a598-c09c57977deb service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Refreshing instance network info cache due to event network-changed-cefb1758-4282-491b-b86a-a7de5efd3cca. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:56:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d1986a2e-3f7d-4294-96c8-626e02483c74 req-91e0ac26-d06a-460c-a598-c09c57977deb service nova] Acquiring lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:56:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d1986a2e-3f7d-4294-96c8-626e02483c74 req-91e0ac26-d06a-460c-a598-c09c57977deb service nova] Acquired lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:56:11 user nova-compute[73010]: DEBUG nova.network.neutron [req-d1986a2e-3f7d-4294-96c8-626e02483c74 req-91e0ac26-d06a-460c-a598-c09c57977deb service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Refreshing network info cache for port cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:56:11 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:56:11 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:56:11 user nova-compute[73010]: DEBUG nova.network.neutron [req-d1986a2e-3f7d-4294-96c8-626e02483c74 req-91e0ac26-d06a-460c-a598-c09c57977deb service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Updated VIF entry in instance network info cache for port cefb1758-4282-491b-b86a-a7de5efd3cca. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:56:12 user nova-compute[73010]: DEBUG nova.network.neutron [req-d1986a2e-3f7d-4294-96c8-626e02483c74 req-91e0ac26-d06a-460c-a598-c09c57977deb service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Updating instance_info_cache with network_info: [{"id": "cefb1758-4282-491b-b86a-a7de5efd3cca", "address": "fa:16:3e:8b:f0:7a", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcefb1758-42", "ovs_interfaceid": "cefb1758-4282-491b-b86a-a7de5efd3cca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:56:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d1986a2e-3f7d-4294-96c8-626e02483c74 req-91e0ac26-d06a-460c-a598-c09c57977deb service nova] Releasing lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:56:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:12 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:56:12 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:56:13 user nova-compute[73010]: DEBUG nova.compute.manager [req-c43d54d4-f1ff-4f99-8dfd-d9bb08bed84e req-291eb286-dd29-4e58-bb8c-f52f770c53c0 service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received event network-changed-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:56:13 user nova-compute[73010]: DEBUG nova.compute.manager [req-c43d54d4-f1ff-4f99-8dfd-d9bb08bed84e req-291eb286-dd29-4e58-bb8c-f52f770c53c0 service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Refreshing instance network info cache due to event network-changed-cefb1758-4282-491b-b86a-a7de5efd3cca. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:56:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c43d54d4-f1ff-4f99-8dfd-d9bb08bed84e req-291eb286-dd29-4e58-bb8c-f52f770c53c0 service nova] Acquiring lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:56:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c43d54d4-f1ff-4f99-8dfd-d9bb08bed84e req-291eb286-dd29-4e58-bb8c-f52f770c53c0 service nova] Acquired lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:56:13 user nova-compute[73010]: DEBUG nova.network.neutron [req-c43d54d4-f1ff-4f99-8dfd-d9bb08bed84e req-291eb286-dd29-4e58-bb8c-f52f770c53c0 service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Refreshing network info cache for port cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:56:14 user nova-compute[73010]: DEBUG nova.network.neutron [req-c43d54d4-f1ff-4f99-8dfd-d9bb08bed84e req-291eb286-dd29-4e58-bb8c-f52f770c53c0 service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Updated VIF entry in instance network info cache for port cefb1758-4282-491b-b86a-a7de5efd3cca. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:56:14 user nova-compute[73010]: DEBUG nova.network.neutron [req-c43d54d4-f1ff-4f99-8dfd-d9bb08bed84e req-291eb286-dd29-4e58-bb8c-f52f770c53c0 service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Updating instance_info_cache with network_info: [{"id": "cefb1758-4282-491b-b86a-a7de5efd3cca", "address": "fa:16:3e:8b:f0:7a", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcefb1758-42", "ovs_interfaceid": "cefb1758-4282-491b-b86a-a7de5efd3cca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:56:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c43d54d4-f1ff-4f99-8dfd-d9bb08bed84e req-291eb286-dd29-4e58-bb8c-f52f770c53c0 service nova] Releasing lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:56:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:15 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:56:16 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:56:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "08a1c553-db53-4559-bac1-4e84ac05e2ab" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:56:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:56:19 user nova-compute[73010]: INFO nova.compute.manager [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Rebooting instance
Aug 15 00:56:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:56:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquired lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:56:19 user nova-compute[73010]: DEBUG nova.network.neutron [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:56:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:20 user nova-compute[73010]: DEBUG nova.network.neutron [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Updating instance_info_cache with network_info: [{"id": "cefb1758-4282-491b-b86a-a7de5efd3cca", "address": "fa:16:3e:8b:f0:7a", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcefb1758-42", "ovs_interfaceid": "cefb1758-4282-491b-b86a-a7de5efd3cca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:56:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Releasing lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:56:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:56:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG nova.compute.manager [req-b44bd16a-1cbe-408f-8052-d16c26276e60 req-3919b8d5-6437-438d-8975-401fde7ec9e1 service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received event network-vif-unplugged-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b44bd16a-1cbe-408f-8052-d16c26276e60 req-3919b8d5-6437-438d-8975-401fde7ec9e1 service nova] Acquiring lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b44bd16a-1cbe-408f-8052-d16c26276e60 req-3919b8d5-6437-438d-8975-401fde7ec9e1 service nova] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b44bd16a-1cbe-408f-8052-d16c26276e60 req-3919b8d5-6437-438d-8975-401fde7ec9e1 service nova] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG nova.compute.manager [req-b44bd16a-1cbe-408f-8052-d16c26276e60 req-3919b8d5-6437-438d-8975-401fde7ec9e1 service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] No waiting events found dispatching network-vif-unplugged-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:56:21 user nova-compute[73010]: WARNING nova.compute.manager [req-b44bd16a-1cbe-408f-8052-d16c26276e60 req-3919b8d5-6437-438d-8975-401fde7ec9e1 service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received unexpected event network-vif-unplugged-cefb1758-4282-491b-b86a-a7de5efd3cca for instance with vm_state active and task_state reboot_started_hard.
Aug 15 00:56:21 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060966.2753308, 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:56:21 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] VM Stopped (Lifecycle Event)
Aug 15 00:56:21 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c0e79385-e081-4cb9-891a-310236727cdb None None] [instance: 7eeadaaa-9d8b-44d2-a419-9bc5b595fc67] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:21 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Instance destroyed successfully.
Aug 15 00:56:21 user nova-compute[73010]: DEBUG nova.objects.instance [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lazy-loading 'resources' on Instance uuid 08a1c553-db53-4559-bac1-4e84ac05e2ab {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-755814511',display_name='tempest-TestMinimumBasicScenario-server-755814511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-755814511',id=41,image_ref='8ed9cf2f-f5d5-45f1-a0d9-87b8e168ef81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK72COEAmkJaS4ZoxaUBDOidQX264zJ9KoBQ1gaMrSk9Upn5O385tR1Ezk98nqb2IDrd6+Jtb3Gy7GorpLp76284Lqs1Se85dNWfEinFROG1uZw9ofBcEoskH2sMpUNiFg==',key_name='tempest-TestMinimumBasicScenario-1030082569',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:54:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3103787ed9304a92a5224610d2e8645a',ramdisk_id='',reservation_id='r-2hn5sxob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8ed9cf2f-f5d5-45f1-a0d9-87b8e168ef81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2145836143',owner_user_name='tempest-TestMinimumBasicScenario-2145836143-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:56:21Z,user_data=None,user_id='58496cb5284e45788eb645d0bff01dc8',uuid=08a1c553-db53-4559-bac1-4e84ac05e2ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cefb1758-4282-491b-b86a-a7de5efd3cca", "address": "fa:16:3e:8b:f0:7a", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcefb1758-42", "ovs_interfaceid": "cefb1758-4282-491b-b86a-a7de5efd3cca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Converting VIF {"id": "cefb1758-4282-491b-b86a-a7de5efd3cca", "address": "fa:16:3e:8b:f0:7a", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcefb1758-42", "ovs_interfaceid": "cefb1758-4282-491b-b86a-a7de5efd3cca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:f0:7a,bridge_name='br-int',has_traffic_filtering=True,id=cefb1758-4282-491b-b86a-a7de5efd3cca,network=Network(8aef7e84-aa84-4b82-beae-723c69281253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcefb1758-42') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG os_vif [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:f0:7a,bridge_name='br-int',has_traffic_filtering=True,id=cefb1758-4282-491b-b86a-a7de5efd3cca,network=Network(8aef7e84-aa84-4b82-beae-723c69281253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcefb1758-42') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcefb1758-42, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:56:21 user nova-compute[73010]: INFO os_vif [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:f0:7a,bridge_name='br-int',has_traffic_filtering=True,id=cefb1758-4282-491b-b86a-a7de5efd3cca,network=Network(8aef7e84-aa84-4b82-beae-723c69281253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcefb1758-42')
Aug 15 00:56:21 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcaoVkfv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:56:21 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:56:21 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d254ef-e5a9-4133-a5c6-80dbc36b1ce9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d8dab5-2c4f-43f8-b605-81c2e5a017dc]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 (non-flash)
Aug 15 00:56:21 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 (non-flash)
Aug 15 00:56:21 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec303c8430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6'): ({'sdc'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Removing single pathed devices sdc {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d947086-561c-4848-a8be-5c16222cf8b1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8eb01f9-dc36-4ea9-984a-0d2242a807c3]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Flushing IO for device /dev/sdc {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa43ff6-650e-4655-93a6-710f15671ada]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3b26b1-420c-4093-b6a6-188d00c98911]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] SCSI volumes sdc have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eebb0b0-50c2-4734-a178-b73ef637a3fc]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa36f15-3921-46fc-8b5e-4873faa79a97]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6, portal: 172.16.0.220,3260]
Aug 15 00:56:21 user nova-compute[73010]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6, portal: 172.16.0.220,3260] successful.
Aug 15 00:56:21 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2dbbd4-2793-4c5c-ba61-029d11013140]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] <== disconnect_volume: return (272ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Start _get_guest_xml network_info=[{"id": "cefb1758-4282-491b-b86a-a7de5efd3cca", "address": "fa:16:3e:8b:f0:7a", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcefb1758-42", "ovs_interfaceid": "cefb1758-4282-491b-b86a-a7de5efd3cca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8ed9cf2f-f5d5-45f1-a0d9-87b8e168ef81,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '8ed9cf2f-f5d5-45f1-a0d9-87b8e168ef81'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcaoVkfv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '08a1c553-db53-4559-bac1-4e84ac05e2ab', 'attached_at': '', 'detached_at': '', 'volume_id': '5695d185-a59c-4e3f-a2e0-a16b899772a6', 'serial': '5695d185-a59c-4e3f-a2e0-a16b899772a6'}, 'disk_bus': 'virtio', 'attachment_id': '163d74da-d8cf-4cd6-b51c-b227de530e91', 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:56:21 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:56:21 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:56:21 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:56:21 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8ed9cf2f-f5d5-45f1-a0d9-87b8e168ef81,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG nova.objects.instance [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lazy-loading 'vcpu_model' on Instance uuid 08a1c553-db53-4559-bac1-4e84ac05e2ab {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcaoVkfv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:56:22 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:56:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:56:22 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:56:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:56:22 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:56:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[09536346-b992-49e3-b22c-b4cf13b96a96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:56:22 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ff8ea1-9972-429b-aae9-1c4db1c0db0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6] added
Aug 15 00:56:22 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c2a124-7105-41e1-bf66-667f19b17365]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fed0a01-f6a1-4307-8744-5220263b2e52]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dcaoVkfv {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dcaoVkfv" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82d36b1-5855-4ddc-84d6-ed652acee151]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dcaoVkfv'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1b0528-21ff-4e04-9cbf-0df6bd1f7717]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[135cffb1-7392-48a1-a23c-7569f3af7cec]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 00:56:22 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 00:56:22 user nova-compute[73010]:  {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:56:22 user nova-compute[73010]: WARNING os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 00:56:22 user nova-compute[73010]: 
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b8f3ff-1c4a-46f5-9d18-f9d1a8cab5da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6, portal: 172.16.0.220,3260]
Aug 15 00:56:22 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6, portal: 172.16.0.220,3260] successful.
Aug 15 00:56:22 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a744ea-a87f-495d-8d3f-03b9ffc11245]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebb5494-02bb-4bbf-934e-18d72ca41051]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 (non-flash)
Aug 15 00:56:22 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 (non-flash)
Aug 15 00:56:22 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.032s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc37c9f3-ecae-470a-98e1-148535834055]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcaoVkfv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:56:22 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:56:23 user nova-compute[73010]: DEBUG nova.compute.manager [req-7096407b-4828-46d3-be4f-ce66a3724736 req-60b2717a-2a9c-4c53-9d60-a39106a7b861 service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received event network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:56:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7096407b-4828-46d3-be4f-ce66a3724736 req-60b2717a-2a9c-4c53-9d60-a39106a7b861 service nova] Acquiring lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:56:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7096407b-4828-46d3-be4f-ce66a3724736 req-60b2717a-2a9c-4c53-9d60-a39106a7b861 service nova] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:56:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7096407b-4828-46d3-be4f-ce66a3724736 req-60b2717a-2a9c-4c53-9d60-a39106a7b861 service nova] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:56:23 user nova-compute[73010]: DEBUG nova.compute.manager [req-7096407b-4828-46d3-be4f-ce66a3724736 req-60b2717a-2a9c-4c53-9d60-a39106a7b861 service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] No waiting events found dispatching network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:56:23 user nova-compute[73010]: WARNING nova.compute.manager [req-7096407b-4828-46d3-be4f-ce66a3724736 req-60b2717a-2a9c-4c53-9d60-a39106a7b861 service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received unexpected event network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca for instance with vm_state active and task_state reboot_started_hard.
Aug 15 00:56:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:56:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23864646534353464', 'path': '/dev/sdb'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:56:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864646534353464', 'path': '/dev/sdb'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:56:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-755814511',display_name='tempest-TestMinimumBasicScenario-server-755814511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-755814511',id=41,image_ref='8ed9cf2f-f5d5-45f1-a0d9-87b8e168ef81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK72COEAmkJaS4ZoxaUBDOidQX264zJ9KoBQ1gaMrSk9Upn5O385tR1Ezk98nqb2IDrd6+Jtb3Gy7GorpLp76284Lqs1Se85dNWfEinFROG1uZw9ofBcEoskH2sMpUNiFg==',key_name='tempest-TestMinimumBasicScenario-1030082569',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:54:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3103787ed9304a92a5224610d2e8645a',ramdisk_id='',reservation_id='r-2hn5sxob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8ed9cf2f-f5d5-45f1-a0d9-87b8e168ef81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2145836143',owner_user_name='tempest-TestMinimumBasicScenario-2145836143-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:56:21Z,user_data=None,user_id='58496cb5284e45788eb645d0bff01dc8',uuid=08a1c553-db53-4559-bac1-4e84ac05e2ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cefb1758-4282-491b-b86a-a7de5efd3cca", "address": "fa:16:3e:8b:f0:7a", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcefb1758-42", "ovs_interfaceid": "cefb1758-4282-491b-b86a-a7de5efd3cca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:56:23 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Converting VIF {"id": "cefb1758-4282-491b-b86a-a7de5efd3cca", "address": "fa:16:3e:8b:f0:7a", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcefb1758-42", "ovs_interfaceid": "cefb1758-4282-491b-b86a-a7de5efd3cca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:56:23 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:f0:7a,bridge_name='br-int',has_traffic_filtering=True,id=cefb1758-4282-491b-b86a-a7de5efd3cca,network=Network(8aef7e84-aa84-4b82-beae-723c69281253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcefb1758-42') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:56:23 user nova-compute[73010]: DEBUG nova.objects.instance [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lazy-loading 'pci_devices' on Instance uuid 08a1c553-db53-4559-bac1-4e84ac05e2ab {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:56:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:56:23 user nova-compute[73010]:   <uuid>08a1c553-db53-4559-bac1-4e84ac05e2ab</uuid>
Aug 15 00:56:23 user nova-compute[73010]:   <name>instance-00000029</name>
Aug 15 00:56:23 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:56:23 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:56:23 user nova-compute[73010]:   <metadata>
Aug 15 00:56:23 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:56:23 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:56:23 user nova-compute[73010]:       <nova:name>tempest-TestMinimumBasicScenario-server-755814511</nova:name>
Aug 15 00:56:23 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:56:21</nova:creationTime>
Aug 15 00:56:23 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:56:23 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:56:23 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:56:23 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:56:23 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:56:23 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:56:23 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:56:23 user nova-compute[73010]:       <nova:owner>
Aug 15 00:56:23 user nova-compute[73010]:         <nova:user uuid="58496cb5284e45788eb645d0bff01dc8">tempest-TestMinimumBasicScenario-2145836143-project-member</nova:user>
Aug 15 00:56:23 user nova-compute[73010]:         <nova:project uuid="3103787ed9304a92a5224610d2e8645a">tempest-TestMinimumBasicScenario-2145836143</nova:project>
Aug 15 00:56:23 user nova-compute[73010]:       </nova:owner>
Aug 15 00:56:23 user nova-compute[73010]:       <nova:root type="image" uuid="8ed9cf2f-f5d5-45f1-a0d9-87b8e168ef81"/>
Aug 15 00:56:23 user nova-compute[73010]:       <nova:ports>
Aug 15 00:56:23 user nova-compute[73010]:         <nova:port uuid="cefb1758-4282-491b-b86a-a7de5efd3cca">
Aug 15 00:56:23 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 00:56:23 user nova-compute[73010]:         </nova:port>
Aug 15 00:56:23 user nova-compute[73010]:       </nova:ports>
Aug 15 00:56:23 user nova-compute[73010]:     </nova:instance>
Aug 15 00:56:23 user nova-compute[73010]:   </metadata>
Aug 15 00:56:23 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:56:23 user nova-compute[73010]:     <system>
Aug 15 00:56:23 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:56:23 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:56:23 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:56:23 user nova-compute[73010]:       <entry name="serial">08a1c553-db53-4559-bac1-4e84ac05e2ab</entry>
Aug 15 00:56:23 user nova-compute[73010]:       <entry name="uuid">08a1c553-db53-4559-bac1-4e84ac05e2ab</entry>
Aug 15 00:56:23 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:56:23 user nova-compute[73010]:     </system>
Aug 15 00:56:23 user nova-compute[73010]:   </sysinfo>
Aug 15 00:56:23 user nova-compute[73010]:   <os>
Aug 15 00:56:23 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:56:23 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:56:23 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:56:23 user nova-compute[73010]:   </os>
Aug 15 00:56:23 user nova-compute[73010]:   <features>
Aug 15 00:56:23 user nova-compute[73010]:     <acpi/>
Aug 15 00:56:23 user nova-compute[73010]:     <apic/>
Aug 15 00:56:23 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:56:23 user nova-compute[73010]:   </features>
Aug 15 00:56:23 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:56:23 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:56:23 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:56:23 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:56:23 user nova-compute[73010]:   </clock>
Aug 15 00:56:23 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:56:23 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:56:23 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:56:23 user nova-compute[73010]:   </cpu>
Aug 15 00:56:23 user nova-compute[73010]:   <devices>
Aug 15 00:56:23 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:56:23 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:56:23 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk"/>
Aug 15 00:56:23 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:56:23 user nova-compute[73010]:     </disk>
Aug 15 00:56:23 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 00:56:23 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:56:23 user nova-compute[73010]:       <source dev="/dev/sdb"/>
Aug 15 00:56:23 user nova-compute[73010]:       <target dev="vdb" bus="virtio"/>
Aug 15 00:56:23 user nova-compute[73010]:       <serial>5695d185-a59c-4e3f-a2e0-a16b899772a6</serial>
Aug 15 00:56:23 user nova-compute[73010]:     </disk>
Aug 15 00:56:23 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:56:23 user nova-compute[73010]:       <mac address="fa:16:3e:8b:f0:7a"/>
Aug 15 00:56:23 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:56:23 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:56:23 user nova-compute[73010]:       <target dev="tapcefb1758-42"/>
Aug 15 00:56:23 user nova-compute[73010]:     </interface>
Aug 15 00:56:23 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:56:23 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/console.log" append="off"/>
Aug 15 00:56:23 user nova-compute[73010]:     </serial>
Aug 15 00:56:23 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:56:23 user nova-compute[73010]:     <video>
Aug 15 00:56:23 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:56:23 user nova-compute[73010]:     </video>
Aug 15 00:56:23 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:56:23 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:56:23 user nova-compute[73010]:     </rng>
Aug 15 00:56:23 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:56:23 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:56:23 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:56:23 user nova-compute[73010]:     </memballoon>
Aug 15 00:56:23 user nova-compute[73010]:   </devices>
Aug 15 00:56:23 user nova-compute[73010]: </domain>
Aug 15 00:56:23 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:56:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:56:23 user nova-compute[73010]: DEBUG nova.objects.instance [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lazy-loading 'trusted_certs' on Instance uuid 08a1c553-db53-4559-bac1-4e84ac05e2ab {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:56:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836 --force-share --output=json" returned: 0 in 0.171s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:24 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:56:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:24 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Cannot resize image /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:56:24 user nova-compute[73010]: DEBUG nova.objects.instance [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lazy-loading 'migration_context' on Instance uuid 08a1c553-db53-4559-bac1-4e84ac05e2ab {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:56:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-755814511',display_name='tempest-TestMinimumBasicScenario-server-755814511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-755814511',id=41,image_ref='8ed9cf2f-f5d5-45f1-a0d9-87b8e168ef81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK72COEAmkJaS4ZoxaUBDOidQX264zJ9KoBQ1gaMrSk9Upn5O385tR1Ezk98nqb2IDrd6+Jtb3Gy7GorpLp76284Lqs1Se85dNWfEinFROG1uZw9ofBcEoskH2sMpUNiFg==',key_name='tempest-TestMinimumBasicScenario-1030082569',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:54:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='3103787ed9304a92a5224610d2e8645a',ramdisk_id='',reservation_id='r-2hn5sxob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8ed9cf2f-f5d5-45f1-a0d9-87b8e168ef81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2145836143',owner_user_name='tempest-TestMinimumBasicScenario-2145836143-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:56:21Z,user_data=None,user_id='58496cb5284e45788eb645d0bff01dc8',uuid=08a1c553-db53-4559-bac1-4e84ac05e2ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cefb1758-4282-491b-b86a-a7de5efd3cca", "address": "fa:16:3e:8b:f0:7a", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcefb1758-42", "ovs_interfaceid": "cefb1758-4282-491b-b86a-a7de5efd3cca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:56:24 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Converting VIF {"id": "cefb1758-4282-491b-b86a-a7de5efd3cca", "address": "fa:16:3e:8b:f0:7a", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcefb1758-42", "ovs_interfaceid": "cefb1758-4282-491b-b86a-a7de5efd3cca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:56:24 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:f0:7a,bridge_name='br-int',has_traffic_filtering=True,id=cefb1758-4282-491b-b86a-a7de5efd3cca,network=Network(8aef7e84-aa84-4b82-beae-723c69281253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcefb1758-42') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:56:24 user nova-compute[73010]: DEBUG os_vif [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:f0:7a,bridge_name='br-int',has_traffic_filtering=True,id=cefb1758-4282-491b-b86a-a7de5efd3cca,network=Network(8aef7e84-aa84-4b82-beae-723c69281253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcefb1758-42') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:56:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:56:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:56:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcefb1758-42, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:56:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcefb1758-42, col_values=(('external_ids', {'iface-id': 'cefb1758-4282-491b-b86a-a7de5efd3cca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:f0:7a', 'vm-uuid': '08a1c553-db53-4559-bac1-4e84ac05e2ab'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:56:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:56:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:24 user nova-compute[73010]: INFO os_vif [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:f0:7a,bridge_name='br-int',has_traffic_filtering=True,id=cefb1758-4282-491b-b86a-a7de5efd3cca,network=Network(8aef7e84-aa84-4b82-beae-723c69281253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcefb1758-42')
Aug 15 00:56:24 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060969.9822173, 6dfc356b-953a-47b0-9da7-70cc59a80853 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:56:24 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] VM Stopped (Lifecycle Event)
Aug 15 00:56:25 user nova-compute[73010]: DEBUG nova.compute.manager [None req-40895d52-e6ab-424b-b16a-de12701b98ff None None] [instance: 6dfc356b-953a-47b0-9da7-70cc59a80853] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:56:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-95663dc5-a5e7-4299-a0f7-cb387fde68a9 req-2c26b3d7-727b-4f60-9362-66c0a892ae0b service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received event network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:56:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-95663dc5-a5e7-4299-a0f7-cb387fde68a9 req-2c26b3d7-727b-4f60-9362-66c0a892ae0b service nova] Acquiring lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:56:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-95663dc5-a5e7-4299-a0f7-cb387fde68a9 req-2c26b3d7-727b-4f60-9362-66c0a892ae0b service nova] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:56:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-95663dc5-a5e7-4299-a0f7-cb387fde68a9 req-2c26b3d7-727b-4f60-9362-66c0a892ae0b service nova] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:56:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-95663dc5-a5e7-4299-a0f7-cb387fde68a9 req-2c26b3d7-727b-4f60-9362-66c0a892ae0b service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] No waiting events found dispatching network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:56:25 user nova-compute[73010]: WARNING nova.compute.manager [req-95663dc5-a5e7-4299-a0f7-cb387fde68a9 req-2c26b3d7-727b-4f60-9362-66c0a892ae0b service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received unexpected event network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca for instance with vm_state active and task_state reboot_started_hard.
Aug 15 00:56:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Removed pending event for 08a1c553-db53-4559-bac1-4e84ac05e2ab due to event {{(pid=73010) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 00:56:27 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060987.8234777, 08a1c553-db53-4559-bac1-4e84ac05e2ab => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:56:27 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] VM Resumed (Lifecycle Event)
Aug 15 00:56:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:56:27 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Instance rebooted successfully.
Aug 15 00:56:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:56:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:56:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:56:27 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 15 00:56:27 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692060987.8254416, 08a1c553-db53-4559-bac1-4e84ac05e2ab => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:56:27 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] VM Started (Lifecycle Event)
Aug 15 00:56:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:56:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:56:27 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 15 00:56:27 user nova-compute[73010]: DEBUG nova.compute.manager [req-92c13a02-142f-4275-b73c-5ad191e9a0f5 req-cc2eee49-60b4-4236-bda8-2770ccc631ee service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received event network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:56:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-92c13a02-142f-4275-b73c-5ad191e9a0f5 req-cc2eee49-60b4-4236-bda8-2770ccc631ee service nova] Acquiring lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:56:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-92c13a02-142f-4275-b73c-5ad191e9a0f5 req-cc2eee49-60b4-4236-bda8-2770ccc631ee service nova] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:56:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-92c13a02-142f-4275-b73c-5ad191e9a0f5 req-cc2eee49-60b4-4236-bda8-2770ccc631ee service nova] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:56:27 user nova-compute[73010]: DEBUG nova.compute.manager [req-92c13a02-142f-4275-b73c-5ad191e9a0f5 req-cc2eee49-60b4-4236-bda8-2770ccc631ee service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] No waiting events found dispatching network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:56:27 user nova-compute[73010]: WARNING nova.compute.manager [req-92c13a02-142f-4275-b73c-5ad191e9a0f5 req-cc2eee49-60b4-4236-bda8-2770ccc631ee service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received unexpected event network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca for instance with vm_state active and task_state None.
Aug 15 00:56:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-2f5c4f0d-997e-4705-891d-cfc4bda4e4dc tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.135s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:56:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-745e4b2d-eb7a-405b-afc0-d7f1d62d8810 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "4b489f97-c8d4-4a6a-8404-e1a05a990261" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:56:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-745e4b2d-eb7a-405b-afc0-d7f1d62d8810 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "4b489f97-c8d4-4a6a-8404-e1a05a990261" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:56:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-745e4b2d-eb7a-405b-afc0-d7f1d62d8810 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:56:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-745e4b2d-eb7a-405b-afc0-d7f1d62d8810 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:56:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-745e4b2d-eb7a-405b-afc0-d7f1d62d8810 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:56:33 user nova-compute[73010]: INFO nova.compute.manager [None req-745e4b2d-eb7a-405b-afc0-d7f1d62d8810 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Terminating instance
Aug 15 00:56:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-745e4b2d-eb7a-405b-afc0-d7f1d62d8810 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:56:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:34 user nova-compute[73010]: DEBUG nova.compute.manager [req-dcb05f71-11f8-46b5-a7f2-cae8f8928404 req-1c6377d6-5bed-4557-b150-756abbf421ce service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Received event network-vif-unplugged-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:56:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dcb05f71-11f8-46b5-a7f2-cae8f8928404 req-1c6377d6-5bed-4557-b150-756abbf421ce service nova] Acquiring lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:56:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dcb05f71-11f8-46b5-a7f2-cae8f8928404 req-1c6377d6-5bed-4557-b150-756abbf421ce service nova] Lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:56:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dcb05f71-11f8-46b5-a7f2-cae8f8928404 req-1c6377d6-5bed-4557-b150-756abbf421ce service nova] Lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:56:34 user nova-compute[73010]: DEBUG nova.compute.manager [req-dcb05f71-11f8-46b5-a7f2-cae8f8928404 req-1c6377d6-5bed-4557-b150-756abbf421ce service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] No waiting events found dispatching network-vif-unplugged-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:56:34 user nova-compute[73010]: DEBUG nova.compute.manager [req-dcb05f71-11f8-46b5-a7f2-cae8f8928404 req-1c6377d6-5bed-4557-b150-756abbf421ce service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Received event network-vif-unplugged-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:56:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:34 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Instance destroyed successfully.
Aug 15 00:56:34 user nova-compute[73010]: DEBUG nova.objects.instance [None req-745e4b2d-eb7a-405b-afc0-d7f1d62d8810 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'resources' on Instance uuid 4b489f97-c8d4-4a6a-8404-e1a05a990261 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:56:34 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-745e4b2d-eb7a-405b-afc0-d7f1d62d8810 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:40:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-871958020',display_name='tempest-ServerRescueNegativeTestJSON-server-871958020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-871958020',id=24,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:42:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a564ea15194c4e059746d2fc6e7e1a07',ramdisk_id='',reservation_id='r-7qe9mv1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-203744558',owner_user_name='tempest-ServerRescueNegativeTestJSON-203744558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:42:10Z,user_data=None,user_id='b85ef05658d64f1fbd78e509e2a606d8',uuid=4b489f97-c8d4-4a6a-8404-e1a05a990261,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "address": "fa:16:3e:31:6a:22", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da1cffd-22", "ovs_interfaceid": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:56:34 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-745e4b2d-eb7a-405b-afc0-d7f1d62d8810 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Converting VIF {"id": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "address": "fa:16:3e:31:6a:22", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da1cffd-22", "ovs_interfaceid": "6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:56:34 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-745e4b2d-eb7a-405b-afc0-d7f1d62d8810 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:6a:22,bridge_name='br-int',has_traffic_filtering=True,id=6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa,network=Network(f4772ea6-9cb0-4ca8-b327-34f8dd08808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6da1cffd-22') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:56:34 user nova-compute[73010]: DEBUG os_vif [None req-745e4b2d-eb7a-405b-afc0-d7f1d62d8810 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:6a:22,bridge_name='br-int',has_traffic_filtering=True,id=6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa,network=Network(f4772ea6-9cb0-4ca8-b327-34f8dd08808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6da1cffd-22') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:56:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6da1cffd-22, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:56:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:56:34 user nova-compute[73010]: INFO os_vif [None req-745e4b2d-eb7a-405b-afc0-d7f1d62d8810 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:6a:22,bridge_name='br-int',has_traffic_filtering=True,id=6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa,network=Network(f4772ea6-9cb0-4ca8-b327-34f8dd08808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6da1cffd-22')
Aug 15 00:56:34 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-745e4b2d-eb7a-405b-afc0-d7f1d62d8810 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Deleting instance files /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261_del
Aug 15 00:56:34 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-745e4b2d-eb7a-405b-afc0-d7f1d62d8810 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Deletion of /opt/stack/data/nova/instances/4b489f97-c8d4-4a6a-8404-e1a05a990261_del complete
Aug 15 00:56:34 user nova-compute[73010]: INFO nova.compute.manager [None req-745e4b2d-eb7a-405b-afc0-d7f1d62d8810 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 15 00:56:34 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-745e4b2d-eb7a-405b-afc0-d7f1d62d8810 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:56:34 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:56:34 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:56:35 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:56:35 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Took 0.67 seconds to deallocate network for instance.
Aug 15 00:56:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-745e4b2d-eb7a-405b-afc0-d7f1d62d8810 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:56:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-745e4b2d-eb7a-405b-afc0-d7f1d62d8810 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:56:35 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-745e4b2d-eb7a-405b-afc0-d7f1d62d8810 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:56:35 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-745e4b2d-eb7a-405b-afc0-d7f1d62d8810 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:56:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-745e4b2d-eb7a-405b-afc0-d7f1d62d8810 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:56:35 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-745e4b2d-eb7a-405b-afc0-d7f1d62d8810 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Deleted allocations for instance 4b489f97-c8d4-4a6a-8404-e1a05a990261
Aug 15 00:56:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-745e4b2d-eb7a-405b-afc0-d7f1d62d8810 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "4b489f97-c8d4-4a6a-8404-e1a05a990261" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.959s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:56:36 user nova-compute[73010]: DEBUG nova.compute.manager [req-33284ac6-810d-4da3-bc24-513b1e73ca7a req-795e39bf-f47c-48a0-a83d-ad4254e25aa1 service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Received event network-vif-plugged-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:56:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-33284ac6-810d-4da3-bc24-513b1e73ca7a req-795e39bf-f47c-48a0-a83d-ad4254e25aa1 service nova] Acquiring lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:56:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-33284ac6-810d-4da3-bc24-513b1e73ca7a req-795e39bf-f47c-48a0-a83d-ad4254e25aa1 service nova] Lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:56:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-33284ac6-810d-4da3-bc24-513b1e73ca7a req-795e39bf-f47c-48a0-a83d-ad4254e25aa1 service nova] Lock "4b489f97-c8d4-4a6a-8404-e1a05a990261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:56:36 user nova-compute[73010]: DEBUG nova.compute.manager [req-33284ac6-810d-4da3-bc24-513b1e73ca7a req-795e39bf-f47c-48a0-a83d-ad4254e25aa1 service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] No waiting events found dispatching network-vif-plugged-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:56:36 user nova-compute[73010]: WARNING nova.compute.manager [req-33284ac6-810d-4da3-bc24-513b1e73ca7a req-795e39bf-f47c-48a0-a83d-ad4254e25aa1 service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Received unexpected event network-vif-plugged-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa for instance with vm_state deleted and task_state None.
Aug 15 00:56:36 user nova-compute[73010]: DEBUG nova.compute.manager [req-33284ac6-810d-4da3-bc24-513b1e73ca7a req-795e39bf-f47c-48a0-a83d-ad4254e25aa1 service nova] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Received event network-vif-deleted-6da1cffd-224f-4dc5-8cb4-dee7c4c6e6aa {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:56:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:49 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692060994.7079358, 4b489f97-c8d4-4a6a-8404-e1a05a990261 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:56:49 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] VM Stopped (Lifecycle Event)
Aug 15 00:56:49 user nova-compute[73010]: DEBUG nova.compute.manager [None req-3e559b4a-7acc-4f9f-ac4e-164904930e7a None None] [instance: 4b489f97-c8d4-4a6a-8404-e1a05a990261] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:56:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:58 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:56:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:56:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:56:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:56:58 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:56:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:56:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:56:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:56:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:56:59 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:56:59 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:56:59 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8496MB free_disk=25.568092346191406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:56:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:56:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:56:59 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance eec545e8-eeda-443c-9892-980e19e7267a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:56:59 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 08a1c553-db53-4559-bac1-4e84ac05e2ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:56:59 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:56:59 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:56:59 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:57:00 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:57:00 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:57:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:57:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "5eed2924-cb4a-453b-b90c-07f1e4603637" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:57:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "5eed2924-cb4a-453b-b90c-07f1e4603637" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:57:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:57:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:57:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:57:10 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:57:10 user nova-compute[73010]: INFO nova.compute.claims [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Claim successful on node user
Aug 15 00:57:10 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:57:10 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:57:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:57:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:57:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:57:10 user nova-compute[73010]: DEBUG nova.network.neutron [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:57:10 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:57:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:57:10 user nova-compute[73010]: INFO nova.virt.block_device [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Booting with volume 048aabec-0774-43ba-b0e0-68effb43d98f at /dev/vda
Aug 15 00:57:10 user nova-compute[73010]: DEBUG os_brick.utils [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:57:10 user nova-compute[73010]: DEBUG nova.policy [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'daa4eb788f724a6fbf908b029315a02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67d1031d3cb4c8fb66342a7888ca1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:57:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:57:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c79019b-793d-429a-96a5-329a7be8b6ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:57:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:57:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67b7fe7-5ad7-45ed-89a6-ac25eea9c6c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:57:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:57:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de93a34-92f4-4773-afa5-a3711add1915]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:57:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd57453-b9fe-41d1-9b52-8dc0a853500a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:57:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:57:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:57:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:11 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:57:11 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:57:11 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:57:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:57:11 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:57:11 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0b0884-1882-4d86-a07f-80abec4152af]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:57:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:57:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:57:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:57:11 user nova-compute[73010]: DEBUG os_brick.utils [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:57:11 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Updating existing volume attachment record: 4388225c-ed82-4d3b-ae18-44b1caba8425 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:57:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:57:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:57:11 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 00:57:11 user nova-compute[73010]: DEBUG nova.network.neutron [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Successfully created port: 0b98ada0-5b93-4278-b257-bbaa11248c9c {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:57:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:12 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Updating instance_info_cache with network_info: [{"id": "cefb1758-4282-491b-b86a-a7de5efd3cca", "address": "fa:16:3e:8b:f0:7a", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcefb1758-42", "ovs_interfaceid": "cefb1758-4282-491b-b86a-a7de5efd3cca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:57:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:57:12 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 00:57:12 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:57:12 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:57:12 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:57:12 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:57:12 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:57:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:13 user nova-compute[73010]: DEBUG nova.network.neutron [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Successfully updated port: 0b98ada0-5b93-4278-b257-bbaa11248c9c {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:57:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "refresh_cache-5eed2924-cb4a-453b-b90c-07f1e4603637" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:57:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquired lock "refresh_cache-5eed2924-cb4a-453b-b90c-07f1e4603637" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:57:13 user nova-compute[73010]: DEBUG nova.network.neutron [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:57:13 user nova-compute[73010]: DEBUG nova.compute.manager [req-dd0b8c99-267d-4359-9b71-0e4174b10792 req-f8f87e17-84c0-45b7-b6b0-fbe5604efb3f service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Received event network-changed-0b98ada0-5b93-4278-b257-bbaa11248c9c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:57:13 user nova-compute[73010]: DEBUG nova.compute.manager [req-dd0b8c99-267d-4359-9b71-0e4174b10792 req-f8f87e17-84c0-45b7-b6b0-fbe5604efb3f service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Refreshing instance network info cache due to event network-changed-0b98ada0-5b93-4278-b257-bbaa11248c9c. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:57:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dd0b8c99-267d-4359-9b71-0e4174b10792 req-f8f87e17-84c0-45b7-b6b0-fbe5604efb3f service nova] Acquiring lock "refresh_cache-5eed2924-cb4a-453b-b90c-07f1e4603637" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:57:13 user nova-compute[73010]: DEBUG nova.network.neutron [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:57:13 user nova-compute[73010]: DEBUG nova.network.neutron [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Updating instance_info_cache with network_info: [{"id": "0b98ada0-5b93-4278-b257-bbaa11248c9c", "address": "fa:16:3e:76:8a:ae", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b98ada0-5b", "ovs_interfaceid": "0b98ada0-5b93-4278-b257-bbaa11248c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:57:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Releasing lock "refresh_cache-5eed2924-cb4a-453b-b90c-07f1e4603637" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:57:13 user nova-compute[73010]: DEBUG nova.compute.manager [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Instance network_info: |[{"id": "0b98ada0-5b93-4278-b257-bbaa11248c9c", "address": "fa:16:3e:76:8a:ae", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b98ada0-5b", "ovs_interfaceid": "0b98ada0-5b93-4278-b257-bbaa11248c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:57:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dd0b8c99-267d-4359-9b71-0e4174b10792 req-f8f87e17-84c0-45b7-b6b0-fbe5604efb3f service nova] Acquired lock "refresh_cache-5eed2924-cb4a-453b-b90c-07f1e4603637" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:57:13 user nova-compute[73010]: DEBUG nova.network.neutron [req-dd0b8c99-267d-4359-9b71-0e4174b10792 req-f8f87e17-84c0-45b7-b6b0-fbe5604efb3f service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Refreshing network info cache for port 0b98ada0-5b93-4278-b257-bbaa11248c9c {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:57:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "d79e3854-769c-430a-b980-3a551c7ee34d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:57:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "d79e3854-769c-430a-b980-3a551c7ee34d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:57:14 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:57:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:57:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:57:14 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:57:14 user nova-compute[73010]: INFO nova.compute.claims [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Claim successful on node user
Aug 15 00:57:14 user nova-compute[73010]: DEBUG nova.network.neutron [req-dd0b8c99-267d-4359-9b71-0e4174b10792 req-f8f87e17-84c0-45b7-b6b0-fbe5604efb3f service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Updated VIF entry in instance network info cache for port 0b98ada0-5b93-4278-b257-bbaa11248c9c. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:57:14 user nova-compute[73010]: DEBUG nova.network.neutron [req-dd0b8c99-267d-4359-9b71-0e4174b10792 req-f8f87e17-84c0-45b7-b6b0-fbe5604efb3f service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Updating instance_info_cache with network_info: [{"id": "0b98ada0-5b93-4278-b257-bbaa11248c9c", "address": "fa:16:3e:76:8a:ae", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b98ada0-5b", "ovs_interfaceid": "0b98ada0-5b93-4278-b257-bbaa11248c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:57:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dd0b8c99-267d-4359-9b71-0e4174b10792 req-f8f87e17-84c0-45b7-b6b0-fbe5604efb3f service nova] Releasing lock "refresh_cache-5eed2924-cb4a-453b-b90c-07f1e4603637" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:57:14 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:57:14 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:57:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.283s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:57:14 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:57:14 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:57:14 user nova-compute[73010]: DEBUG nova.network.neutron [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:57:14 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:57:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:14 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:57:14 user nova-compute[73010]: DEBUG nova.policy [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e1e98c9bae145f0909011bb46c6e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6db1cb9145b49999d0f102f8cfb867a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:57:14 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:57:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:57:14 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Creating image(s)
Aug 15 00:57:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "/opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:57:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "/opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:57:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "/opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:57:14 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.190s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:57:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:57:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:57:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.199s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:57:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk 1073741824" returned: 0 in 0.060s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:57:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:57:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:15 user nova-compute[73010]: DEBUG nova.network.neutron [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Successfully created port: fb1f2867-31f1-4c71-94a6-f4682f62d16c {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:57:15 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:57:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.187s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:57:15 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:57:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:57:15 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Cannot resize image /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:57:15 user nova-compute[73010]: DEBUG nova.objects.instance [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lazy-loading 'migration_context' on Instance uuid d79e3854-769c-430a-b980-3a551c7ee34d {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:57:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:57:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Ensure instance console log exists: /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:57:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:57:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:57:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.network.neutron [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Successfully updated port: fb1f2867-31f1-4c71-94a6-f4682f62d16c {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "refresh_cache-d79e3854-769c-430a-b980-3a551c7ee34d" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquired lock "refresh_cache-d79e3854-769c-430a-b980-3a551c7ee34d" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.network.neutron [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.compute.manager [req-6e6a6995-416e-4c87-a2d7-22ceaa1947dd req-42d016d4-445a-49ab-9f6b-91925c70ada7 service nova] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Received event network-changed-fb1f2867-31f1-4c71-94a6-f4682f62d16c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.compute.manager [req-6e6a6995-416e-4c87-a2d7-22ceaa1947dd req-42d016d4-445a-49ab-9f6b-91925c70ada7 service nova] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Refreshing instance network info cache due to event network-changed-fb1f2867-31f1-4c71-94a6-f4682f62d16c. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6e6a6995-416e-4c87-a2d7-22ceaa1947dd req-42d016d4-445a-49ab-9f6b-91925c70ada7 service nova] Acquiring lock "refresh_cache-d79e3854-769c-430a-b980-3a551c7ee34d" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.network.neutron [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.network.neutron [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Updating instance_info_cache with network_info: [{"id": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "address": "fa:16:3e:07:08:aa", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1f2867-31", "ovs_interfaceid": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Releasing lock "refresh_cache-d79e3854-769c-430a-b980-3a551c7ee34d" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Instance network_info: |[{"id": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "address": "fa:16:3e:07:08:aa", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1f2867-31", "ovs_interfaceid": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6e6a6995-416e-4c87-a2d7-22ceaa1947dd req-42d016d4-445a-49ab-9f6b-91925c70ada7 service nova] Acquired lock "refresh_cache-d79e3854-769c-430a-b980-3a551c7ee34d" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.network.neutron [req-6e6a6995-416e-4c87-a2d7-22ceaa1947dd req-42d016d4-445a-49ab-9f6b-91925c70ada7 service nova] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Refreshing network info cache for port fb1f2867-31f1-4c71-94a6-f4682f62d16c {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Start _get_guest_xml network_info=[{"id": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "address": "fa:16:3e:07:08:aa", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1f2867-31", "ovs_interfaceid": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:57:16 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:57:16 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1542157265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1542157265',id=43,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6db1cb9145b49999d0f102f8cfb867a',ramdisk_id='',reservation_id='r-7y51m5mf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:57:15Z,user_data=None,user_id='8e1e98c9bae145f0909011bb46c6e104',uuid=d79e3854-769c-430a-b980-3a551c7ee34d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "address": "fa:16:3e:07:08:aa", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1f2867-31", "ovs_interfaceid": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converting VIF {"id": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "address": "fa:16:3e:07:08:aa", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1f2867-31", "ovs_interfaceid": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:08:aa,bridge_name='br-int',has_traffic_filtering=True,id=fb1f2867-31f1-4c71-94a6-f4682f62d16c,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1f2867-31') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.objects.instance [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lazy-loading 'pci_devices' on Instance uuid d79e3854-769c-430a-b980-3a551c7ee34d {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:57:16 user nova-compute[73010]:   <uuid>d79e3854-769c-430a-b980-3a551c7ee34d</uuid>
Aug 15 00:57:16 user nova-compute[73010]:   <name>instance-0000002b</name>
Aug 15 00:57:16 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:57:16 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:57:16 user nova-compute[73010]:   <metadata>
Aug 15 00:57:16 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:57:16 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:57:16 user nova-compute[73010]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1542157265</nova:name>
Aug 15 00:57:16 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:57:16</nova:creationTime>
Aug 15 00:57:16 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:57:16 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:57:16 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:57:16 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:57:16 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:57:16 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:57:16 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:57:16 user nova-compute[73010]:       <nova:owner>
Aug 15 00:57:16 user nova-compute[73010]:         <nova:user uuid="8e1e98c9bae145f0909011bb46c6e104">tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member</nova:user>
Aug 15 00:57:16 user nova-compute[73010]:         <nova:project uuid="f6db1cb9145b49999d0f102f8cfb867a">tempest-ServerBootFromVolumeStableRescueTest-1758225981</nova:project>
Aug 15 00:57:16 user nova-compute[73010]:       </nova:owner>
Aug 15 00:57:16 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:57:16 user nova-compute[73010]:       <nova:ports>
Aug 15 00:57:16 user nova-compute[73010]:         <nova:port uuid="fb1f2867-31f1-4c71-94a6-f4682f62d16c">
Aug 15 00:57:16 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 00:57:16 user nova-compute[73010]:         </nova:port>
Aug 15 00:57:16 user nova-compute[73010]:       </nova:ports>
Aug 15 00:57:16 user nova-compute[73010]:     </nova:instance>
Aug 15 00:57:16 user nova-compute[73010]:   </metadata>
Aug 15 00:57:16 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:57:16 user nova-compute[73010]:     <system>
Aug 15 00:57:16 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:57:16 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:57:16 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:57:16 user nova-compute[73010]:       <entry name="serial">d79e3854-769c-430a-b980-3a551c7ee34d</entry>
Aug 15 00:57:16 user nova-compute[73010]:       <entry name="uuid">d79e3854-769c-430a-b980-3a551c7ee34d</entry>
Aug 15 00:57:16 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:57:16 user nova-compute[73010]:     </system>
Aug 15 00:57:16 user nova-compute[73010]:   </sysinfo>
Aug 15 00:57:16 user nova-compute[73010]:   <os>
Aug 15 00:57:16 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:57:16 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:57:16 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:57:16 user nova-compute[73010]:   </os>
Aug 15 00:57:16 user nova-compute[73010]:   <features>
Aug 15 00:57:16 user nova-compute[73010]:     <acpi/>
Aug 15 00:57:16 user nova-compute[73010]:     <apic/>
Aug 15 00:57:16 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:57:16 user nova-compute[73010]:   </features>
Aug 15 00:57:16 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:57:16 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:57:16 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:57:16 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:57:16 user nova-compute[73010]:   </clock>
Aug 15 00:57:16 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:57:16 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:57:16 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:57:16 user nova-compute[73010]:   </cpu>
Aug 15 00:57:16 user nova-compute[73010]:   <devices>
Aug 15 00:57:16 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:57:16 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:57:16 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk"/>
Aug 15 00:57:16 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:57:16 user nova-compute[73010]:     </disk>
Aug 15 00:57:16 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:57:16 user nova-compute[73010]:       <mac address="fa:16:3e:07:08:aa"/>
Aug 15 00:57:16 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:57:16 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:57:16 user nova-compute[73010]:       <target dev="tapfb1f2867-31"/>
Aug 15 00:57:16 user nova-compute[73010]:     </interface>
Aug 15 00:57:16 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:57:16 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/console.log" append="off"/>
Aug 15 00:57:16 user nova-compute[73010]:     </serial>
Aug 15 00:57:16 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:57:16 user nova-compute[73010]:     <video>
Aug 15 00:57:16 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:57:16 user nova-compute[73010]:     </video>
Aug 15 00:57:16 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:57:16 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:57:16 user nova-compute[73010]:     </rng>
Aug 15 00:57:16 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:57:16 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:57:16 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:57:16 user nova-compute[73010]:     </memballoon>
Aug 15 00:57:16 user nova-compute[73010]:   </devices>
Aug 15 00:57:16 user nova-compute[73010]: </domain>
Aug 15 00:57:16 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1542157265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1542157265',id=43,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6db1cb9145b49999d0f102f8cfb867a',ramdisk_id='',reservation_id='r-7y51m5mf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:57:15Z,user_data=None,user_id='8e1e98c9bae145f0909011bb46c6e104',uuid=d79e3854-769c-430a-b980-3a551c7ee34d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "address": "fa:16:3e:07:08:aa", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1f2867-31", "ovs_interfaceid": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converting VIF {"id": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "address": "fa:16:3e:07:08:aa", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1f2867-31", "ovs_interfaceid": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:08:aa,bridge_name='br-int',has_traffic_filtering=True,id=fb1f2867-31f1-4c71-94a6-f4682f62d16c,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1f2867-31') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG os_vif [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:08:aa,bridge_name='br-int',has_traffic_filtering=True,id=fb1f2867-31f1-4c71-94a6-f4682f62d16c,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1f2867-31') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb1f2867-31, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfb1f2867-31, col_values=(('external_ids', {'iface-id': 'fb1f2867-31f1-4c71-94a6-f4682f62d16c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:08:aa', 'vm-uuid': 'd79e3854-769c-430a-b980-3a551c7ee34d'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:16 user nova-compute[73010]: INFO os_vif [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:08:aa,bridge_name='br-int',has_traffic_filtering=True,id=fb1f2867-31f1-4c71-94a6-f4682f62d16c,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1f2867-31')
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:57:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] No VIF found with MAC fa:16:3e:07:08:aa, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:57:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:17 user nova-compute[73010]: DEBUG nova.network.neutron [req-6e6a6995-416e-4c87-a2d7-22ceaa1947dd req-42d016d4-445a-49ab-9f6b-91925c70ada7 service nova] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Updated VIF entry in instance network info cache for port fb1f2867-31f1-4c71-94a6-f4682f62d16c. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:57:17 user nova-compute[73010]: DEBUG nova.network.neutron [req-6e6a6995-416e-4c87-a2d7-22ceaa1947dd req-42d016d4-445a-49ab-9f6b-91925c70ada7 service nova] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Updating instance_info_cache with network_info: [{"id": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "address": "fa:16:3e:07:08:aa", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1f2867-31", "ovs_interfaceid": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:57:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6e6a6995-416e-4c87-a2d7-22ceaa1947dd req-42d016d4-445a-49ab-9f6b-91925c70ada7 service nova] Releasing lock "refresh_cache-d79e3854-769c-430a-b980-3a551c7ee34d" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:57:17 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:57:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:18 user nova-compute[73010]: DEBUG nova.compute.manager [req-051418ba-7ca9-4815-be00-69336d3838f7 req-7c4b8520-9631-4762-b7bd-6cd42595e8ae service nova] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Received event network-vif-plugged-fb1f2867-31f1-4c71-94a6-f4682f62d16c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:57:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-051418ba-7ca9-4815-be00-69336d3838f7 req-7c4b8520-9631-4762-b7bd-6cd42595e8ae service nova] Acquiring lock "d79e3854-769c-430a-b980-3a551c7ee34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:57:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-051418ba-7ca9-4815-be00-69336d3838f7 req-7c4b8520-9631-4762-b7bd-6cd42595e8ae service nova] Lock "d79e3854-769c-430a-b980-3a551c7ee34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:57:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-051418ba-7ca9-4815-be00-69336d3838f7 req-7c4b8520-9631-4762-b7bd-6cd42595e8ae service nova] Lock "d79e3854-769c-430a-b980-3a551c7ee34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:57:18 user nova-compute[73010]: DEBUG nova.compute.manager [req-051418ba-7ca9-4815-be00-69336d3838f7 req-7c4b8520-9631-4762-b7bd-6cd42595e8ae service nova] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] No waiting events found dispatching network-vif-plugged-fb1f2867-31f1-4c71-94a6-f4682f62d16c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:57:18 user nova-compute[73010]: WARNING nova.compute.manager [req-051418ba-7ca9-4815-be00-69336d3838f7 req-7c4b8520-9631-4762-b7bd-6cd42595e8ae service nova] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Received unexpected event network-vif-plugged-fb1f2867-31f1-4c71-94a6-f4682f62d16c for instance with vm_state building and task_state spawning.
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061040.325856, d79e3854-769c-430a-b980-3a551c7ee34d => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:57:20 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] VM Resumed (Lifecycle Event)
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:57:20 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Instance spawned successfully.
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:57:20 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061040.3303096, d79e3854-769c-430a-b980-3a551c7ee34d => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:57:20 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] VM Started (Lifecycle Event)
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:57:20 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:57:20 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Creating image(s)
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Did not create local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Ensure instance console log exists: /opt/stack/data/nova/instances/5eed2924-cb4a-453b-b90c-07f1e4603637/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Start _get_guest_xml network_info=[{"id": "0b98ada0-5b93-4278-b257-bbaa11248c9c", "address": "fa:16:3e:76:8a:ae", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b98ada0-5b", "ovs_interfaceid": "0b98ada0-5b93-4278-b257-bbaa11248c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YtmOlWJi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5eed2924-cb4a-453b-b90c-07f1e4603637', 'attached_at': '', 'detached_at': '', 'volume_id': '048aabec-0774-43ba-b0e0-68effb43d98f', 'serial': '048aabec-0774-43ba-b0e0-68effb43d98f'}, 'disk_bus': 'virtio', 'attachment_id': '4388225c-ed82-4d3b-ae18-44b1caba8425', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:57:20 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:57:20 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YtmOlWJi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:57:20 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:57:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:57:20 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:57:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:57:20 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 00:57:20 user nova-compute[73010]: INFO nova.compute.manager [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Took 5.55 seconds to spawn the instance on the hypervisor.
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6314a2-fa3d-42f5-a850-f9a607d4662e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 00:57:20 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4ec998-d92f-472d-b0ba-61a4bec530a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f] added
Aug 15 00:57:20 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4fd5b5-c9d9-4863-972d-58cee9d1b749]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa187f5-c62e-4194-a08b-80f064f24c47]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:57:20 user nova-compute[73010]: INFO nova.compute.manager [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Took 6.21 seconds to build instance.
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YtmOlWJi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8a4b831d-7ebe-4ddb-bfb0-9ff3497c964c tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "d79e3854-769c-430a-b980-3a551c7ee34d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.327s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YtmOlWJi" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb489045-ab05-43e2-8a70-1083e19e880d]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YtmOlWJi'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f624f0-f1ce-49ef-9905-20a2dbcf7579]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb4bcd5-f44c-4594-9842-d8d2d19e03a1]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 (non-flash)
Aug 15 00:57:20 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 (non-flash)
Aug 15 00:57:20 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[133c42ca-61a9-48fb-8d0a-e92b413b5f43]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f, portal: 172.16.0.220,3260]
Aug 15 00:57:20 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f, portal: 172.16.0.220,3260] successful.
Aug 15 00:57:20 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3132244a-9640-40c2-a174-7e9c93b7bb1c]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef6d730-9399-4f5f-b69a-7056d795e3da]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 (non-flash)
Aug 15 00:57:20 user nova-compute[73010]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 00:57:20 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 (non-flash)
Aug 15 00:57:20 user nova-compute[73010]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 00:57:20 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[53694910-4ce6-4517-ac87-6d55092ec3c4]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YtmOlWJi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-c7664bfc-d791-4706-88bd-70030b5ef3d5 req-8fd57c7a-6a78-449d-9559-f906019e48f6 service nova] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Received event network-vif-plugged-fb1f2867-31f1-4c71-94a6-f4682f62d16c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c7664bfc-d791-4706-88bd-70030b5ef3d5 req-8fd57c7a-6a78-449d-9559-f906019e48f6 service nova] Acquiring lock "d79e3854-769c-430a-b980-3a551c7ee34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c7664bfc-d791-4706-88bd-70030b5ef3d5 req-8fd57c7a-6a78-449d-9559-f906019e48f6 service nova] Lock "d79e3854-769c-430a-b980-3a551c7ee34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c7664bfc-d791-4706-88bd-70030b5ef3d5 req-8fd57c7a-6a78-449d-9559-f906019e48f6 service nova] Lock "d79e3854-769c-430a-b980-3a551c7ee34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:57:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-c7664bfc-d791-4706-88bd-70030b5ef3d5 req-8fd57c7a-6a78-449d-9559-f906019e48f6 service nova] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] No waiting events found dispatching network-vif-plugged-fb1f2867-31f1-4c71-94a6-f4682f62d16c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:57:20 user nova-compute[73010]: WARNING nova.compute.manager [req-c7664bfc-d791-4706-88bd-70030b5ef3d5 req-8fd57c7a-6a78-449d-9559-f906019e48f6 service nova] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Received unexpected event network-vif-plugged-fb1f2867-31f1-4c71-94a6-f4682f62d16c for instance with vm_state active and task_state None.
Aug 15 00:57:21 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:57:21 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23164373465343434', 'path': '/dev/sdc'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:57:21 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164373465343434', 'path': '/dev/sdc'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 00:57:21 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:57:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-476276858',display_name='tempest-TestVolumeBootPattern-server-476276858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-476276858',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1zaN+b+VydDVLamZvE8X1Kd/Q5Q2Sojr9sHX021PLtuvBNvO93jAR1znkRwvthrtxRfhwBKAX8n8oRWo/mH1ipr8A9qzs9a0e/tyPo6tpDcd6aKpdp/ZnfjKtEL/p1Mg==',key_name='tempest-TestVolumeBootPattern-1981746338',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f67d1031d3cb4c8fb66342a7888ca1c4',ramdisk_id='',reservation_id='r-x5mf80yk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1953358779',owner_user_name='tempest-TestVolumeBootPattern-1953358779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:57:11Z,user_data=None,user_id='daa4eb788f724a6fbf908b029315a02b',uuid=5eed2924-cb4a-453b-b90c-07f1e4603637,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b98ada0-5b93-4278-b257-bbaa11248c9c", "address": "fa:16:3e:76:8a:ae", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b98ada0-5b", "ovs_interfaceid": "0b98ada0-5b93-4278-b257-bbaa11248c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:57:21 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converting VIF {"id": "0b98ada0-5b93-4278-b257-bbaa11248c9c", "address": "fa:16:3e:76:8a:ae", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b98ada0-5b", "ovs_interfaceid": "0b98ada0-5b93-4278-b257-bbaa11248c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:57:21 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:8a:ae,bridge_name='br-int',has_traffic_filtering=True,id=0b98ada0-5b93-4278-b257-bbaa11248c9c,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b98ada0-5b') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:57:21 user nova-compute[73010]: DEBUG nova.objects.instance [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lazy-loading 'pci_devices' on Instance uuid 5eed2924-cb4a-453b-b90c-07f1e4603637 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:57:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:21 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:57:21 user nova-compute[73010]:   <uuid>5eed2924-cb4a-453b-b90c-07f1e4603637</uuid>
Aug 15 00:57:21 user nova-compute[73010]:   <name>instance-0000002a</name>
Aug 15 00:57:21 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:57:21 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:57:21 user nova-compute[73010]:   <metadata>
Aug 15 00:57:21 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:57:21 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:57:21 user nova-compute[73010]:       <nova:name>tempest-TestVolumeBootPattern-server-476276858</nova:name>
Aug 15 00:57:21 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:57:20</nova:creationTime>
Aug 15 00:57:21 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:57:21 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:57:21 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:57:21 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:57:21 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:57:21 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:57:21 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:57:21 user nova-compute[73010]:       <nova:owner>
Aug 15 00:57:21 user nova-compute[73010]:         <nova:user uuid="daa4eb788f724a6fbf908b029315a02b">tempest-TestVolumeBootPattern-1953358779-project-member</nova:user>
Aug 15 00:57:21 user nova-compute[73010]:         <nova:project uuid="f67d1031d3cb4c8fb66342a7888ca1c4">tempest-TestVolumeBootPattern-1953358779</nova:project>
Aug 15 00:57:21 user nova-compute[73010]:       </nova:owner>
Aug 15 00:57:21 user nova-compute[73010]:       <nova:ports>
Aug 15 00:57:21 user nova-compute[73010]:         <nova:port uuid="0b98ada0-5b93-4278-b257-bbaa11248c9c">
Aug 15 00:57:21 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 00:57:21 user nova-compute[73010]:         </nova:port>
Aug 15 00:57:21 user nova-compute[73010]:       </nova:ports>
Aug 15 00:57:21 user nova-compute[73010]:     </nova:instance>
Aug 15 00:57:21 user nova-compute[73010]:   </metadata>
Aug 15 00:57:21 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:57:21 user nova-compute[73010]:     <system>
Aug 15 00:57:21 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:57:21 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:57:21 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:57:21 user nova-compute[73010]:       <entry name="serial">5eed2924-cb4a-453b-b90c-07f1e4603637</entry>
Aug 15 00:57:21 user nova-compute[73010]:       <entry name="uuid">5eed2924-cb4a-453b-b90c-07f1e4603637</entry>
Aug 15 00:57:21 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:57:21 user nova-compute[73010]:     </system>
Aug 15 00:57:21 user nova-compute[73010]:   </sysinfo>
Aug 15 00:57:21 user nova-compute[73010]:   <os>
Aug 15 00:57:21 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:57:21 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:57:21 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:57:21 user nova-compute[73010]:   </os>
Aug 15 00:57:21 user nova-compute[73010]:   <features>
Aug 15 00:57:21 user nova-compute[73010]:     <acpi/>
Aug 15 00:57:21 user nova-compute[73010]:     <apic/>
Aug 15 00:57:21 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:57:21 user nova-compute[73010]:   </features>
Aug 15 00:57:21 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:57:21 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:57:21 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:57:21 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:57:21 user nova-compute[73010]:   </clock>
Aug 15 00:57:21 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:57:21 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:57:21 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:57:21 user nova-compute[73010]:   </cpu>
Aug 15 00:57:21 user nova-compute[73010]:   <devices>
Aug 15 00:57:21 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 00:57:21 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:57:21 user nova-compute[73010]:       <source dev="/dev/sdc"/>
Aug 15 00:57:21 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:57:21 user nova-compute[73010]:       <serial>048aabec-0774-43ba-b0e0-68effb43d98f</serial>
Aug 15 00:57:21 user nova-compute[73010]:     </disk>
Aug 15 00:57:21 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:57:21 user nova-compute[73010]:       <mac address="fa:16:3e:76:8a:ae"/>
Aug 15 00:57:21 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:57:21 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:57:21 user nova-compute[73010]:       <target dev="tap0b98ada0-5b"/>
Aug 15 00:57:21 user nova-compute[73010]:     </interface>
Aug 15 00:57:21 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:57:21 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/5eed2924-cb4a-453b-b90c-07f1e4603637/console.log" append="off"/>
Aug 15 00:57:21 user nova-compute[73010]:     </serial>
Aug 15 00:57:21 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:57:21 user nova-compute[73010]:     <video>
Aug 15 00:57:21 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:57:21 user nova-compute[73010]:     </video>
Aug 15 00:57:21 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:57:21 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:57:21 user nova-compute[73010]:     </rng>
Aug 15 00:57:21 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:57:21 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:57:21 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:57:21 user nova-compute[73010]:     </memballoon>
Aug 15 00:57:21 user nova-compute[73010]:   </devices>
Aug 15 00:57:21 user nova-compute[73010]: </domain>
Aug 15 00:57:21 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:57:21 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:57:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-476276858',display_name='tempest-TestVolumeBootPattern-server-476276858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-476276858',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1zaN+b+VydDVLamZvE8X1Kd/Q5Q2Sojr9sHX021PLtuvBNvO93jAR1znkRwvthrtxRfhwBKAX8n8oRWo/mH1ipr8A9qzs9a0e/tyPo6tpDcd6aKpdp/ZnfjKtEL/p1Mg==',key_name='tempest-TestVolumeBootPattern-1981746338',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f67d1031d3cb4c8fb66342a7888ca1c4',ramdisk_id='',reservation_id='r-x5mf80yk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1953358779',owner_user_name='tempest-TestVolumeBootPattern-1953358779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:57:11Z,user_data=None,user_id='daa4eb788f724a6fbf908b029315a02b',uuid=5eed2924-cb4a-453b-b90c-07f1e4603637,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b98ada0-5b93-4278-b257-bbaa11248c9c", "address": "fa:16:3e:76:8a:ae", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b98ada0-5b", "ovs_interfaceid": "0b98ada0-5b93-4278-b257-bbaa11248c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:57:21 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converting VIF {"id": "0b98ada0-5b93-4278-b257-bbaa11248c9c", "address": "fa:16:3e:76:8a:ae", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b98ada0-5b", "ovs_interfaceid": "0b98ada0-5b93-4278-b257-bbaa11248c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:57:21 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:8a:ae,bridge_name='br-int',has_traffic_filtering=True,id=0b98ada0-5b93-4278-b257-bbaa11248c9c,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b98ada0-5b') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:57:21 user nova-compute[73010]: DEBUG os_vif [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:8a:ae,bridge_name='br-int',has_traffic_filtering=True,id=0b98ada0-5b93-4278-b257-bbaa11248c9c,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b98ada0-5b') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:57:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:57:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:57:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b98ada0-5b, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:57:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0b98ada0-5b, col_values=(('external_ids', {'iface-id': '0b98ada0-5b93-4278-b257-bbaa11248c9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:8a:ae', 'vm-uuid': '5eed2924-cb4a-453b-b90c-07f1e4603637'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:57:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:57:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:21 user nova-compute[73010]: INFO os_vif [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:8a:ae,bridge_name='br-int',has_traffic_filtering=True,id=0b98ada0-5b93-4278-b257-bbaa11248c9c,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b98ada0-5b')
Aug 15 00:57:21 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:57:21 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] No VIF found with MAC fa:16:3e:76:8a:ae, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:57:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:23 user nova-compute[73010]: DEBUG nova.compute.manager [req-91de1a24-f34e-4cb0-9081-54da2e76c0e1 req-93d79f3d-2b77-4b3d-83dd-dbb42fadfd0f service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Received event network-vif-plugged-0b98ada0-5b93-4278-b257-bbaa11248c9c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:57:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-91de1a24-f34e-4cb0-9081-54da2e76c0e1 req-93d79f3d-2b77-4b3d-83dd-dbb42fadfd0f service nova] Acquiring lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:57:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-91de1a24-f34e-4cb0-9081-54da2e76c0e1 req-93d79f3d-2b77-4b3d-83dd-dbb42fadfd0f service nova] Lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:57:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-91de1a24-f34e-4cb0-9081-54da2e76c0e1 req-93d79f3d-2b77-4b3d-83dd-dbb42fadfd0f service nova] Lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:57:23 user nova-compute[73010]: DEBUG nova.compute.manager [req-91de1a24-f34e-4cb0-9081-54da2e76c0e1 req-93d79f3d-2b77-4b3d-83dd-dbb42fadfd0f service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] No waiting events found dispatching network-vif-plugged-0b98ada0-5b93-4278-b257-bbaa11248c9c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:57:23 user nova-compute[73010]: WARNING nova.compute.manager [req-91de1a24-f34e-4cb0-9081-54da2e76c0e1 req-93d79f3d-2b77-4b3d-83dd-dbb42fadfd0f service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Received unexpected event network-vif-plugged-0b98ada0-5b93-4278-b257-bbaa11248c9c for instance with vm_state building and task_state spawning.
Aug 15 00:57:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-97104418-565d-41aa-ae1e-da4ee7a82699 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "eec545e8-eeda-443c-9892-980e19e7267a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:57:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-97104418-565d-41aa-ae1e-da4ee7a82699 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "eec545e8-eeda-443c-9892-980e19e7267a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:57:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-97104418-565d-41aa-ae1e-da4ee7a82699 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "eec545e8-eeda-443c-9892-980e19e7267a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:57:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-97104418-565d-41aa-ae1e-da4ee7a82699 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:57:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-97104418-565d-41aa-ae1e-da4ee7a82699 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:57:24 user nova-compute[73010]: INFO nova.compute.manager [None req-97104418-565d-41aa-ae1e-da4ee7a82699 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Terminating instance
Aug 15 00:57:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-97104418-565d-41aa-ae1e-da4ee7a82699 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:57:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:24 user nova-compute[73010]: DEBUG nova.compute.manager [req-00f1a0f5-3685-4f23-ba90-b5034d260d31 req-2a1bc3d8-8b1d-4206-8ee4-3e105023bf24 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received event network-vif-unplugged-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:57:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-00f1a0f5-3685-4f23-ba90-b5034d260d31 req-2a1bc3d8-8b1d-4206-8ee4-3e105023bf24 service nova] Acquiring lock "eec545e8-eeda-443c-9892-980e19e7267a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:57:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-00f1a0f5-3685-4f23-ba90-b5034d260d31 req-2a1bc3d8-8b1d-4206-8ee4-3e105023bf24 service nova] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:57:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-00f1a0f5-3685-4f23-ba90-b5034d260d31 req-2a1bc3d8-8b1d-4206-8ee4-3e105023bf24 service nova] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:57:24 user nova-compute[73010]: DEBUG nova.compute.manager [req-00f1a0f5-3685-4f23-ba90-b5034d260d31 req-2a1bc3d8-8b1d-4206-8ee4-3e105023bf24 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] No waiting events found dispatching network-vif-unplugged-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:57:24 user nova-compute[73010]: DEBUG nova.compute.manager [req-00f1a0f5-3685-4f23-ba90-b5034d260d31 req-2a1bc3d8-8b1d-4206-8ee4-3e105023bf24 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received event network-vif-unplugged-65b5e7b6-01af-4239-9386-e7b14c83e766 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:57:25 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Instance destroyed successfully.
Aug 15 00:57:25 user nova-compute[73010]: DEBUG nova.objects.instance [None req-97104418-565d-41aa-ae1e-da4ee7a82699 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lazy-loading 'resources' on Instance uuid eec545e8-eeda-443c-9892-980e19e7267a {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-97104418-565d-41aa-ae1e-da4ee7a82699 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:40:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1221562093',display_name='tempest-ServerRescueNegativeTestJSON-server-1221562093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1221562093',id=23,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:45:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a564ea15194c4e059746d2fc6e7e1a07',ramdisk_id='',reservation_id='r-dhvz0v5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-203744558',owner_user_name='tempest-ServerRescueNegativeTestJSON-203744558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:46:53Z,user_data=None,user_id='b85ef05658d64f1fbd78e509e2a606d8',uuid=eec545e8-eeda-443c-9892-980e19e7267a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65b5e7b6-01af-4239-9386-e7b14c83e766", "address": "fa:16:3e:88:de:ee", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b5e7b6-01", "ovs_interfaceid": "65b5e7b6-01af-4239-9386-e7b14c83e766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-97104418-565d-41aa-ae1e-da4ee7a82699 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Converting VIF {"id": "65b5e7b6-01af-4239-9386-e7b14c83e766", "address": "fa:16:3e:88:de:ee", "network": {"id": "f4772ea6-9cb0-4ca8-b327-34f8dd08808e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1000949869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a564ea15194c4e059746d2fc6e7e1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b5e7b6-01", "ovs_interfaceid": "65b5e7b6-01af-4239-9386-e7b14c83e766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-97104418-565d-41aa-ae1e-da4ee7a82699 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:de:ee,bridge_name='br-int',has_traffic_filtering=True,id=65b5e7b6-01af-4239-9386-e7b14c83e766,network=Network(f4772ea6-9cb0-4ca8-b327-34f8dd08808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65b5e7b6-01') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG os_vif [None req-97104418-565d-41aa-ae1e-da4ee7a82699 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:de:ee,bridge_name='br-int',has_traffic_filtering=True,id=65b5e7b6-01af-4239-9386-e7b14c83e766,network=Network(f4772ea6-9cb0-4ca8-b327-34f8dd08808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65b5e7b6-01') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65b5e7b6-01, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:57:25 user nova-compute[73010]: INFO os_vif [None req-97104418-565d-41aa-ae1e-da4ee7a82699 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:de:ee,bridge_name='br-int',has_traffic_filtering=True,id=65b5e7b6-01af-4239-9386-e7b14c83e766,network=Network(f4772ea6-9cb0-4ca8-b327-34f8dd08808e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65b5e7b6-01')
Aug 15 00:57:25 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-97104418-565d-41aa-ae1e-da4ee7a82699 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Deleting instance files /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a_del
Aug 15 00:57:25 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-97104418-565d-41aa-ae1e-da4ee7a82699 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Deletion of /opt/stack/data/nova/instances/eec545e8-eeda-443c-9892-980e19e7267a_del complete
Aug 15 00:57:25 user nova-compute[73010]: INFO nova.compute.manager [None req-97104418-565d-41aa-ae1e-da4ee7a82699 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 15 00:57:25 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-97104418-565d-41aa-ae1e-da4ee7a82699 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: eec545e8-eeda-443c-9892-980e19e7267a] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-815916b9-6390-4f20-b191-4a6a101dc983 req-cec686ee-3266-45ff-83d7-a9b32a3953f6 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Received event network-vif-plugged-0b98ada0-5b93-4278-b257-bbaa11248c9c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-815916b9-6390-4f20-b191-4a6a101dc983 req-cec686ee-3266-45ff-83d7-a9b32a3953f6 service nova] Acquiring lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-815916b9-6390-4f20-b191-4a6a101dc983 req-cec686ee-3266-45ff-83d7-a9b32a3953f6 service nova] Lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-815916b9-6390-4f20-b191-4a6a101dc983 req-cec686ee-3266-45ff-83d7-a9b32a3953f6 service nova] Lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-815916b9-6390-4f20-b191-4a6a101dc983 req-cec686ee-3266-45ff-83d7-a9b32a3953f6 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] No waiting events found dispatching network-vif-plugged-0b98ada0-5b93-4278-b257-bbaa11248c9c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:57:25 user nova-compute[73010]: WARNING nova.compute.manager [req-815916b9-6390-4f20-b191-4a6a101dc983 req-cec686ee-3266-45ff-83d7-a9b32a3953f6 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Received unexpected event network-vif-plugged-0b98ada0-5b93-4278-b257-bbaa11248c9c for instance with vm_state building and task_state spawning.
Aug 15 00:57:25 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061045.6188786, 5eed2924-cb4a-453b-b90c-07f1e4603637 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:57:25 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] VM Resumed (Lifecycle Event)
Aug 15 00:57:25 user nova-compute[73010]: DEBUG nova.compute.manager [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:57:25 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Instance spawned successfully.
Aug 15 00:57:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:57:25 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:57:25 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061045.6191235, 5eed2924-cb4a-453b-b90c-07f1e4603637 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:57:25 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] VM Started (Lifecycle Event)
Aug 15 00:57:25 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:57:25 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:57:25 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:57:25 user nova-compute[73010]: INFO nova.compute.manager [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Took 5.33 seconds to spawn the instance on the hypervisor.
Aug 15 00:57:25 user nova-compute[73010]: DEBUG nova.compute.manager [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:57:25 user nova-compute[73010]: INFO nova.compute.manager [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Took 15.51 seconds to build instance.
Aug 15 00:57:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0154a935-0267-4dcf-929e-cf63576411c5 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "5eed2924-cb4a-453b-b90c-07f1e4603637" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.666s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:57:26 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:57:26 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Took 0.57 seconds to deallocate network for instance.
Aug 15 00:57:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-97104418-565d-41aa-ae1e-da4ee7a82699 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:57:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-97104418-565d-41aa-ae1e-da4ee7a82699 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:57:26 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-97104418-565d-41aa-ae1e-da4ee7a82699 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:57:26 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-97104418-565d-41aa-ae1e-da4ee7a82699 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:57:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-97104418-565d-41aa-ae1e-da4ee7a82699 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:57:26 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-97104418-565d-41aa-ae1e-da4ee7a82699 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Deleted allocations for instance eec545e8-eeda-443c-9892-980e19e7267a
Aug 15 00:57:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-97104418-565d-41aa-ae1e-da4ee7a82699 tempest-ServerRescueNegativeTestJSON-203744558 tempest-ServerRescueNegativeTestJSON-203744558-project-member] Lock "eec545e8-eeda-443c-9892-980e19e7267a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.940s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:57:26 user nova-compute[73010]: DEBUG nova.compute.manager [req-ae5b2e66-54c7-440d-abd9-df35f0ba0dc9 req-c1713a69-42be-496e-a3c3-66729efaab36 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received event network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:57:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ae5b2e66-54c7-440d-abd9-df35f0ba0dc9 req-c1713a69-42be-496e-a3c3-66729efaab36 service nova] Acquiring lock "eec545e8-eeda-443c-9892-980e19e7267a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:57:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ae5b2e66-54c7-440d-abd9-df35f0ba0dc9 req-c1713a69-42be-496e-a3c3-66729efaab36 service nova] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:57:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ae5b2e66-54c7-440d-abd9-df35f0ba0dc9 req-c1713a69-42be-496e-a3c3-66729efaab36 service nova] Lock "eec545e8-eeda-443c-9892-980e19e7267a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:57:26 user nova-compute[73010]: DEBUG nova.compute.manager [req-ae5b2e66-54c7-440d-abd9-df35f0ba0dc9 req-c1713a69-42be-496e-a3c3-66729efaab36 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] No waiting events found dispatching network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:57:26 user nova-compute[73010]: WARNING nova.compute.manager [req-ae5b2e66-54c7-440d-abd9-df35f0ba0dc9 req-c1713a69-42be-496e-a3c3-66729efaab36 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received unexpected event network-vif-plugged-65b5e7b6-01af-4239-9386-e7b14c83e766 for instance with vm_state deleted and task_state None.
Aug 15 00:57:26 user nova-compute[73010]: DEBUG nova.compute.manager [req-ae5b2e66-54c7-440d-abd9-df35f0ba0dc9 req-c1713a69-42be-496e-a3c3-66729efaab36 service nova] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Received event network-vif-deleted-65b5e7b6-01af-4239-9386-e7b14c83e766 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:57:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:40 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692061045.4264266, eec545e8-eeda-443c-9892-980e19e7267a => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:57:40 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: eec545e8-eeda-443c-9892-980e19e7267a] VM Stopped (Lifecycle Event)
Aug 15 00:57:40 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f26c310b-d075-4a02-b6c0-7395170aeae8 None None] [instance: eec545e8-eeda-443c-9892-980e19e7267a] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:57:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:57:58 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:57:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:57:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:57:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:57:58 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:57:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:57:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:57:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:57:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:57:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:57:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:57:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:57:59 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:57:59 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:57:59 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8395MB free_disk=25.556270599365234GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:57:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:57:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:57:59 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 08a1c553-db53-4559-bac1-4e84ac05e2ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:57:59 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 5eed2924-cb4a-453b-b90c-07f1e4603637 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:57:59 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance d79e3854-769c-430a-b980-3a551c7ee34d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:57:59 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:57:59 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:57:59 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:57:59 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:57:59 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:57:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:58:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:00 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:58:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:58:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 00:58:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:58:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:58:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:10 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:58:10 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:58:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-e51aeaba-df9b-45d2-99f2-36e6fe2fcf0f req-9ab47189-ca82-4325-b113-818d091b4bdb service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received event network-changed-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:58:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-e51aeaba-df9b-45d2-99f2-36e6fe2fcf0f req-9ab47189-ca82-4325-b113-818d091b4bdb service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Refreshing instance network info cache due to event network-changed-cefb1758-4282-491b-b86a-a7de5efd3cca. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:58:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e51aeaba-df9b-45d2-99f2-36e6fe2fcf0f req-9ab47189-ca82-4325-b113-818d091b4bdb service nova] Acquiring lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:58:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e51aeaba-df9b-45d2-99f2-36e6fe2fcf0f req-9ab47189-ca82-4325-b113-818d091b4bdb service nova] Acquired lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:58:11 user nova-compute[73010]: DEBUG nova.network.neutron [req-e51aeaba-df9b-45d2-99f2-36e6fe2fcf0f req-9ab47189-ca82-4325-b113-818d091b4bdb service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Refreshing network info cache for port cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:58:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:12 user nova-compute[73010]: DEBUG nova.network.neutron [req-e51aeaba-df9b-45d2-99f2-36e6fe2fcf0f req-9ab47189-ca82-4325-b113-818d091b4bdb service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Updated VIF entry in instance network info cache for port cefb1758-4282-491b-b86a-a7de5efd3cca. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:58:12 user nova-compute[73010]: DEBUG nova.network.neutron [req-e51aeaba-df9b-45d2-99f2-36e6fe2fcf0f req-9ab47189-ca82-4325-b113-818d091b4bdb service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Updating instance_info_cache with network_info: [{"id": "cefb1758-4282-491b-b86a-a7de5efd3cca", "address": "fa:16:3e:8b:f0:7a", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcefb1758-42", "ovs_interfaceid": "cefb1758-4282-491b-b86a-a7de5efd3cca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:58:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e51aeaba-df9b-45d2-99f2-36e6fe2fcf0f req-9ab47189-ca82-4325-b113-818d091b4bdb service nova] Releasing lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:58:12 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:58:12 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:58:12 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 00:58:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:58:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:58:12 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 00:58:12 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lazy-loading 'info_cache' on Instance uuid 08a1c553-db53-4559-bac1-4e84ac05e2ab {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "08a1c553-db53-4559-bac1-4e84ac05e2ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:58:13 user nova-compute[73010]: INFO nova.compute.manager [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Detaching volume 5695d185-a59c-4e3f-a2e0-a16b899772a6
Aug 15 00:58:13 user nova-compute[73010]: INFO nova.virt.block_device [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Attempting to driver detach volume 5695d185-a59c-4e3f-a2e0-a16b899772a6 from mountpoint /dev/vdb
Aug 15 00:58:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Attempting to detach device vdb from instance 08a1c553-db53-4559-bac1-4e84ac05e2ab from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:58:13 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:58:13 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:58:13 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:58:13 user nova-compute[73010]:   <serial>5695d185-a59c-4e3f-a2e0-a16b899772a6</serial>
Aug 15 00:58:13 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 00:58:13 user nova-compute[73010]: </disk>
Aug 15 00:58:13 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:58:13 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Successfully detached device vdb from instance 08a1c553-db53-4559-bac1-4e84ac05e2ab from the persistent domain config.
Aug 15 00:58:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 08a1c553-db53-4559-bac1-4e84ac05e2ab from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 00:58:13 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 00:58:13 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 00:58:13 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 00:58:13 user nova-compute[73010]:   <serial>5695d185-a59c-4e3f-a2e0-a16b899772a6</serial>
Aug 15 00:58:13 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 00:58:13 user nova-compute[73010]: </disk>
Aug 15 00:58:13 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Updating instance_info_cache with network_info: [{"id": "cefb1758-4282-491b-b86a-a7de5efd3cca", "address": "fa:16:3e:8b:f0:7a", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcefb1758-42", "ovs_interfaceid": "cefb1758-4282-491b-b86a-a7de5efd3cca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692061093.62835, 08a1c553-db53-4559-bac1-4e84ac05e2ab => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 08a1c553-db53-4559-bac1-4e84ac05e2ab {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 00:58:13 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Successfully detached device vdb from instance 08a1c553-db53-4559-bac1-4e84ac05e2ab from the live domain config.
Aug 15 00:58:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcaoVkfv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:58:13 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:58:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6471353b-6eab-404f-a650-dd7cebb5faaa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e3a119-79df-4e93-ad74-1a90dcde68d2]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 (non-flash)
Aug 15 00:58:13 user nova-compute[73010]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 00:58:13 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 (non-flash)
Aug 15 00:58:13 user nova-compute[73010]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 00:58:13 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec3034b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6'): ({'sdb'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Removing single pathed devices sdb {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94ae692-4d00-4ad5-ae32-72cd5430fafa]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[56769e7b-f984-436e-b1f9-890f84c46df2]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Flushing IO for device /dev/sdb {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0674617e-5678-4e80-916d-162cea9eceb5]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ddf281-cbd1-4840-92b5-d7f34567a2ab]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e39c37e-ca71-4f97-aac3-fdf45964577e]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fe5550-2073-4a58-8506-3c1e4660ce63]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6, portal: 172.16.0.220,3260]
Aug 15 00:58:13 user nova-compute[73010]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6, portal: 172.16.0.220,3260] successful.
Aug 15 00:58:13 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5695d185-a59c-4e3f-a2e0-a16b899772a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7237d1e-82c5-4b77-9ef5-da0ee01ef10d]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] <== disconnect_volume: return (262ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG nova.compute.manager [req-8dfde284-a24b-492d-93e5-242208cc4072 req-18d36c08-8644-4607-b659-59ee5f50881d service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received event network-changed-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG nova.compute.manager [req-8dfde284-a24b-492d-93e5-242208cc4072 req-18d36c08-8644-4607-b659-59ee5f50881d service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Refreshing instance network info cache due to event network-changed-cefb1758-4282-491b-b86a-a7de5efd3cca. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-8dfde284-a24b-492d-93e5-242208cc4072 req-18d36c08-8644-4607-b659-59ee5f50881d service nova] Acquiring lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-8dfde284-a24b-492d-93e5-242208cc4072 req-18d36c08-8644-4607-b659-59ee5f50881d service nova] Acquired lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:58:13 user nova-compute[73010]: DEBUG nova.network.neutron [req-8dfde284-a24b-492d-93e5-242208cc4072 req-18d36c08-8644-4607-b659-59ee5f50881d service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Refreshing network info cache for port cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:58:14 user nova-compute[73010]: DEBUG nova.network.neutron [req-8dfde284-a24b-492d-93e5-242208cc4072 req-18d36c08-8644-4607-b659-59ee5f50881d service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Updated VIF entry in instance network info cache for port cefb1758-4282-491b-b86a-a7de5efd3cca. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:58:14 user nova-compute[73010]: DEBUG nova.network.neutron [req-8dfde284-a24b-492d-93e5-242208cc4072 req-18d36c08-8644-4607-b659-59ee5f50881d service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Updating instance_info_cache with network_info: [{"id": "cefb1758-4282-491b-b86a-a7de5efd3cca", "address": "fa:16:3e:8b:f0:7a", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcefb1758-42", "ovs_interfaceid": "cefb1758-4282-491b-b86a-a7de5efd3cca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:58:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-8dfde284-a24b-492d-93e5-242208cc4072 req-18d36c08-8644-4607-b659-59ee5f50881d service nova] Releasing lock "refresh_cache-08a1c553-db53-4559-bac1-4e84ac05e2ab" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:58:14 user nova-compute[73010]: DEBUG nova.objects.instance [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lazy-loading 'flavor' on Instance uuid 08a1c553-db53-4559-bac1-4e84ac05e2ab {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:58:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ad253b3d-6362-4772-8aa0-e0e9e2cf3874 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.566s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:58:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:16 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:58:16 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Cleaning up deleted instances {{(pid=73010) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 00:58:16 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] There are 0 instances to clean {{(pid=73010) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 00:58:17 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:58:17 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:58:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:24 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:58:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:26 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:58:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:58:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:58:28 user nova-compute[73010]: DEBUG nova.compute.manager [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:58:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:58:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:58:28 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:58:28 user nova-compute[73010]: INFO nova.compute.claims [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Claim successful on node user
Aug 15 00:58:29 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:58:29 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:58:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.246s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:58:29 user nova-compute[73010]: DEBUG nova.compute.manager [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:58:29 user nova-compute[73010]: DEBUG nova.compute.manager [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:58:29 user nova-compute[73010]: DEBUG nova.network.neutron [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:58:29 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:58:29 user nova-compute[73010]: DEBUG nova.compute.manager [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:58:29 user nova-compute[73010]: DEBUG nova.policy [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c5655da76eb4671b4db00e086232f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586bed330893488081bb21738b1a6ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:58:29 user nova-compute[73010]: DEBUG nova.compute.manager [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 00:58:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 00:58:29 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Creating image(s)
Aug 15 00:58:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "/opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:58:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "/opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:58:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "/opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:58:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:58:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.183s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:58:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:58:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:58:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:58:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:58:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:58:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk 1073741824" returned: 0 in 0.053s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:58:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:58:29 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:58:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.191s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:58:30 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 00:58:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:58:30 user nova-compute[73010]: DEBUG nova.network.neutron [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Successfully created port: bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:58:30 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:58:30 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Cannot resize image /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 00:58:30 user nova-compute[73010]: DEBUG nova.objects.instance [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lazy-loading 'migration_context' on Instance uuid 20d92360-d4f7-4f17-8a32-fb901dd8feb8 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:58:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 00:58:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Ensure instance console log exists: /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 00:58:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:58:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:58:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:58:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:30 user nova-compute[73010]: DEBUG nova.network.neutron [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Successfully updated port: bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:58:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "refresh_cache-20d92360-d4f7-4f17-8a32-fb901dd8feb8" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:58:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquired lock "refresh_cache-20d92360-d4f7-4f17-8a32-fb901dd8feb8" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:58:30 user nova-compute[73010]: DEBUG nova.network.neutron [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:58:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-ae2367cd-f4ae-427c-bad9-75b3561d1201 req-2817c1f1-a99c-4abe-9ecc-5b424b31d169 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Received event network-changed-bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:58:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-ae2367cd-f4ae-427c-bad9-75b3561d1201 req-2817c1f1-a99c-4abe-9ecc-5b424b31d169 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Refreshing instance network info cache due to event network-changed-bb08a1cd-7152-4c81-b416-ac00f5bb59be. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:58:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ae2367cd-f4ae-427c-bad9-75b3561d1201 req-2817c1f1-a99c-4abe-9ecc-5b424b31d169 service nova] Acquiring lock "refresh_cache-20d92360-d4f7-4f17-8a32-fb901dd8feb8" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:58:30 user nova-compute[73010]: DEBUG nova.network.neutron [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.network.neutron [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Updating instance_info_cache with network_info: [{"id": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "address": "fa:16:3e:d7:26:86", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb08a1cd-71", "ovs_interfaceid": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Releasing lock "refresh_cache-20d92360-d4f7-4f17-8a32-fb901dd8feb8" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.compute.manager [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Instance network_info: |[{"id": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "address": "fa:16:3e:d7:26:86", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb08a1cd-71", "ovs_interfaceid": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ae2367cd-f4ae-427c-bad9-75b3561d1201 req-2817c1f1-a99c-4abe-9ecc-5b424b31d169 service nova] Acquired lock "refresh_cache-20d92360-d4f7-4f17-8a32-fb901dd8feb8" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.network.neutron [req-ae2367cd-f4ae-427c-bad9-75b3561d1201 req-2817c1f1-a99c-4abe-9ecc-5b424b31d169 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Refreshing network info cache for port bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Start _get_guest_xml network_info=[{"id": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "address": "fa:16:3e:d7:26:86", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb08a1cd-71", "ovs_interfaceid": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 00:58:31 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:58:31 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:58:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-250049231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-250049231',id=44,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB68T4Tfh7suf54gX4WwC1EAatBAA0f+1a93JBgelOv/aFsQJIUeViaEqJv62ELVcOXfDPqS4j5ENQxQZplvmlKnUkW3CYdpGB4XrHmlOoqKR080R20EdRsZnzavNv1BQQ==',key_name='tempest-keypair-449371876',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='586bed330893488081bb21738b1a6ec4',ramdisk_id='',reservation_id='r-ckgkv059',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-563974852',owner_user_name='tempest-AttachVolumeShelveTestJSON-563974852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:58:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c5655da76eb4671b4db00e086232f05',uuid=20d92360-d4f7-4f17-8a32-fb901dd8feb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "address": "fa:16:3e:d7:26:86", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb08a1cd-71", "ovs_interfaceid": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Converting VIF {"id": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "address": "fa:16:3e:d7:26:86", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb08a1cd-71", "ovs_interfaceid": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:26:86,bridge_name='br-int',has_traffic_filtering=True,id=bb08a1cd-7152-4c81-b416-ac00f5bb59be,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb08a1cd-71') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.objects.instance [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lazy-loading 'pci_devices' on Instance uuid 20d92360-d4f7-4f17-8a32-fb901dd8feb8 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] End _get_guest_xml xml=<domain type="kvm">
Aug 15 00:58:31 user nova-compute[73010]:   <uuid>20d92360-d4f7-4f17-8a32-fb901dd8feb8</uuid>
Aug 15 00:58:31 user nova-compute[73010]:   <name>instance-0000002c</name>
Aug 15 00:58:31 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 00:58:31 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 00:58:31 user nova-compute[73010]:   <metadata>
Aug 15 00:58:31 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 00:58:31 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 00:58:31 user nova-compute[73010]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-250049231</nova:name>
Aug 15 00:58:31 user nova-compute[73010]:       <nova:creationTime>2023-08-15 00:58:31</nova:creationTime>
Aug 15 00:58:31 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 00:58:31 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 00:58:31 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 00:58:31 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 00:58:31 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 00:58:31 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 00:58:31 user nova-compute[73010]:       </nova:flavor>
Aug 15 00:58:31 user nova-compute[73010]:       <nova:owner>
Aug 15 00:58:31 user nova-compute[73010]:         <nova:user uuid="0c5655da76eb4671b4db00e086232f05">tempest-AttachVolumeShelveTestJSON-563974852-project-member</nova:user>
Aug 15 00:58:31 user nova-compute[73010]:         <nova:project uuid="586bed330893488081bb21738b1a6ec4">tempest-AttachVolumeShelveTestJSON-563974852</nova:project>
Aug 15 00:58:31 user nova-compute[73010]:       </nova:owner>
Aug 15 00:58:31 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 00:58:31 user nova-compute[73010]:       <nova:ports>
Aug 15 00:58:31 user nova-compute[73010]:         <nova:port uuid="bb08a1cd-7152-4c81-b416-ac00f5bb59be">
Aug 15 00:58:31 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 00:58:31 user nova-compute[73010]:         </nova:port>
Aug 15 00:58:31 user nova-compute[73010]:       </nova:ports>
Aug 15 00:58:31 user nova-compute[73010]:     </nova:instance>
Aug 15 00:58:31 user nova-compute[73010]:   </metadata>
Aug 15 00:58:31 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 00:58:31 user nova-compute[73010]:     <system>
Aug 15 00:58:31 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 00:58:31 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 00:58:31 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 00:58:31 user nova-compute[73010]:       <entry name="serial">20d92360-d4f7-4f17-8a32-fb901dd8feb8</entry>
Aug 15 00:58:31 user nova-compute[73010]:       <entry name="uuid">20d92360-d4f7-4f17-8a32-fb901dd8feb8</entry>
Aug 15 00:58:31 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 00:58:31 user nova-compute[73010]:     </system>
Aug 15 00:58:31 user nova-compute[73010]:   </sysinfo>
Aug 15 00:58:31 user nova-compute[73010]:   <os>
Aug 15 00:58:31 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 00:58:31 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 00:58:31 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 00:58:31 user nova-compute[73010]:   </os>
Aug 15 00:58:31 user nova-compute[73010]:   <features>
Aug 15 00:58:31 user nova-compute[73010]:     <acpi/>
Aug 15 00:58:31 user nova-compute[73010]:     <apic/>
Aug 15 00:58:31 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 00:58:31 user nova-compute[73010]:   </features>
Aug 15 00:58:31 user nova-compute[73010]:   <clock offset="utc">
Aug 15 00:58:31 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 00:58:31 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 00:58:31 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 00:58:31 user nova-compute[73010]:   </clock>
Aug 15 00:58:31 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 00:58:31 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 00:58:31 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 00:58:31 user nova-compute[73010]:   </cpu>
Aug 15 00:58:31 user nova-compute[73010]:   <devices>
Aug 15 00:58:31 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 00:58:31 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 00:58:31 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk"/>
Aug 15 00:58:31 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 00:58:31 user nova-compute[73010]:     </disk>
Aug 15 00:58:31 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 00:58:31 user nova-compute[73010]:       <mac address="fa:16:3e:d7:26:86"/>
Aug 15 00:58:31 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:58:31 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 00:58:31 user nova-compute[73010]:       <target dev="tapbb08a1cd-71"/>
Aug 15 00:58:31 user nova-compute[73010]:     </interface>
Aug 15 00:58:31 user nova-compute[73010]:     <serial type="pty">
Aug 15 00:58:31 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/console.log" append="off"/>
Aug 15 00:58:31 user nova-compute[73010]:     </serial>
Aug 15 00:58:31 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 00:58:31 user nova-compute[73010]:     <video>
Aug 15 00:58:31 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 00:58:31 user nova-compute[73010]:     </video>
Aug 15 00:58:31 user nova-compute[73010]:     <rng model="virtio">
Aug 15 00:58:31 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 00:58:31 user nova-compute[73010]:     </rng>
Aug 15 00:58:31 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 00:58:31 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 00:58:31 user nova-compute[73010]:       <stats period="10"/>
Aug 15 00:58:31 user nova-compute[73010]:     </memballoon>
Aug 15 00:58:31 user nova-compute[73010]:   </devices>
Aug 15 00:58:31 user nova-compute[73010]: </domain>
Aug 15 00:58:31 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:58:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-250049231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-250049231',id=44,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB68T4Tfh7suf54gX4WwC1EAatBAA0f+1a93JBgelOv/aFsQJIUeViaEqJv62ELVcOXfDPqS4j5ENQxQZplvmlKnUkW3CYdpGB4XrHmlOoqKR080R20EdRsZnzavNv1BQQ==',key_name='tempest-keypair-449371876',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='586bed330893488081bb21738b1a6ec4',ramdisk_id='',reservation_id='r-ckgkv059',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-563974852',owner_user_name='tempest-AttachVolumeShelveTestJSON-563974852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:58:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c5655da76eb4671b4db00e086232f05',uuid=20d92360-d4f7-4f17-8a32-fb901dd8feb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "address": "fa:16:3e:d7:26:86", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb08a1cd-71", "ovs_interfaceid": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Converting VIF {"id": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "address": "fa:16:3e:d7:26:86", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb08a1cd-71", "ovs_interfaceid": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:26:86,bridge_name='br-int',has_traffic_filtering=True,id=bb08a1cd-7152-4c81-b416-ac00f5bb59be,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb08a1cd-71') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG os_vif [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:26:86,bridge_name='br-int',has_traffic_filtering=True,id=bb08a1cd-7152-4c81-b416-ac00f5bb59be,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb08a1cd-71') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb08a1cd-71, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb08a1cd-71, col_values=(('external_ids', {'iface-id': 'bb08a1cd-7152-4c81-b416-ac00f5bb59be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:26:86', 'vm-uuid': '20d92360-d4f7-4f17-8a32-fb901dd8feb8'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:31 user nova-compute[73010]: INFO os_vif [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:26:86,bridge_name='br-int',has_traffic_filtering=True,id=bb08a1cd-7152-4c81-b416-ac00f5bb59be,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb08a1cd-71')
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] No VIF found with MAC fa:16:3e:d7:26:86, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.network.neutron [req-ae2367cd-f4ae-427c-bad9-75b3561d1201 req-2817c1f1-a99c-4abe-9ecc-5b424b31d169 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Updated VIF entry in instance network info cache for port bb08a1cd-7152-4c81-b416-ac00f5bb59be. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG nova.network.neutron [req-ae2367cd-f4ae-427c-bad9-75b3561d1201 req-2817c1f1-a99c-4abe-9ecc-5b424b31d169 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Updating instance_info_cache with network_info: [{"id": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "address": "fa:16:3e:d7:26:86", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb08a1cd-71", "ovs_interfaceid": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:58:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ae2367cd-f4ae-427c-bad9-75b3561d1201 req-2817c1f1-a99c-4abe-9ecc-5b424b31d169 service nova] Releasing lock "refresh_cache-20d92360-d4f7-4f17-8a32-fb901dd8feb8" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:58:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:32 user nova-compute[73010]: DEBUG nova.compute.manager [req-43463ab6-a2ab-4b71-9795-d45dc1575d9b req-76ca62de-0378-4464-945b-5e20bff03aed service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Received event network-vif-plugged-bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:58:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-43463ab6-a2ab-4b71-9795-d45dc1575d9b req-76ca62de-0378-4464-945b-5e20bff03aed service nova] Acquiring lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:58:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-43463ab6-a2ab-4b71-9795-d45dc1575d9b req-76ca62de-0378-4464-945b-5e20bff03aed service nova] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:58:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-43463ab6-a2ab-4b71-9795-d45dc1575d9b req-76ca62de-0378-4464-945b-5e20bff03aed service nova] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:58:32 user nova-compute[73010]: DEBUG nova.compute.manager [req-43463ab6-a2ab-4b71-9795-d45dc1575d9b req-76ca62de-0378-4464-945b-5e20bff03aed service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] No waiting events found dispatching network-vif-plugged-bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:58:32 user nova-compute[73010]: WARNING nova.compute.manager [req-43463ab6-a2ab-4b71-9795-d45dc1575d9b req-76ca62de-0378-4464-945b-5e20bff03aed service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Received unexpected event network-vif-plugged-bb08a1cd-7152-4c81-b416-ac00f5bb59be for instance with vm_state building and task_state spawning.
Aug 15 00:58:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:34 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:58:34 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73010) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 00:58:34 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061114.8292203, 20d92360-d4f7-4f17-8a32-fb901dd8feb8 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:58:34 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] VM Resumed (Lifecycle Event)
Aug 15 00:58:34 user nova-compute[73010]: DEBUG nova.compute.manager [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 00:58:34 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 00:58:34 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Instance spawned successfully.
Aug 15 00:58:34 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 00:58:34 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:58:34 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:58:34 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:58:34 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:58:34 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:58:34 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:58:34 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:58:34 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 00:58:34 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:58:34 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061114.8321812, 20d92360-d4f7-4f17-8a32-fb901dd8feb8 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:58:34 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] VM Started (Lifecycle Event)
Aug 15 00:58:34 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:58:34 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 00:58:34 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 00:58:34 user nova-compute[73010]: INFO nova.compute.manager [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Took 5.53 seconds to spawn the instance on the hypervisor.
Aug 15 00:58:34 user nova-compute[73010]: DEBUG nova.compute.manager [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:58:34 user nova-compute[73010]: DEBUG nova.compute.manager [req-02fe6bb2-0753-48be-8876-b99d91d0b940 req-c16a2ef7-a017-46a4-b5d5-1c22d5bdfd89 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Received event network-vif-plugged-bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:58:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-02fe6bb2-0753-48be-8876-b99d91d0b940 req-c16a2ef7-a017-46a4-b5d5-1c22d5bdfd89 service nova] Acquiring lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:58:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-02fe6bb2-0753-48be-8876-b99d91d0b940 req-c16a2ef7-a017-46a4-b5d5-1c22d5bdfd89 service nova] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:58:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-02fe6bb2-0753-48be-8876-b99d91d0b940 req-c16a2ef7-a017-46a4-b5d5-1c22d5bdfd89 service nova] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:58:34 user nova-compute[73010]: DEBUG nova.compute.manager [req-02fe6bb2-0753-48be-8876-b99d91d0b940 req-c16a2ef7-a017-46a4-b5d5-1c22d5bdfd89 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] No waiting events found dispatching network-vif-plugged-bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:58:34 user nova-compute[73010]: WARNING nova.compute.manager [req-02fe6bb2-0753-48be-8876-b99d91d0b940 req-c16a2ef7-a017-46a4-b5d5-1c22d5bdfd89 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Received unexpected event network-vif-plugged-bb08a1cd-7152-4c81-b416-ac00f5bb59be for instance with vm_state building and task_state spawning.
Aug 15 00:58:35 user nova-compute[73010]: INFO nova.compute.manager [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Took 6.09 seconds to build instance.
Aug 15 00:58:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-80660181-9c55-4085-873e-3c9bee313dd7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.194s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:58:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:39 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_power_states {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:58:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid 08a1c553-db53-4559-bac1-4e84ac05e2ab {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 00:58:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid 5eed2924-cb4a-453b-b90c-07f1e4603637 {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 00:58:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid d79e3854-769c-430a-b980-3a551c7ee34d {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 00:58:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid 20d92360-d4f7-4f17-8a32-fb901dd8feb8 {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 00:58:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "08a1c553-db53-4559-bac1-4e84ac05e2ab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:58:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:58:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "5eed2924-cb4a-453b-b90c-07f1e4603637" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:58:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "5eed2924-cb4a-453b-b90c-07f1e4603637" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:58:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "d79e3854-769c-430a-b980-3a551c7ee34d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:58:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "d79e3854-769c-430a-b980-3a551c7ee34d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:58:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:58:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:58:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:58:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "5eed2924-cb4a-453b-b90c-07f1e4603637" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:58:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "d79e3854-769c-430a-b980-3a551c7ee34d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:58:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:58:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:58:59 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:58:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:58:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:58:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:58:59 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 00:58:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:58:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:58:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:58:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:58:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:59:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:59:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:59:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:59:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:59:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:59:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:59:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:59:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 00:59:01 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:59:01 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 00:59:01 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8276MB free_disk=25.525894165039062GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 00:59:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:59:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:59:01 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 08a1c553-db53-4559-bac1-4e84ac05e2ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:59:01 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 5eed2924-cb4a-453b-b90c-07f1e4603637 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:59:01 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance d79e3854-769c-430a-b980-3a551c7ee34d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:59:01 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 20d92360-d4f7-4f17-8a32-fb901dd8feb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 00:59:01 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 00:59:01 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 00:59:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:01 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Refreshing inventories for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 00:59:01 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Updating ProviderTree inventory for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 00:59:01 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Updating inventory in ProviderTree for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 00:59:01 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Refreshing aggregate associations for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e, aggregates: None {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 00:59:01 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Refreshing trait associations for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 00:59:01 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:59:01 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:59:01 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 00:59:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.466s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:59:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-b3163c7c-dbf5-4028-b57c-54e4bcf373fe req-71ae5055-4acd-4e6b-b152-e3f39e766f55 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Received event network-changed-0b98ada0-5b93-4278-b257-bbaa11248c9c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:59:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-b3163c7c-dbf5-4028-b57c-54e4bcf373fe req-71ae5055-4acd-4e6b-b152-e3f39e766f55 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Refreshing instance network info cache due to event network-changed-0b98ada0-5b93-4278-b257-bbaa11248c9c. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:59:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b3163c7c-dbf5-4028-b57c-54e4bcf373fe req-71ae5055-4acd-4e6b-b152-e3f39e766f55 service nova] Acquiring lock "refresh_cache-5eed2924-cb4a-453b-b90c-07f1e4603637" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:59:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b3163c7c-dbf5-4028-b57c-54e4bcf373fe req-71ae5055-4acd-4e6b-b152-e3f39e766f55 service nova] Acquired lock "refresh_cache-5eed2924-cb4a-453b-b90c-07f1e4603637" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:59:02 user nova-compute[73010]: DEBUG nova.network.neutron [req-b3163c7c-dbf5-4028-b57c-54e4bcf373fe req-71ae5055-4acd-4e6b-b152-e3f39e766f55 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Refreshing network info cache for port 0b98ada0-5b93-4278-b257-bbaa11248c9c {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:59:02 user nova-compute[73010]: DEBUG nova.network.neutron [req-b3163c7c-dbf5-4028-b57c-54e4bcf373fe req-71ae5055-4acd-4e6b-b152-e3f39e766f55 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Updated VIF entry in instance network info cache for port 0b98ada0-5b93-4278-b257-bbaa11248c9c. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:59:02 user nova-compute[73010]: DEBUG nova.network.neutron [req-b3163c7c-dbf5-4028-b57c-54e4bcf373fe req-71ae5055-4acd-4e6b-b152-e3f39e766f55 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Updating instance_info_cache with network_info: [{"id": "0b98ada0-5b93-4278-b257-bbaa11248c9c", "address": "fa:16:3e:76:8a:ae", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b98ada0-5b", "ovs_interfaceid": "0b98ada0-5b93-4278-b257-bbaa11248c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:59:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-b3163c7c-dbf5-4028-b57c-54e4bcf373fe req-71ae5055-4acd-4e6b-b152-e3f39e766f55 service nova] Releasing lock "refresh_cache-5eed2924-cb4a-453b-b90c-07f1e4603637" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:59:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "5eed2924-cb4a-453b-b90c-07f1e4603637" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:59:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "5eed2924-cb4a-453b-b90c-07f1e4603637" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:59:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:59:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:59:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:59:03 user nova-compute[73010]: INFO nova.compute.manager [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Terminating instance
Aug 15 00:59:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:59:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:03 user nova-compute[73010]: DEBUG nova.compute.manager [req-48178019-5b3d-4f2f-82b1-6989e53b4346 req-dc94e572-2a3a-4b80-9d66-b22d0032e944 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Received event network-vif-unplugged-0b98ada0-5b93-4278-b257-bbaa11248c9c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:59:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-48178019-5b3d-4f2f-82b1-6989e53b4346 req-dc94e572-2a3a-4b80-9d66-b22d0032e944 service nova] Acquiring lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:59:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-48178019-5b3d-4f2f-82b1-6989e53b4346 req-dc94e572-2a3a-4b80-9d66-b22d0032e944 service nova] Lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:59:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-48178019-5b3d-4f2f-82b1-6989e53b4346 req-dc94e572-2a3a-4b80-9d66-b22d0032e944 service nova] Lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:59:03 user nova-compute[73010]: DEBUG nova.compute.manager [req-48178019-5b3d-4f2f-82b1-6989e53b4346 req-dc94e572-2a3a-4b80-9d66-b22d0032e944 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] No waiting events found dispatching network-vif-unplugged-0b98ada0-5b93-4278-b257-bbaa11248c9c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:59:03 user nova-compute[73010]: DEBUG nova.compute.manager [req-48178019-5b3d-4f2f-82b1-6989e53b4346 req-dc94e572-2a3a-4b80-9d66-b22d0032e944 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Received event network-vif-unplugged-0b98ada0-5b93-4278-b257-bbaa11248c9c for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:04 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Instance destroyed successfully.
Aug 15 00:59:04 user nova-compute[73010]: DEBUG nova.objects.instance [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lazy-loading 'resources' on Instance uuid 5eed2924-cb4a-453b-b90c-07f1e4603637 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:57:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-476276858',display_name='tempest-TestVolumeBootPattern-server-476276858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-476276858',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1zaN+b+VydDVLamZvE8X1Kd/Q5Q2Sojr9sHX021PLtuvBNvO93jAR1znkRwvthrtxRfhwBKAX8n8oRWo/mH1ipr8A9qzs9a0e/tyPo6tpDcd6aKpdp/ZnfjKtEL/p1Mg==',key_name='tempest-TestVolumeBootPattern-1981746338',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:57:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f67d1031d3cb4c8fb66342a7888ca1c4',ramdisk_id='',reservation_id='r-x5mf80yk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1953358779',owner_user_name='tempest-TestVolumeBootPattern-1953358779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:57:26Z,user_data=None,user_id='daa4eb788f724a6fbf908b029315a02b',uuid=5eed2924-cb4a-453b-b90c-07f1e4603637,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b98ada0-5b93-4278-b257-bbaa11248c9c", "address": "fa:16:3e:76:8a:ae", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b98ada0-5b", "ovs_interfaceid": "0b98ada0-5b93-4278-b257-bbaa11248c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converting VIF {"id": "0b98ada0-5b93-4278-b257-bbaa11248c9c", "address": "fa:16:3e:76:8a:ae", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b98ada0-5b", "ovs_interfaceid": "0b98ada0-5b93-4278-b257-bbaa11248c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:8a:ae,bridge_name='br-int',has_traffic_filtering=True,id=0b98ada0-5b93-4278-b257-bbaa11248c9c,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b98ada0-5b') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG os_vif [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:8a:ae,bridge_name='br-int',has_traffic_filtering=True,id=0b98ada0-5b93-4278-b257-bbaa11248c9c,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b98ada0-5b') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b98ada0-5b, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:04 user nova-compute[73010]: INFO os_vif [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:8a:ae,bridge_name='br-int',has_traffic_filtering=True,id=0b98ada0-5b93-4278-b257-bbaa11248c9c,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b98ada0-5b')
Aug 15 00:59:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YtmOlWJi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:59:04 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 00:59:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a42bf3-10de-4f08-96a7-1cd1765886ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e420d29-233d-41db-b16c-185a8d7544e4]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 00:59:04 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 00:59:04 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec3034bac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f'): ({'sdc'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Removing single pathed devices sdc {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[912cc9e0-1cb4-46cf-b3e1-535ec8bfd0fa]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d4290b-cd71-4c5d-967a-a3f19714978d]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Flushing IO for device /dev/sdc {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddd0f97-bf5f-4d4e-a305-87651e7eb4af]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c108214-faee-4381-bc7f-2389b0a20b38]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] SCSI volumes sdc have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c07c35-456c-4162-82a6-99d6ed7ef5d9]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb85dc5-18e9-4390-8a85-339b32d87737]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f, portal: 172.16.0.220,3260]
Aug 15 00:59:04 user nova-compute[73010]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f, portal: 172.16.0.220,3260] successful.
Aug 15 00:59:04 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[436b3987-269c-4be4-9404-651217287e54]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] <== disconnect_volume: return (316ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 00:59:04 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Deleting instance files /opt/stack/data/nova/instances/5eed2924-cb4a-453b-b90c-07f1e4603637_del
Aug 15 00:59:04 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Deletion of /opt/stack/data/nova/instances/5eed2924-cb4a-453b-b90c-07f1e4603637_del complete
Aug 15 00:59:04 user nova-compute[73010]: INFO nova.compute.manager [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 15 00:59:04 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:59:04 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:59:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:05 user nova-compute[73010]: DEBUG nova.compute.manager [None req-4d443a25-543d-4c6b-ba32-712e25369dce tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:59:05 user nova-compute[73010]: INFO nova.compute.manager [None req-4d443a25-543d-4c6b-ba32-712e25369dce tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] instance snapshotting
Aug 15 00:59:05 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-4d443a25-543d-4c6b-ba32-712e25369dce tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Beginning live snapshot process
Aug 15 00:59:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4d443a25-543d-4c6b-ba32-712e25369dce tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json -f qcow2 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:59:05 user nova-compute[73010]: DEBUG nova.compute.manager [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Received event network-vif-plugged-0b98ada0-5b93-4278-b257-bbaa11248c9c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:59:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] Acquiring lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:59:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] Lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:59:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] Lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:59:05 user nova-compute[73010]: DEBUG nova.compute.manager [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] No waiting events found dispatching network-vif-plugged-0b98ada0-5b93-4278-b257-bbaa11248c9c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:59:05 user nova-compute[73010]: WARNING nova.compute.manager [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Received unexpected event network-vif-plugged-0b98ada0-5b93-4278-b257-bbaa11248c9c for instance with vm_state active and task_state deleting.
Aug 15 00:59:05 user nova-compute[73010]: DEBUG nova.compute.manager [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Received event network-vif-plugged-0b98ada0-5b93-4278-b257-bbaa11248c9c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:59:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] Acquiring lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:59:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] Lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:59:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] Lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:59:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] No waiting events found dispatching network-vif-plugged-0b98ada0-5b93-4278-b257-bbaa11248c9c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:59:06 user nova-compute[73010]: WARNING nova.compute.manager [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Received unexpected event network-vif-plugged-0b98ada0-5b93-4278-b257-bbaa11248c9c for instance with vm_state active and task_state deleting.
Aug 15 00:59:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Received event network-vif-plugged-0b98ada0-5b93-4278-b257-bbaa11248c9c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:59:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] Acquiring lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:59:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] Lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:59:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] Lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:59:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] No waiting events found dispatching network-vif-plugged-0b98ada0-5b93-4278-b257-bbaa11248c9c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:59:06 user nova-compute[73010]: WARNING nova.compute.manager [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Received unexpected event network-vif-plugged-0b98ada0-5b93-4278-b257-bbaa11248c9c for instance with vm_state active and task_state deleting.
Aug 15 00:59:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Received event network-vif-unplugged-0b98ada0-5b93-4278-b257-bbaa11248c9c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:59:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] Acquiring lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:59:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] Lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:59:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] Lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:59:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] No waiting events found dispatching network-vif-unplugged-0b98ada0-5b93-4278-b257-bbaa11248c9c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:59:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Received event network-vif-unplugged-0b98ada0-5b93-4278-b257-bbaa11248c9c for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:59:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Received event network-vif-plugged-0b98ada0-5b93-4278-b257-bbaa11248c9c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:59:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] Acquiring lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:59:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] Lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:59:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] Lock "5eed2924-cb4a-453b-b90c-07f1e4603637-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:59:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] No waiting events found dispatching network-vif-plugged-0b98ada0-5b93-4278-b257-bbaa11248c9c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:59:06 user nova-compute[73010]: WARNING nova.compute.manager [req-34ab4149-f884-4eba-9700-7f97b70ef99b req-c30e9789-cf64-48ff-8945-4f18fdcd3345 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Received unexpected event network-vif-plugged-0b98ada0-5b93-4278-b257-bbaa11248c9c for instance with vm_state active and task_state deleting.
Aug 15 00:59:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4d443a25-543d-4c6b-ba32-712e25369dce tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json -f qcow2" returned: 0 in 0.227s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:59:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4d443a25-543d-4c6b-ba32-712e25369dce tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json -f qcow2 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:59:06 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:59:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4d443a25-543d-4c6b-ba32-712e25369dce tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json -f qcow2" returned: 0 in 0.217s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:59:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4d443a25-543d-4c6b-ba32-712e25369dce tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:59:06 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Took 1.61 seconds to deallocate network for instance.
Aug 15 00:59:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-1dbbe9e9-9417-4ba5-b477-e2507c0ced8f req-00513ea4-504d-48fc-839b-bf08bb2af515 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Received event network-vif-deleted-0b98ada0-5b93-4278-b257-bbaa11248c9c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:59:06 user nova-compute[73010]: INFO nova.compute.manager [req-1dbbe9e9-9417-4ba5-b477-e2507c0ced8f req-00513ea4-504d-48fc-839b-bf08bb2af515 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Neutron deleted interface 0b98ada0-5b93-4278-b257-bbaa11248c9c; detaching it from the instance and deleting it from the info cache
Aug 15 00:59:06 user nova-compute[73010]: DEBUG nova.network.neutron [req-1dbbe9e9-9417-4ba5-b477-e2507c0ced8f req-00513ea4-504d-48fc-839b-bf08bb2af515 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:59:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-1dbbe9e9-9417-4ba5-b477-e2507c0ced8f req-00513ea4-504d-48fc-839b-bf08bb2af515 service nova] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Detach interface failed, port_id=0b98ada0-5b93-4278-b257-bbaa11248c9c, reason: Instance 5eed2924-cb4a-453b-b90c-07f1e4603637 could not be found. {{(pid=73010) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 00:59:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4d443a25-543d-4c6b-ba32-712e25369dce tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.191s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:59:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4d443a25-543d-4c6b-ba32-712e25369dce tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptmok1uzt/3ea492ca1c6e4b3ab8dd78fd4c4b079d.delta 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:59:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4d443a25-543d-4c6b-ba32-712e25369dce tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptmok1uzt/3ea492ca1c6e4b3ab8dd78fd4c4b079d.delta 1073741824" returned: 0 in 0.061s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:59:06 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-4d443a25-543d-4c6b-ba32-712e25369dce tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 00:59:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:07 user nova-compute[73010]: INFO nova.compute.manager [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Took 0.81 seconds to detach 1 volumes for instance.
Aug 15 00:59:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:59:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:59:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-4d443a25-543d-4c6b-ba32-712e25369dce tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] COPY block job progress, current cursor: 720896 final cursor: 75497472 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 00:59:07 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:59:07 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:59:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:59:07 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Deleted allocations for instance 5eed2924-cb4a-453b-b90c-07f1e4603637
Aug 15 00:59:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fb642a71-9a69-4ace-9b7d-96ec459f76e7 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "5eed2924-cb4a-453b-b90c-07f1e4603637" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.227s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:59:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-4d443a25-543d-4c6b-ba32-712e25369dce tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 00:59:07 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-4d443a25-543d-4c6b-ba32-712e25369dce tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 00:59:08 user nova-compute[73010]: DEBUG nova.privsep.utils [None req-4d443a25-543d-4c6b-ba32-712e25369dce tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73010) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 00:59:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4d443a25-543d-4c6b-ba32-712e25369dce tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptmok1uzt/3ea492ca1c6e4b3ab8dd78fd4c4b079d.delta /opt/stack/data/nova/instances/snapshots/tmptmok1uzt/3ea492ca1c6e4b3ab8dd78fd4c4b079d {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:59:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-4d443a25-543d-4c6b-ba32-712e25369dce tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptmok1uzt/3ea492ca1c6e4b3ab8dd78fd4c4b079d.delta /opt/stack/data/nova/instances/snapshots/tmptmok1uzt/3ea492ca1c6e4b3ab8dd78fd4c4b079d" returned: 0 in 0.832s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:59:08 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-4d443a25-543d-4c6b-ba32-712e25369dce tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Snapshot extracted, beginning image upload
Aug 15 00:59:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ede7052-132e-44a3-a414-98f4a155592f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "08a1c553-db53-4559-bac1-4e84ac05e2ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ede7052-132e-44a3-a414-98f4a155592f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ede7052-132e-44a3-a414-98f4a155592f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ede7052-132e-44a3-a414-98f4a155592f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ede7052-132e-44a3-a414-98f4a155592f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:59:10 user nova-compute[73010]: INFO nova.compute.manager [None req-1ede7052-132e-44a3-a414-98f4a155592f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Terminating instance
Aug 15 00:59:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-1ede7052-132e-44a3-a414-98f4a155592f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG nova.compute.manager [req-1a4ad5a0-fac6-494c-82e6-212e461dfb3d req-15853ab4-cc09-45e1-9d92-fe469aecf870 service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received event network-vif-unplugged-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1a4ad5a0-fac6-494c-82e6-212e461dfb3d req-15853ab4-cc09-45e1-9d92-fe469aecf870 service nova] Acquiring lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1a4ad5a0-fac6-494c-82e6-212e461dfb3d req-15853ab4-cc09-45e1-9d92-fe469aecf870 service nova] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1a4ad5a0-fac6-494c-82e6-212e461dfb3d req-15853ab4-cc09-45e1-9d92-fe469aecf870 service nova] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG nova.compute.manager [req-1a4ad5a0-fac6-494c-82e6-212e461dfb3d req-15853ab4-cc09-45e1-9d92-fe469aecf870 service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] No waiting events found dispatching network-vif-unplugged-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG nova.compute.manager [req-1a4ad5a0-fac6-494c-82e6-212e461dfb3d req-15853ab4-cc09-45e1-9d92-fe469aecf870 service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received event network-vif-unplugged-cefb1758-4282-491b-b86a-a7de5efd3cca for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:10 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Instance destroyed successfully.
Aug 15 00:59:10 user nova-compute[73010]: DEBUG nova.objects.instance [None req-1ede7052-132e-44a3-a414-98f4a155592f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lazy-loading 'resources' on Instance uuid 08a1c553-db53-4559-bac1-4e84ac05e2ab {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-1ede7052-132e-44a3-a414-98f4a155592f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-755814511',display_name='tempest-TestMinimumBasicScenario-server-755814511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-755814511',id=41,image_ref='8ed9cf2f-f5d5-45f1-a0d9-87b8e168ef81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK72COEAmkJaS4ZoxaUBDOidQX264zJ9KoBQ1gaMrSk9Upn5O385tR1Ezk98nqb2IDrd6+Jtb3Gy7GorpLp76284Lqs1Se85dNWfEinFROG1uZw9ofBcEoskH2sMpUNiFg==',key_name='tempest-TestMinimumBasicScenario-1030082569',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:54:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3103787ed9304a92a5224610d2e8645a',ramdisk_id='',reservation_id='r-2hn5sxob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8ed9cf2f-f5d5-45f1-a0d9-87b8e168ef81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2145836143',owner_user_name='tempest-TestMinimumBasicScenario-2145836143-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:56:28Z,user_data=None,user_id='58496cb5284e45788eb645d0bff01dc8',uuid=08a1c553-db53-4559-bac1-4e84ac05e2ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cefb1758-4282-491b-b86a-a7de5efd3cca", "address": "fa:16:3e:8b:f0:7a", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcefb1758-42", "ovs_interfaceid": "cefb1758-4282-491b-b86a-a7de5efd3cca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-1ede7052-132e-44a3-a414-98f4a155592f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Converting VIF {"id": "cefb1758-4282-491b-b86a-a7de5efd3cca", "address": "fa:16:3e:8b:f0:7a", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcefb1758-42", "ovs_interfaceid": "cefb1758-4282-491b-b86a-a7de5efd3cca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-1ede7052-132e-44a3-a414-98f4a155592f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:f0:7a,bridge_name='br-int',has_traffic_filtering=True,id=cefb1758-4282-491b-b86a-a7de5efd3cca,network=Network(8aef7e84-aa84-4b82-beae-723c69281253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcefb1758-42') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG os_vif [None req-1ede7052-132e-44a3-a414-98f4a155592f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:f0:7a,bridge_name='br-int',has_traffic_filtering=True,id=cefb1758-4282-491b-b86a-a7de5efd3cca,network=Network(8aef7e84-aa84-4b82-beae-723c69281253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcefb1758-42') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcefb1758-42, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:10 user nova-compute[73010]: INFO os_vif [None req-1ede7052-132e-44a3-a414-98f4a155592f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:f0:7a,bridge_name='br-int',has_traffic_filtering=True,id=cefb1758-4282-491b-b86a-a7de5efd3cca,network=Network(8aef7e84-aa84-4b82-beae-723c69281253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcefb1758-42')
Aug 15 00:59:10 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-1ede7052-132e-44a3-a414-98f4a155592f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Deleting instance files /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab_del
Aug 15 00:59:10 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-1ede7052-132e-44a3-a414-98f4a155592f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Deletion of /opt/stack/data/nova/instances/08a1c553-db53-4559-bac1-4e84ac05e2ab_del complete
Aug 15 00:59:11 user nova-compute[73010]: INFO nova.compute.manager [None req-1ede7052-132e-44a3-a414-98f4a155592f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 15 00:59:11 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-1ede7052-132e-44a3-a414-98f4a155592f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 00:59:11 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 00:59:11 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 00:59:11 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-4d443a25-543d-4c6b-ba32-712e25369dce tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Snapshot image upload complete
Aug 15 00:59:11 user nova-compute[73010]: INFO nova.compute.manager [None req-4d443a25-543d-4c6b-ba32-712e25369dce tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Took 5.69 seconds to snapshot the instance on the hypervisor.
Aug 15 00:59:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:11 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:59:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:11 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Took 0.59 seconds to deallocate network for instance.
Aug 15 00:59:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-d399b63b-a328-4c3f-a801-631ef6048446 req-b89ebab4-2efe-4587-b917-83304a4c25b9 service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received event network-vif-deleted-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:59:11 user nova-compute[73010]: INFO nova.compute.manager [req-d399b63b-a328-4c3f-a801-631ef6048446 req-b89ebab4-2efe-4587-b917-83304a4c25b9 service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Neutron deleted interface cefb1758-4282-491b-b86a-a7de5efd3cca; detaching it from the instance and deleting it from the info cache
Aug 15 00:59:11 user nova-compute[73010]: DEBUG nova.network.neutron [req-d399b63b-a328-4c3f-a801-631ef6048446 req-b89ebab4-2efe-4587-b917-83304a4c25b9 service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:59:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-d399b63b-a328-4c3f-a801-631ef6048446 req-b89ebab4-2efe-4587-b917-83304a4c25b9 service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Detach interface failed, port_id=cefb1758-4282-491b-b86a-a7de5efd3cca, reason: Instance 08a1c553-db53-4559-bac1-4e84ac05e2ab could not be found. {{(pid=73010) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 00:59:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ede7052-132e-44a3-a414-98f4a155592f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:59:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ede7052-132e-44a3-a414-98f4a155592f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:59:11 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-1ede7052-132e-44a3-a414-98f4a155592f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:59:11 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-1ede7052-132e-44a3-a414-98f4a155592f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:59:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ede7052-132e-44a3-a414-98f4a155592f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:59:11 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-1ede7052-132e-44a3-a414-98f4a155592f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Deleted allocations for instance 08a1c553-db53-4559-bac1-4e84ac05e2ab
Aug 15 00:59:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1ede7052-132e-44a3-a414-98f4a155592f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.835s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:59:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-a282cc9c-6659-4315-8369-4461f5dd00de req-10a582e1-3c4a-4b38-83c2-f4e8581d4cba service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received event network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:59:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a282cc9c-6659-4315-8369-4461f5dd00de req-10a582e1-3c4a-4b38-83c2-f4e8581d4cba service nova] Acquiring lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:59:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a282cc9c-6659-4315-8369-4461f5dd00de req-10a582e1-3c4a-4b38-83c2-f4e8581d4cba service nova] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:59:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a282cc9c-6659-4315-8369-4461f5dd00de req-10a582e1-3c4a-4b38-83c2-f4e8581d4cba service nova] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:59:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-a282cc9c-6659-4315-8369-4461f5dd00de req-10a582e1-3c4a-4b38-83c2-f4e8581d4cba service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] No waiting events found dispatching network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:59:12 user nova-compute[73010]: WARNING nova.compute.manager [req-a282cc9c-6659-4315-8369-4461f5dd00de req-10a582e1-3c4a-4b38-83c2-f4e8581d4cba service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received unexpected event network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca for instance with vm_state deleted and task_state None.
Aug 15 00:59:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-a282cc9c-6659-4315-8369-4461f5dd00de req-10a582e1-3c4a-4b38-83c2-f4e8581d4cba service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received event network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:59:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a282cc9c-6659-4315-8369-4461f5dd00de req-10a582e1-3c4a-4b38-83c2-f4e8581d4cba service nova] Acquiring lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:59:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a282cc9c-6659-4315-8369-4461f5dd00de req-10a582e1-3c4a-4b38-83c2-f4e8581d4cba service nova] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:59:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a282cc9c-6659-4315-8369-4461f5dd00de req-10a582e1-3c4a-4b38-83c2-f4e8581d4cba service nova] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:59:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-a282cc9c-6659-4315-8369-4461f5dd00de req-10a582e1-3c4a-4b38-83c2-f4e8581d4cba service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] No waiting events found dispatching network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:59:12 user nova-compute[73010]: WARNING nova.compute.manager [req-a282cc9c-6659-4315-8369-4461f5dd00de req-10a582e1-3c4a-4b38-83c2-f4e8581d4cba service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received unexpected event network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca for instance with vm_state deleted and task_state None.
Aug 15 00:59:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-a282cc9c-6659-4315-8369-4461f5dd00de req-10a582e1-3c4a-4b38-83c2-f4e8581d4cba service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received event network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:59:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a282cc9c-6659-4315-8369-4461f5dd00de req-10a582e1-3c4a-4b38-83c2-f4e8581d4cba service nova] Acquiring lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:59:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a282cc9c-6659-4315-8369-4461f5dd00de req-10a582e1-3c4a-4b38-83c2-f4e8581d4cba service nova] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:59:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a282cc9c-6659-4315-8369-4461f5dd00de req-10a582e1-3c4a-4b38-83c2-f4e8581d4cba service nova] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:59:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-a282cc9c-6659-4315-8369-4461f5dd00de req-10a582e1-3c4a-4b38-83c2-f4e8581d4cba service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] No waiting events found dispatching network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:59:12 user nova-compute[73010]: WARNING nova.compute.manager [req-a282cc9c-6659-4315-8369-4461f5dd00de req-10a582e1-3c4a-4b38-83c2-f4e8581d4cba service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received unexpected event network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca for instance with vm_state deleted and task_state None.
Aug 15 00:59:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-a282cc9c-6659-4315-8369-4461f5dd00de req-10a582e1-3c4a-4b38-83c2-f4e8581d4cba service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received event network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:59:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a282cc9c-6659-4315-8369-4461f5dd00de req-10a582e1-3c4a-4b38-83c2-f4e8581d4cba service nova] Acquiring lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:59:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a282cc9c-6659-4315-8369-4461f5dd00de req-10a582e1-3c4a-4b38-83c2-f4e8581d4cba service nova] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:59:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a282cc9c-6659-4315-8369-4461f5dd00de req-10a582e1-3c4a-4b38-83c2-f4e8581d4cba service nova] Lock "08a1c553-db53-4559-bac1-4e84ac05e2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:59:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-a282cc9c-6659-4315-8369-4461f5dd00de req-10a582e1-3c4a-4b38-83c2-f4e8581d4cba service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] No waiting events found dispatching network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 00:59:12 user nova-compute[73010]: WARNING nova.compute.manager [req-a282cc9c-6659-4315-8369-4461f5dd00de req-10a582e1-3c4a-4b38-83c2-f4e8581d4cba service nova] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Received unexpected event network-vif-plugged-cefb1758-4282-491b-b86a-a7de5efd3cca for instance with vm_state deleted and task_state None.
Aug 15 00:59:12 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:59:12 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:59:12 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 00:59:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-d79e3854-769c-430a-b980-3a551c7ee34d" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:59:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-d79e3854-769c-430a-b980-3a551c7ee34d" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:59:12 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 00:59:13 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Updating instance_info_cache with network_info: [{"id": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "address": "fa:16:3e:07:08:aa", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1f2867-31", "ovs_interfaceid": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:59:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-d79e3854-769c-430a-b980-3a551c7ee34d" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:59:13 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 00:59:13 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:59:13 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:59:14 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:59:14 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:59:14 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 00:59:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:17 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:59:18 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 00:59:19 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692061144.4296947, 5eed2924-cb4a-453b-b90c-07f1e4603637 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:59:19 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] VM Stopped (Lifecycle Event)
Aug 15 00:59:19 user nova-compute[73010]: DEBUG nova.compute.manager [None req-6f09a356-3ab1-4273-b326-98922cdb9a00 None None] [instance: 5eed2924-cb4a-453b-b90c-07f1e4603637] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:59:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:59:25 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692061150.9189677, 08a1c553-db53-4559-bac1-4e84ac05e2ab => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 00:59:25 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] VM Stopped (Lifecycle Event)
Aug 15 00:59:25 user nova-compute[73010]: DEBUG nova.compute.manager [None req-cc791a63-13d4-409f-8d30-c7e0552d9059 None None] [instance: 08a1c553-db53-4559-bac1-4e84ac05e2ab] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 00:59:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:59:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 00:59:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:59:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:59:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:59:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 00:59:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:59:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:59:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:59:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:59:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:59:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 00:59:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 00:59:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:59:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 00:59:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "634979eb-b706-4bdd-bb72-c2d163d3f8c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:59:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "634979eb-b706-4bdd-bb72-c2d163d3f8c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:59:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 00:59:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 00:59:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 00:59:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 00:59:54 user nova-compute[73010]: INFO nova.compute.claims [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Claim successful on node user
Aug 15 00:59:54 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 00:59:54 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 00:59:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.230s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 00:59:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 00:59:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 00:59:54 user nova-compute[73010]: DEBUG nova.network.neutron [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 00:59:54 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 00:59:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 00:59:55 user nova-compute[73010]: INFO nova.virt.block_device [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Booting with volume 048aabec-0774-43ba-b0e0-68effb43d98f at /dev/vda
Aug 15 00:59:55 user nova-compute[73010]: DEBUG nova.policy [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'daa4eb788f724a6fbf908b029315a02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67d1031d3cb4c8fb66342a7888ca1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 00:59:55 user nova-compute[73010]: DEBUG os_brick.utils [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 00:59:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:59:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:59:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d15dfe-4a80-4330-a2a7-5a2f61efa873]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:59:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:59:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:59:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c60783-9901-45a0-a3b9-ecb5a501ac6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:59:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:59:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 00:59:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cadd99-3138-4473-a3cb-7d3423722610]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:59:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b16c62-7eba-4e27-8a11-921e80a7a0dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:59:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:59:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:59:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 00:59:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 00:59:55 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 00:59:55 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 00:59:55 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dafaf9d-7703-4404-8f75-2f84001b0184]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 00:59:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 00:59:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 00:59:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 00:59:55 user nova-compute[73010]: DEBUG os_brick.utils [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 00:59:55 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Updating existing volume attachment record: f67d5105-6011-4957-930b-5ea2f52db888 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 00:59:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:55 user nova-compute[73010]: DEBUG nova.network.neutron [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Successfully created port: a0d42bd2-1517-4cc8-9783-b7d6f124c301 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 00:59:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 00:59:56 user nova-compute[73010]: DEBUG nova.network.neutron [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Successfully updated port: a0d42bd2-1517-4cc8-9783-b7d6f124c301 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 00:59:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "refresh_cache-634979eb-b706-4bdd-bb72-c2d163d3f8c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:59:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquired lock "refresh_cache-634979eb-b706-4bdd-bb72-c2d163d3f8c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:59:56 user nova-compute[73010]: DEBUG nova.network.neutron [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 00:59:56 user nova-compute[73010]: DEBUG nova.compute.manager [req-8c4f9b4b-f7e9-4a1a-9fdc-2141f5ef4c52 req-558c3f80-dbff-4bf2-ae2f-01defc84f15f service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Received event network-changed-a0d42bd2-1517-4cc8-9783-b7d6f124c301 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 00:59:56 user nova-compute[73010]: DEBUG nova.compute.manager [req-8c4f9b4b-f7e9-4a1a-9fdc-2141f5ef4c52 req-558c3f80-dbff-4bf2-ae2f-01defc84f15f service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Refreshing instance network info cache due to event network-changed-a0d42bd2-1517-4cc8-9783-b7d6f124c301. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 00:59:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-8c4f9b4b-f7e9-4a1a-9fdc-2141f5ef4c52 req-558c3f80-dbff-4bf2-ae2f-01defc84f15f service nova] Acquiring lock "refresh_cache-634979eb-b706-4bdd-bb72-c2d163d3f8c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 00:59:56 user nova-compute[73010]: DEBUG nova.network.neutron [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 00:59:56 user nova-compute[73010]: DEBUG nova.network.neutron [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Updating instance_info_cache with network_info: [{"id": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "address": "fa:16:3e:29:2e:78", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d42bd2-15", "ovs_interfaceid": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:59:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Releasing lock "refresh_cache-634979eb-b706-4bdd-bb72-c2d163d3f8c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 00:59:56 user nova-compute[73010]: DEBUG nova.compute.manager [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Instance network_info: |[{"id": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "address": "fa:16:3e:29:2e:78", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d42bd2-15", "ovs_interfaceid": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 00:59:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-8c4f9b4b-f7e9-4a1a-9fdc-2141f5ef4c52 req-558c3f80-dbff-4bf2-ae2f-01defc84f15f service nova] Acquired lock "refresh_cache-634979eb-b706-4bdd-bb72-c2d163d3f8c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 00:59:56 user nova-compute[73010]: DEBUG nova.network.neutron [req-8c4f9b4b-f7e9-4a1a-9fdc-2141f5ef4c52 req-558c3f80-dbff-4bf2-ae2f-01defc84f15f service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Refreshing network info cache for port a0d42bd2-1517-4cc8-9783-b7d6f124c301 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 00:59:57 user nova-compute[73010]: DEBUG nova.network.neutron [req-8c4f9b4b-f7e9-4a1a-9fdc-2141f5ef4c52 req-558c3f80-dbff-4bf2-ae2f-01defc84f15f service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Updated VIF entry in instance network info cache for port a0d42bd2-1517-4cc8-9783-b7d6f124c301. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 00:59:57 user nova-compute[73010]: DEBUG nova.network.neutron [req-8c4f9b4b-f7e9-4a1a-9fdc-2141f5ef4c52 req-558c3f80-dbff-4bf2-ae2f-01defc84f15f service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Updating instance_info_cache with network_info: [{"id": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "address": "fa:16:3e:29:2e:78", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d42bd2-15", "ovs_interfaceid": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 00:59:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-8c4f9b4b-f7e9-4a1a-9fdc-2141f5ef4c52 req-558c3f80-dbff-4bf2-ae2f-01defc84f15f service nova] Releasing lock "refresh_cache-634979eb-b706-4bdd-bb72-c2d163d3f8c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:00:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:00:01 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:00:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:00:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:00:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:00:01 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:00:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:02 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:02 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:00:02 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:00:02 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8527MB free_disk=25.54297637939453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:00:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:00:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:00:02 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance d79e3854-769c-430a-b980-3a551c7ee34d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:00:02 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 20d92360-d4f7-4f17-8a32-fb901dd8feb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:00:02 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 634979eb-b706-4bdd-bb72-c2d163d3f8c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:00:02 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:00:02 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:00:02 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 01:00:03 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Creating image(s)
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Did not create local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Ensure instance console log exists: /opt/stack/data/nova/instances/634979eb-b706-4bdd-bb72-c2d163d3f8c9/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Start _get_guest_xml network_info=[{"id": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "address": "fa:16:3e:29:2e:78", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d42bd2-15", "ovs_interfaceid": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YtmOlWJi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '634979eb-b706-4bdd-bb72-c2d163d3f8c9', 'attached_at': '', 'detached_at': '', 'volume_id': '048aabec-0774-43ba-b0e0-68effb43d98f', 'serial': '048aabec-0774-43ba-b0e0-68effb43d98f'}, 'disk_bus': 'virtio', 'attachment_id': 'f67d5105-6011-4957-930b-5ea2f52db888', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 01:00:03 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:00:03 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YtmOlWJi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:00:03 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:00:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:00:03 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:00:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:00:03 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "6b931225-177c-4b6c-9989-8e036ad58987" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "6b931225-177c-4b6c-9989-8e036ad58987" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64faa57-2a20-4049-8c42-fe1696f36508]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 01:00:03 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7eb6225-c217-4b7a-8067-be53c94ef2ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f] added
Aug 15 01:00:03 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01317bf-b607-4540-a6e6-8afca2eacecd]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d57f279-0f9c-4772-abb2-0569d257605b]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YtmOlWJi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YtmOlWJi" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a78464b-6453-4304-905c-a05fdbfd7ed0]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YtmOlWJi'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 01:00:03 user nova-compute[73010]: INFO nova.compute.claims [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Claim successful on node user
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2217fad4-1cb3-4e41-8411-06b64feb035f]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[96742918-ae38-4763-907c-6401adb689a3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 01:00:03 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 01:00:03 user nova-compute[73010]:  {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:00:03 user nova-compute[73010]: WARNING os_brick.initiator.connectors.iscsi [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 01:00:03 user nova-compute[73010]: 
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bcf806-882c-48b9-a8e1-f87650c28ef2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f, portal: 172.16.0.220,3260]
Aug 15 01:00:03 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f, portal: 172.16.0.220,3260] successful.
Aug 15 01:00:03 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9799453e-dc35-4a47-916c-76a2fc9bcd24]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[80220dfb-b637-4387-8790-15e585879479]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:00:03 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:00:03 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 01:00:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:04 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5409aab0-b5b7-41da-af93-9c17b5560ceb]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:04 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 01:00:04 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YtmOlWJi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 01:00:04 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:00:04 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:00:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.252s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:00:04 user nova-compute[73010]: DEBUG nova.compute.manager [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 01:00:04 user nova-compute[73010]: DEBUG nova.compute.manager [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 01:00:04 user nova-compute[73010]: DEBUG nova.network.neutron [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 01:00:04 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 01:00:04 user nova-compute[73010]: DEBUG nova.compute.manager [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 01:00:04 user nova-compute[73010]: DEBUG nova.policy [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58496cb5284e45788eb645d0bff01dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103787ed9304a92a5224610d2e8645a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 01:00:04 user nova-compute[73010]: DEBUG nova.compute.manager [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 01:00:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 01:00:04 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Creating image(s)
Aug 15 01:00:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:00:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "/opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:00:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "/opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:00:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "205dce7ddd41cb9dec4259d0967eba5cc02f59b1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:00:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "205dce7ddd41cb9dec4259d0967eba5cc02f59b1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:00:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/205dce7ddd41cb9dec4259d0967eba5cc02f59b1.part --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/205dce7ddd41cb9dec4259d0967eba5cc02f59b1.part --force-share --output=json" returned: 0 in 0.189s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:04 user nova-compute[73010]: DEBUG nova.virt.images [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] 40cc5fd5-6bd4-4612-98a3-8a25318367bb was qcow2, converting to raw {{(pid=73010) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 01:00:04 user nova-compute[73010]: DEBUG nova.privsep.utils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73010) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 01:00:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/205dce7ddd41cb9dec4259d0967eba5cc02f59b1.part /opt/stack/data/nova/instances/_base/205dce7ddd41cb9dec4259d0967eba5cc02f59b1.converted {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23164373465343434', 'path': '/dev/sdb'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164373465343434', 'path': '/dev/sdb'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1425881955',display_name='tempest-TestVolumeBootPattern-server-1425881955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1425881955',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1zaN+b+VydDVLamZvE8X1Kd/Q5Q2Sojr9sHX021PLtuvBNvO93jAR1znkRwvthrtxRfhwBKAX8n8oRWo/mH1ipr8A9qzs9a0e/tyPo6tpDcd6aKpdp/ZnfjKtEL/p1Mg==',key_name='tempest-TestVolumeBootPattern-1981746338',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f67d1031d3cb4c8fb66342a7888ca1c4',ramdisk_id='',reservation_id='r-7c3yr3ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1953358779',owner_user_name='tempest-TestVolumeBootPattern-1953358779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:59:55Z,user_data=None,user_id='daa4eb788f724a6fbf908b029315a02b',uuid=634979eb-b706-4bdd-bb72-c2d163d3f8c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "address": "fa:16:3e:29:2e:78", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d42bd2-15", "ovs_interfaceid": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converting VIF {"id": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "address": "fa:16:3e:29:2e:78", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d42bd2-15", "ovs_interfaceid": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:2e:78,bridge_name='br-int',has_traffic_filtering=True,id=a0d42bd2-1517-4cc8-9783-b7d6f124c301,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0d42bd2-15') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG nova.objects.instance [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lazy-loading 'pci_devices' on Instance uuid 634979eb-b706-4bdd-bb72-c2d163d3f8c9 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] End _get_guest_xml xml=<domain type="kvm">
Aug 15 01:00:05 user nova-compute[73010]:   <uuid>634979eb-b706-4bdd-bb72-c2d163d3f8c9</uuid>
Aug 15 01:00:05 user nova-compute[73010]:   <name>instance-0000002d</name>
Aug 15 01:00:05 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 01:00:05 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 01:00:05 user nova-compute[73010]:   <metadata>
Aug 15 01:00:05 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 01:00:05 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 01:00:05 user nova-compute[73010]:       <nova:name>tempest-TestVolumeBootPattern-server-1425881955</nova:name>
Aug 15 01:00:05 user nova-compute[73010]:       <nova:creationTime>2023-08-15 01:00:03</nova:creationTime>
Aug 15 01:00:05 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 01:00:05 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 01:00:05 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 01:00:05 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 01:00:05 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 01:00:05 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 01:00:05 user nova-compute[73010]:       </nova:flavor>
Aug 15 01:00:05 user nova-compute[73010]:       <nova:owner>
Aug 15 01:00:05 user nova-compute[73010]:         <nova:user uuid="daa4eb788f724a6fbf908b029315a02b">tempest-TestVolumeBootPattern-1953358779-project-member</nova:user>
Aug 15 01:00:05 user nova-compute[73010]:         <nova:project uuid="f67d1031d3cb4c8fb66342a7888ca1c4">tempest-TestVolumeBootPattern-1953358779</nova:project>
Aug 15 01:00:05 user nova-compute[73010]:       </nova:owner>
Aug 15 01:00:05 user nova-compute[73010]:       <nova:ports>
Aug 15 01:00:05 user nova-compute[73010]:         <nova:port uuid="a0d42bd2-1517-4cc8-9783-b7d6f124c301">
Aug 15 01:00:05 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 01:00:05 user nova-compute[73010]:         </nova:port>
Aug 15 01:00:05 user nova-compute[73010]:       </nova:ports>
Aug 15 01:00:05 user nova-compute[73010]:     </nova:instance>
Aug 15 01:00:05 user nova-compute[73010]:   </metadata>
Aug 15 01:00:05 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 01:00:05 user nova-compute[73010]:     <system>
Aug 15 01:00:05 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 01:00:05 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 01:00:05 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 01:00:05 user nova-compute[73010]:       <entry name="serial">634979eb-b706-4bdd-bb72-c2d163d3f8c9</entry>
Aug 15 01:00:05 user nova-compute[73010]:       <entry name="uuid">634979eb-b706-4bdd-bb72-c2d163d3f8c9</entry>
Aug 15 01:00:05 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 01:00:05 user nova-compute[73010]:     </system>
Aug 15 01:00:05 user nova-compute[73010]:   </sysinfo>
Aug 15 01:00:05 user nova-compute[73010]:   <os>
Aug 15 01:00:05 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 01:00:05 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 01:00:05 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 01:00:05 user nova-compute[73010]:   </os>
Aug 15 01:00:05 user nova-compute[73010]:   <features>
Aug 15 01:00:05 user nova-compute[73010]:     <acpi/>
Aug 15 01:00:05 user nova-compute[73010]:     <apic/>
Aug 15 01:00:05 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 01:00:05 user nova-compute[73010]:   </features>
Aug 15 01:00:05 user nova-compute[73010]:   <clock offset="utc">
Aug 15 01:00:05 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 01:00:05 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 01:00:05 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 01:00:05 user nova-compute[73010]:   </clock>
Aug 15 01:00:05 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 01:00:05 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 01:00:05 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 01:00:05 user nova-compute[73010]:   </cpu>
Aug 15 01:00:05 user nova-compute[73010]:   <devices>
Aug 15 01:00:05 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 01:00:05 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:00:05 user nova-compute[73010]:       <source dev="/dev/sdb"/>
Aug 15 01:00:05 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 01:00:05 user nova-compute[73010]:       <serial>048aabec-0774-43ba-b0e0-68effb43d98f</serial>
Aug 15 01:00:05 user nova-compute[73010]:     </disk>
Aug 15 01:00:05 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 01:00:05 user nova-compute[73010]:       <mac address="fa:16:3e:29:2e:78"/>
Aug 15 01:00:05 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:00:05 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 01:00:05 user nova-compute[73010]:       <target dev="tapa0d42bd2-15"/>
Aug 15 01:00:05 user nova-compute[73010]:     </interface>
Aug 15 01:00:05 user nova-compute[73010]:     <serial type="pty">
Aug 15 01:00:05 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/634979eb-b706-4bdd-bb72-c2d163d3f8c9/console.log" append="off"/>
Aug 15 01:00:05 user nova-compute[73010]:     </serial>
Aug 15 01:00:05 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 01:00:05 user nova-compute[73010]:     <video>
Aug 15 01:00:05 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:00:05 user nova-compute[73010]:     </video>
Aug 15 01:00:05 user nova-compute[73010]:     <rng model="virtio">
Aug 15 01:00:05 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 01:00:05 user nova-compute[73010]:     </rng>
Aug 15 01:00:05 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 01:00:05 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 01:00:05 user nova-compute[73010]:       <stats period="10"/>
Aug 15 01:00:05 user nova-compute[73010]:     </memballoon>
Aug 15 01:00:05 user nova-compute[73010]:   </devices>
Aug 15 01:00:05 user nova-compute[73010]: </domain>
Aug 15 01:00:05 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1425881955',display_name='tempest-TestVolumeBootPattern-server-1425881955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1425881955',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1zaN+b+VydDVLamZvE8X1Kd/Q5Q2Sojr9sHX021PLtuvBNvO93jAR1znkRwvthrtxRfhwBKAX8n8oRWo/mH1ipr8A9qzs9a0e/tyPo6tpDcd6aKpdp/ZnfjKtEL/p1Mg==',key_name='tempest-TestVolumeBootPattern-1981746338',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f67d1031d3cb4c8fb66342a7888ca1c4',ramdisk_id='',reservation_id='r-7c3yr3ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1953358779',owner_user_name='tempest-TestVolumeBootPattern-1953358779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T00:59:55Z,user_data=None,user_id='daa4eb788f724a6fbf908b029315a02b',uuid=634979eb-b706-4bdd-bb72-c2d163d3f8c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "address": "fa:16:3e:29:2e:78", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d42bd2-15", "ovs_interfaceid": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converting VIF {"id": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "address": "fa:16:3e:29:2e:78", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d42bd2-15", "ovs_interfaceid": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:2e:78,bridge_name='br-int',has_traffic_filtering=True,id=a0d42bd2-1517-4cc8-9783-b7d6f124c301,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0d42bd2-15') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG os_vif [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:2e:78,bridge_name='br-int',has_traffic_filtering=True,id=a0d42bd2-1517-4cc8-9783-b7d6f124c301,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0d42bd2-15') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0d42bd2-15, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa0d42bd2-15, col_values=(('external_ids', {'iface-id': 'a0d42bd2-1517-4cc8-9783-b7d6f124c301', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:2e:78', 'vm-uuid': '634979eb-b706-4bdd-bb72-c2d163d3f8c9'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:05 user nova-compute[73010]: INFO os_vif [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:2e:78,bridge_name='br-int',has_traffic_filtering=True,id=a0d42bd2-1517-4cc8-9783-b7d6f124c301,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0d42bd2-15')
Aug 15 01:00:05 user nova-compute[73010]: DEBUG nova.network.neutron [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Successfully created port: c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/205dce7ddd41cb9dec4259d0967eba5cc02f59b1.part /opt/stack/data/nova/instances/_base/205dce7ddd41cb9dec4259d0967eba5cc02f59b1.converted" returned: 0 in 0.262s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/205dce7ddd41cb9dec4259d0967eba5cc02f59b1.converted --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] No VIF found with MAC fa:16:3e:29:2e:78, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/205dce7ddd41cb9dec4259d0967eba5cc02f59b1.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "205dce7ddd41cb9dec4259d0967eba5cc02f59b1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.062s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/205dce7ddd41cb9dec4259d0967eba5cc02f59b1 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/205dce7ddd41cb9dec4259d0967eba5cc02f59b1 --force-share --output=json" returned: 0 in 0.211s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "205dce7ddd41cb9dec4259d0967eba5cc02f59b1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "205dce7ddd41cb9dec4259d0967eba5cc02f59b1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/205dce7ddd41cb9dec4259d0967eba5cc02f59b1 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/205dce7ddd41cb9dec4259d0967eba5cc02f59b1 --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/205dce7ddd41cb9dec4259d0967eba5cc02f59b1,backing_fmt=raw /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/205dce7ddd41cb9dec4259d0967eba5cc02f59b1,backing_fmt=raw /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk 1073741824" returned: 0 in 0.147s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "205dce7ddd41cb9dec4259d0967eba5cc02f59b1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:00:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/205dce7ddd41cb9dec4259d0967eba5cc02f59b1 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.network.neutron [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Successfully updated port: c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "refresh_cache-6b931225-177c-4b6c-9989-8e036ad58987" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquired lock "refresh_cache-6b931225-177c-4b6c-9989-8e036ad58987" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.network.neutron [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-238cd5c1-fdd6-4c27-8f6a-868fbf698474 req-dcdf0268-8d40-4b8b-86ee-a6cdd9b472db service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Received event network-changed-c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-238cd5c1-fdd6-4c27-8f6a-868fbf698474 req-dcdf0268-8d40-4b8b-86ee-a6cdd9b472db service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Refreshing instance network info cache due to event network-changed-c94c8a3a-6c88-482c-8c90-86341f11658d. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-238cd5c1-fdd6-4c27-8f6a-868fbf698474 req-dcdf0268-8d40-4b8b-86ee-a6cdd9b472db service nova] Acquiring lock "refresh_cache-6b931225-177c-4b6c-9989-8e036ad58987" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/205dce7ddd41cb9dec4259d0967eba5cc02f59b1 --force-share --output=json" returned: 0 in 0.216s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.network.neutron [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Cannot resize image /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.objects.instance [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lazy-loading 'migration_context' on Instance uuid 6b931225-177c-4b6c-9989-8e036ad58987 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Ensure instance console log exists: /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.network.neutron [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Updating instance_info_cache with network_info: [{"id": "c94c8a3a-6c88-482c-8c90-86341f11658d", "address": "fa:16:3e:b7:84:04", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c8a3a-6c", "ovs_interfaceid": "c94c8a3a-6c88-482c-8c90-86341f11658d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Releasing lock "refresh_cache-6b931225-177c-4b6c-9989-8e036ad58987" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.compute.manager [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Instance network_info: |[{"id": "c94c8a3a-6c88-482c-8c90-86341f11658d", "address": "fa:16:3e:b7:84:04", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c8a3a-6c", "ovs_interfaceid": "c94c8a3a-6c88-482c-8c90-86341f11658d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-238cd5c1-fdd6-4c27-8f6a-868fbf698474 req-dcdf0268-8d40-4b8b-86ee-a6cdd9b472db service nova] Acquired lock "refresh_cache-6b931225-177c-4b6c-9989-8e036ad58987" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.network.neutron [req-238cd5c1-fdd6-4c27-8f6a-868fbf698474 req-dcdf0268-8d40-4b8b-86ee-a6cdd9b472db service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Refreshing network info cache for port c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Start _get_guest_xml network_info=[{"id": "c94c8a3a-6c88-482c-8c90-86341f11658d", "address": "fa:16:3e:b7:84:04", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c8a3a-6c", "ovs_interfaceid": "c94c8a3a-6c88-482c-8c90-86341f11658d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:00:01Z,direct_url=<?>,disk_format='qcow2',id=40cc5fd5-6bd4-4612-98a3-8a25318367bb,min_disk=0,min_ram=0,name='tempest-scenario-img--166019557',owner='3103787ed9304a92a5224610d2e8645a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:00:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '40cc5fd5-6bd4-4612-98a3-8a25318367bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 01:00:06 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:00:06 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:00:01Z,direct_url=<?>,disk_format='qcow2',id=40cc5fd5-6bd4-4612-98a3-8a25318367bb,min_disk=0,min_ram=0,name='tempest-scenario-img--166019557',owner='3103787ed9304a92a5224610d2e8645a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:00:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:00:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1796039906',display_name='tempest-TestMinimumBasicScenario-server-1796039906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1796039906',id=46,image_ref='40cc5fd5-6bd4-4612-98a3-8a25318367bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKw3jtnMWSuPt98NSH+l+ULYp8Ma5pXlJY0JJeurqUEH8Nlw2IrmaxtNfQ23YS5Ob8cURz+RHERbbh51Wx+YzyP3ifGdx/RR0LTznoTGMNFEmPMhPHSf7FT6Rhv0b6KLhg==',key_name='tempest-TestMinimumBasicScenario-969106236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3103787ed9304a92a5224610d2e8645a',ramdisk_id='',reservation_id='r-051bace4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40cc5fd5-6bd4-4612-98a3-8a25318367bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2145836143',owner_user_name='tempest-TestMinimumBasicScenario-2145836143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T01:00:04Z,user_data=None,user_id='58496cb5284e45788eb645d0bff01dc8',uuid=6b931225-177c-4b6c-9989-8e036ad58987,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c94c8a3a-6c88-482c-8c90-86341f11658d", "address": "fa:16:3e:b7:84:04", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c8a3a-6c", "ovs_interfaceid": "c94c8a3a-6c88-482c-8c90-86341f11658d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Converting VIF {"id": "c94c8a3a-6c88-482c-8c90-86341f11658d", "address": "fa:16:3e:b7:84:04", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c8a3a-6c", "ovs_interfaceid": "c94c8a3a-6c88-482c-8c90-86341f11658d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:84:04,bridge_name='br-int',has_traffic_filtering=True,id=c94c8a3a-6c88-482c-8c90-86341f11658d,network=Network(8aef7e84-aa84-4b82-beae-723c69281253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc94c8a3a-6c') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.objects.instance [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b931225-177c-4b6c-9989-8e036ad58987 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] End _get_guest_xml xml=<domain type="kvm">
Aug 15 01:00:06 user nova-compute[73010]:   <uuid>6b931225-177c-4b6c-9989-8e036ad58987</uuid>
Aug 15 01:00:06 user nova-compute[73010]:   <name>instance-0000002e</name>
Aug 15 01:00:06 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 01:00:06 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 01:00:06 user nova-compute[73010]:   <metadata>
Aug 15 01:00:06 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 01:00:06 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 01:00:06 user nova-compute[73010]:       <nova:name>tempest-TestMinimumBasicScenario-server-1796039906</nova:name>
Aug 15 01:00:06 user nova-compute[73010]:       <nova:creationTime>2023-08-15 01:00:06</nova:creationTime>
Aug 15 01:00:06 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 01:00:06 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 01:00:06 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 01:00:06 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 01:00:06 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 01:00:06 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 01:00:06 user nova-compute[73010]:       </nova:flavor>
Aug 15 01:00:06 user nova-compute[73010]:       <nova:owner>
Aug 15 01:00:06 user nova-compute[73010]:         <nova:user uuid="58496cb5284e45788eb645d0bff01dc8">tempest-TestMinimumBasicScenario-2145836143-project-member</nova:user>
Aug 15 01:00:06 user nova-compute[73010]:         <nova:project uuid="3103787ed9304a92a5224610d2e8645a">tempest-TestMinimumBasicScenario-2145836143</nova:project>
Aug 15 01:00:06 user nova-compute[73010]:       </nova:owner>
Aug 15 01:00:06 user nova-compute[73010]:       <nova:root type="image" uuid="40cc5fd5-6bd4-4612-98a3-8a25318367bb"/>
Aug 15 01:00:06 user nova-compute[73010]:       <nova:ports>
Aug 15 01:00:06 user nova-compute[73010]:         <nova:port uuid="c94c8a3a-6c88-482c-8c90-86341f11658d">
Aug 15 01:00:06 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 01:00:06 user nova-compute[73010]:         </nova:port>
Aug 15 01:00:06 user nova-compute[73010]:       </nova:ports>
Aug 15 01:00:06 user nova-compute[73010]:     </nova:instance>
Aug 15 01:00:06 user nova-compute[73010]:   </metadata>
Aug 15 01:00:06 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 01:00:06 user nova-compute[73010]:     <system>
Aug 15 01:00:06 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 01:00:06 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 01:00:06 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 01:00:06 user nova-compute[73010]:       <entry name="serial">6b931225-177c-4b6c-9989-8e036ad58987</entry>
Aug 15 01:00:06 user nova-compute[73010]:       <entry name="uuid">6b931225-177c-4b6c-9989-8e036ad58987</entry>
Aug 15 01:00:06 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 01:00:06 user nova-compute[73010]:     </system>
Aug 15 01:00:06 user nova-compute[73010]:   </sysinfo>
Aug 15 01:00:06 user nova-compute[73010]:   <os>
Aug 15 01:00:06 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 01:00:06 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 01:00:06 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 01:00:06 user nova-compute[73010]:   </os>
Aug 15 01:00:06 user nova-compute[73010]:   <features>
Aug 15 01:00:06 user nova-compute[73010]:     <acpi/>
Aug 15 01:00:06 user nova-compute[73010]:     <apic/>
Aug 15 01:00:06 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 01:00:06 user nova-compute[73010]:   </features>
Aug 15 01:00:06 user nova-compute[73010]:   <clock offset="utc">
Aug 15 01:00:06 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 01:00:06 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 01:00:06 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 01:00:06 user nova-compute[73010]:   </clock>
Aug 15 01:00:06 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 01:00:06 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 01:00:06 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 01:00:06 user nova-compute[73010]:   </cpu>
Aug 15 01:00:06 user nova-compute[73010]:   <devices>
Aug 15 01:00:06 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 01:00:06 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 01:00:06 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk"/>
Aug 15 01:00:06 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 01:00:06 user nova-compute[73010]:     </disk>
Aug 15 01:00:06 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 01:00:06 user nova-compute[73010]:       <mac address="fa:16:3e:b7:84:04"/>
Aug 15 01:00:06 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:00:06 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 01:00:06 user nova-compute[73010]:       <target dev="tapc94c8a3a-6c"/>
Aug 15 01:00:06 user nova-compute[73010]:     </interface>
Aug 15 01:00:06 user nova-compute[73010]:     <serial type="pty">
Aug 15 01:00:06 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/console.log" append="off"/>
Aug 15 01:00:06 user nova-compute[73010]:     </serial>
Aug 15 01:00:06 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 01:00:06 user nova-compute[73010]:     <video>
Aug 15 01:00:06 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:00:06 user nova-compute[73010]:     </video>
Aug 15 01:00:06 user nova-compute[73010]:     <rng model="virtio">
Aug 15 01:00:06 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 01:00:06 user nova-compute[73010]:     </rng>
Aug 15 01:00:06 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 01:00:06 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 01:00:06 user nova-compute[73010]:       <stats period="10"/>
Aug 15 01:00:06 user nova-compute[73010]:     </memballoon>
Aug 15 01:00:06 user nova-compute[73010]:   </devices>
Aug 15 01:00:06 user nova-compute[73010]: </domain>
Aug 15 01:00:06 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:00:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1796039906',display_name='tempest-TestMinimumBasicScenario-server-1796039906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1796039906',id=46,image_ref='40cc5fd5-6bd4-4612-98a3-8a25318367bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKw3jtnMWSuPt98NSH+l+ULYp8Ma5pXlJY0JJeurqUEH8Nlw2IrmaxtNfQ23YS5Ob8cURz+RHERbbh51Wx+YzyP3ifGdx/RR0LTznoTGMNFEmPMhPHSf7FT6Rhv0b6KLhg==',key_name='tempest-TestMinimumBasicScenario-969106236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3103787ed9304a92a5224610d2e8645a',ramdisk_id='',reservation_id='r-051bace4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40cc5fd5-6bd4-4612-98a3-8a25318367bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2145836143',owner_user_name='tempest-TestMinimumBasicScenario-2145836143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T01:00:04Z,user_data=None,user_id='58496cb5284e45788eb645d0bff01dc8',uuid=6b931225-177c-4b6c-9989-8e036ad58987,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c94c8a3a-6c88-482c-8c90-86341f11658d", "address": "fa:16:3e:b7:84:04", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c8a3a-6c", "ovs_interfaceid": "c94c8a3a-6c88-482c-8c90-86341f11658d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Converting VIF {"id": "c94c8a3a-6c88-482c-8c90-86341f11658d", "address": "fa:16:3e:b7:84:04", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c8a3a-6c", "ovs_interfaceid": "c94c8a3a-6c88-482c-8c90-86341f11658d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:84:04,bridge_name='br-int',has_traffic_filtering=True,id=c94c8a3a-6c88-482c-8c90-86341f11658d,network=Network(8aef7e84-aa84-4b82-beae-723c69281253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc94c8a3a-6c') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG os_vif [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:84:04,bridge_name='br-int',has_traffic_filtering=True,id=c94c8a3a-6c88-482c-8c90-86341f11658d,network=Network(8aef7e84-aa84-4b82-beae-723c69281253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc94c8a3a-6c') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc94c8a3a-6c, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc94c8a3a-6c, col_values=(('external_ids', {'iface-id': 'c94c8a3a-6c88-482c-8c90-86341f11658d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:84:04', 'vm-uuid': '6b931225-177c-4b6c-9989-8e036ad58987'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:06 user nova-compute[73010]: INFO os_vif [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:84:04,bridge_name='br-int',has_traffic_filtering=True,id=c94c8a3a-6c88-482c-8c90-86341f11658d,network=Network(8aef7e84-aa84-4b82-beae-723c69281253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc94c8a3a-6c')
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] No VIF found with MAC fa:16:3e:b7:84:04, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-bfde7850-3146-4d0d-a61c-478957763034 req-017d2dfa-8aeb-4558-b48b-2356dfb64ee5 service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Received event network-vif-plugged-a0d42bd2-1517-4cc8-9783-b7d6f124c301 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-bfde7850-3146-4d0d-a61c-478957763034 req-017d2dfa-8aeb-4558-b48b-2356dfb64ee5 service nova] Acquiring lock "634979eb-b706-4bdd-bb72-c2d163d3f8c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-bfde7850-3146-4d0d-a61c-478957763034 req-017d2dfa-8aeb-4558-b48b-2356dfb64ee5 service nova] Lock "634979eb-b706-4bdd-bb72-c2d163d3f8c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-bfde7850-3146-4d0d-a61c-478957763034 req-017d2dfa-8aeb-4558-b48b-2356dfb64ee5 service nova] Lock "634979eb-b706-4bdd-bb72-c2d163d3f8c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:00:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-bfde7850-3146-4d0d-a61c-478957763034 req-017d2dfa-8aeb-4558-b48b-2356dfb64ee5 service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] No waiting events found dispatching network-vif-plugged-a0d42bd2-1517-4cc8-9783-b7d6f124c301 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:00:06 user nova-compute[73010]: WARNING nova.compute.manager [req-bfde7850-3146-4d0d-a61c-478957763034 req-017d2dfa-8aeb-4558-b48b-2356dfb64ee5 service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Received unexpected event network-vif-plugged-a0d42bd2-1517-4cc8-9783-b7d6f124c301 for instance with vm_state building and task_state spawning.
Aug 15 01:00:07 user nova-compute[73010]: DEBUG nova.network.neutron [req-238cd5c1-fdd6-4c27-8f6a-868fbf698474 req-dcdf0268-8d40-4b8b-86ee-a6cdd9b472db service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Updated VIF entry in instance network info cache for port c94c8a3a-6c88-482c-8c90-86341f11658d. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 01:00:07 user nova-compute[73010]: DEBUG nova.network.neutron [req-238cd5c1-fdd6-4c27-8f6a-868fbf698474 req-dcdf0268-8d40-4b8b-86ee-a6cdd9b472db service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Updating instance_info_cache with network_info: [{"id": "c94c8a3a-6c88-482c-8c90-86341f11658d", "address": "fa:16:3e:b7:84:04", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c8a3a-6c", "ovs_interfaceid": "c94c8a3a-6c88-482c-8c90-86341f11658d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:00:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-238cd5c1-fdd6-4c27-8f6a-868fbf698474 req-dcdf0268-8d40-4b8b-86ee-a6cdd9b472db service nova] Releasing lock "refresh_cache-6b931225-177c-4b6c-9989-8e036ad58987" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:00:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:08 user nova-compute[73010]: DEBUG nova.compute.manager [req-f5a00b83-c40b-4a42-9efe-3418cbdd8d73 req-11884397-268b-46b2-8b5d-9b2b0d9a0b50 service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Received event network-vif-plugged-a0d42bd2-1517-4cc8-9783-b7d6f124c301 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:00:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f5a00b83-c40b-4a42-9efe-3418cbdd8d73 req-11884397-268b-46b2-8b5d-9b2b0d9a0b50 service nova] Acquiring lock "634979eb-b706-4bdd-bb72-c2d163d3f8c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:00:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f5a00b83-c40b-4a42-9efe-3418cbdd8d73 req-11884397-268b-46b2-8b5d-9b2b0d9a0b50 service nova] Lock "634979eb-b706-4bdd-bb72-c2d163d3f8c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:00:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f5a00b83-c40b-4a42-9efe-3418cbdd8d73 req-11884397-268b-46b2-8b5d-9b2b0d9a0b50 service nova] Lock "634979eb-b706-4bdd-bb72-c2d163d3f8c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:00:08 user nova-compute[73010]: DEBUG nova.compute.manager [req-f5a00b83-c40b-4a42-9efe-3418cbdd8d73 req-11884397-268b-46b2-8b5d-9b2b0d9a0b50 service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] No waiting events found dispatching network-vif-plugged-a0d42bd2-1517-4cc8-9783-b7d6f124c301 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:00:08 user nova-compute[73010]: WARNING nova.compute.manager [req-f5a00b83-c40b-4a42-9efe-3418cbdd8d73 req-11884397-268b-46b2-8b5d-9b2b0d9a0b50 service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Received unexpected event network-vif-plugged-a0d42bd2-1517-4cc8-9783-b7d6f124c301 for instance with vm_state building and task_state spawning.
Aug 15 01:00:08 user nova-compute[73010]: DEBUG nova.compute.manager [req-f5a00b83-c40b-4a42-9efe-3418cbdd8d73 req-11884397-268b-46b2-8b5d-9b2b0d9a0b50 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Received event network-vif-plugged-c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:00:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f5a00b83-c40b-4a42-9efe-3418cbdd8d73 req-11884397-268b-46b2-8b5d-9b2b0d9a0b50 service nova] Acquiring lock "6b931225-177c-4b6c-9989-8e036ad58987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:00:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f5a00b83-c40b-4a42-9efe-3418cbdd8d73 req-11884397-268b-46b2-8b5d-9b2b0d9a0b50 service nova] Lock "6b931225-177c-4b6c-9989-8e036ad58987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:00:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f5a00b83-c40b-4a42-9efe-3418cbdd8d73 req-11884397-268b-46b2-8b5d-9b2b0d9a0b50 service nova] Lock "6b931225-177c-4b6c-9989-8e036ad58987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:00:08 user nova-compute[73010]: DEBUG nova.compute.manager [req-f5a00b83-c40b-4a42-9efe-3418cbdd8d73 req-11884397-268b-46b2-8b5d-9b2b0d9a0b50 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] No waiting events found dispatching network-vif-plugged-c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:00:08 user nova-compute[73010]: WARNING nova.compute.manager [req-f5a00b83-c40b-4a42-9efe-3418cbdd8d73 req-11884397-268b-46b2-8b5d-9b2b0d9a0b50 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Received unexpected event network-vif-plugged-c94c8a3a-6c88-482c-8c90-86341f11658d for instance with vm_state building and task_state spawning.
Aug 15 01:00:08 user nova-compute[73010]: DEBUG nova.compute.manager [req-f5a00b83-c40b-4a42-9efe-3418cbdd8d73 req-11884397-268b-46b2-8b5d-9b2b0d9a0b50 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Received event network-vif-plugged-c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:00:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f5a00b83-c40b-4a42-9efe-3418cbdd8d73 req-11884397-268b-46b2-8b5d-9b2b0d9a0b50 service nova] Acquiring lock "6b931225-177c-4b6c-9989-8e036ad58987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:00:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f5a00b83-c40b-4a42-9efe-3418cbdd8d73 req-11884397-268b-46b2-8b5d-9b2b0d9a0b50 service nova] Lock "6b931225-177c-4b6c-9989-8e036ad58987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:00:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f5a00b83-c40b-4a42-9efe-3418cbdd8d73 req-11884397-268b-46b2-8b5d-9b2b0d9a0b50 service nova] Lock "6b931225-177c-4b6c-9989-8e036ad58987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:00:08 user nova-compute[73010]: DEBUG nova.compute.manager [req-f5a00b83-c40b-4a42-9efe-3418cbdd8d73 req-11884397-268b-46b2-8b5d-9b2b0d9a0b50 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] No waiting events found dispatching network-vif-plugged-c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:00:08 user nova-compute[73010]: WARNING nova.compute.manager [req-f5a00b83-c40b-4a42-9efe-3418cbdd8d73 req-11884397-268b-46b2-8b5d-9b2b0d9a0b50 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Received unexpected event network-vif-plugged-c94c8a3a-6c88-482c-8c90-86341f11658d for instance with vm_state building and task_state spawning.
Aug 15 01:00:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:09 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061209.954796, 634979eb-b706-4bdd-bb72-c2d163d3f8c9 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:00:09 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] VM Resumed (Lifecycle Event)
Aug 15 01:00:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 01:00:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 01:00:09 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Instance spawned successfully.
Aug 15 01:00:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 01:00:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:00:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:00:10 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061209.956424, 634979eb-b706-4bdd-bb72-c2d163d3f8c9 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:00:10 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] VM Started (Lifecycle Event)
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:00:10 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 01:00:10 user nova-compute[73010]: INFO nova.compute.manager [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Took 6.40 seconds to spawn the instance on the hypervisor.
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:00:10 user nova-compute[73010]: INFO nova.compute.manager [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Took 15.50 seconds to build instance.
Aug 15 01:00:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-74d2d5e7-f27f-40a3-81e3-36d2e86f99bd tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "634979eb-b706-4bdd-bb72-c2d163d3f8c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.596s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061210.440902, 6b931225-177c-4b6c-9989-8e036ad58987 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:00:10 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] VM Resumed (Lifecycle Event)
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 01:00:10 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Instance spawned successfully.
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:00:10 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061210.4425197, 6b931225-177c-4b6c-9989-8e036ad58987 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:00:10 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] VM Started (Lifecycle Event)
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:00:10 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 01:00:10 user nova-compute[73010]: INFO nova.compute.manager [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Took 6.24 seconds to spawn the instance on the hypervisor.
Aug 15 01:00:10 user nova-compute[73010]: DEBUG nova.compute.manager [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:00:10 user nova-compute[73010]: INFO nova.compute.manager [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Took 6.80 seconds to build instance.
Aug 15 01:00:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-50f6236f-b2f2-4c7c-9e62-15a5c0a6e1db tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "6b931225-177c-4b6c-9989-8e036ad58987" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.904s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:00:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:12 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:00:12 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:00:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "39a36324-d323-4169-abaa-09028eeb5598" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:00:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "39a36324-d323-4169-abaa-09028eeb5598" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:00:13 user nova-compute[73010]: DEBUG nova.compute.manager [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 01:00:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:00:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:00:13 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 01:00:13 user nova-compute[73010]: INFO nova.compute.claims [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Claim successful on node user
Aug 15 01:00:13 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:00:13 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:00:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:00:13 user nova-compute[73010]: DEBUG nova.compute.manager [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 01:00:13 user nova-compute[73010]: DEBUG nova.compute.manager [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 01:00:13 user nova-compute[73010]: DEBUG nova.network.neutron [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 01:00:13 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 01:00:13 user nova-compute[73010]: DEBUG nova.compute.manager [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 01:00:14 user nova-compute[73010]: DEBUG nova.policy [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e1e98c9bae145f0909011bb46c6e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6db1cb9145b49999d0f102f8cfb867a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 01:00:14 user nova-compute[73010]: INFO nova.virt.block_device [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Booting with blank volume at /dev/vda
Aug 15 01:00:14 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:00:14 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:00:14 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 01:00:14 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Skipping network cache update for instance because it is Building. {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 15 01:00:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-d79e3854-769c-430a-b980-3a551c7ee34d" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:00:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-d79e3854-769c-430a-b980-3a551c7ee34d" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:00:14 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 01:00:14 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lazy-loading 'info_cache' on Instance uuid d79e3854-769c-430a-b980-3a551c7ee34d {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:00:14 user nova-compute[73010]: DEBUG nova.network.neutron [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Successfully created port: 18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 01:00:15 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Updating instance_info_cache with network_info: [{"id": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "address": "fa:16:3e:07:08:aa", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1f2867-31", "ovs_interfaceid": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:00:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-d79e3854-769c-430a-b980-3a551c7ee34d" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:00:15 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 01:00:15 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:00:15 user nova-compute[73010]: DEBUG nova.network.neutron [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Successfully updated port: 18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 01:00:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "refresh_cache-39a36324-d323-4169-abaa-09028eeb5598" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:00:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquired lock "refresh_cache-39a36324-d323-4169-abaa-09028eeb5598" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:00:15 user nova-compute[73010]: DEBUG nova.network.neutron [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 01:00:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-6a2b9925-dc3e-4a7b-89b3-d713802bce39 req-7fc9eea3-a508-40ba-b5f6-934a3417e993 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received event network-changed-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:00:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-6a2b9925-dc3e-4a7b-89b3-d713802bce39 req-7fc9eea3-a508-40ba-b5f6-934a3417e993 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Refreshing instance network info cache due to event network-changed-18919d62-63b4-4622-af68-05b0ecfb2002. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 01:00:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6a2b9925-dc3e-4a7b-89b3-d713802bce39 req-7fc9eea3-a508-40ba-b5f6-934a3417e993 service nova] Acquiring lock "refresh_cache-39a36324-d323-4169-abaa-09028eeb5598" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:00:15 user nova-compute[73010]: DEBUG nova.network.neutron [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 01:00:16 user nova-compute[73010]: DEBUG nova.network.neutron [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Updating instance_info_cache with network_info: [{"id": "18919d62-63b4-4622-af68-05b0ecfb2002", "address": "fa:16:3e:d7:7a:a7", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18919d62-63", "ovs_interfaceid": "18919d62-63b4-4622-af68-05b0ecfb2002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:00:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Releasing lock "refresh_cache-39a36324-d323-4169-abaa-09028eeb5598" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:00:16 user nova-compute[73010]: DEBUG nova.compute.manager [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Instance network_info: |[{"id": "18919d62-63b4-4622-af68-05b0ecfb2002", "address": "fa:16:3e:d7:7a:a7", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18919d62-63", "ovs_interfaceid": "18919d62-63b4-4622-af68-05b0ecfb2002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 01:00:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6a2b9925-dc3e-4a7b-89b3-d713802bce39 req-7fc9eea3-a508-40ba-b5f6-934a3417e993 service nova] Acquired lock "refresh_cache-39a36324-d323-4169-abaa-09028eeb5598" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:00:16 user nova-compute[73010]: DEBUG nova.network.neutron [req-6a2b9925-dc3e-4a7b-89b3-d713802bce39 req-7fc9eea3-a508-40ba-b5f6-934a3417e993 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Refreshing network info cache for port 18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 01:00:16 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:00:16 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:00:16 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:00:16 user nova-compute[73010]: DEBUG nova.network.neutron [req-6a2b9925-dc3e-4a7b-89b3-d713802bce39 req-7fc9eea3-a508-40ba-b5f6-934a3417e993 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Updated VIF entry in instance network info cache for port 18919d62-63b4-4622-af68-05b0ecfb2002. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 01:00:16 user nova-compute[73010]: DEBUG nova.network.neutron [req-6a2b9925-dc3e-4a7b-89b3-d713802bce39 req-7fc9eea3-a508-40ba-b5f6-934a3417e993 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Updating instance_info_cache with network_info: [{"id": "18919d62-63b4-4622-af68-05b0ecfb2002", "address": "fa:16:3e:d7:7a:a7", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18919d62-63", "ovs_interfaceid": "18919d62-63b4-4622-af68-05b0ecfb2002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:00:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-6a2b9925-dc3e-4a7b-89b3-d713802bce39 req-7fc9eea3-a508-40ba-b5f6-934a3417e993 service nova] Releasing lock "refresh_cache-39a36324-d323-4169-abaa-09028eeb5598" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:00:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:19 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:00:19 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:00:19 user nova-compute[73010]: DEBUG os_brick.utils [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:00:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0105f993-fae8-4ecd-a680-da11a42c15bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab158402-17b9-4d7c-b3aa-3c52638134b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd10d7d2-3114-40a3-ba71-8c2f350e08db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[45474372-29f7-40ca-840a-30e4360b55e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 01:00:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 01:00:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 01:00:19 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 01:00:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a350d2-7d29-45d9-a616-24affe205ca1]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 01:00:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 01:00:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 01:00:19 user nova-compute[73010]: DEBUG os_brick.utils [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:00:19 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Updating existing volume attachment record: e2b45385-dec1-4153-b94e-364df6253b37 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 01:00:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-5ad7c489-93bd-4587-8abe-a4ecc8031483 req-2611f284-eb62-4061-8ceb-1c9d7bd0a14c service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Received event network-changed-bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:00:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-5ad7c489-93bd-4587-8abe-a4ecc8031483 req-2611f284-eb62-4061-8ceb-1c9d7bd0a14c service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Refreshing instance network info cache due to event network-changed-bb08a1cd-7152-4c81-b416-ac00f5bb59be. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 01:00:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5ad7c489-93bd-4587-8abe-a4ecc8031483 req-2611f284-eb62-4061-8ceb-1c9d7bd0a14c service nova] Acquiring lock "refresh_cache-20d92360-d4f7-4f17-8a32-fb901dd8feb8" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:00:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5ad7c489-93bd-4587-8abe-a4ecc8031483 req-2611f284-eb62-4061-8ceb-1c9d7bd0a14c service nova] Acquired lock "refresh_cache-20d92360-d4f7-4f17-8a32-fb901dd8feb8" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:00:20 user nova-compute[73010]: DEBUG nova.network.neutron [req-5ad7c489-93bd-4587-8abe-a4ecc8031483 req-2611f284-eb62-4061-8ceb-1c9d7bd0a14c service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Refreshing network info cache for port bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 01:00:20 user nova-compute[73010]: DEBUG nova.network.neutron [req-5ad7c489-93bd-4587-8abe-a4ecc8031483 req-2611f284-eb62-4061-8ceb-1c9d7bd0a14c service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Updated VIF entry in instance network info cache for port bb08a1cd-7152-4c81-b416-ac00f5bb59be. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 01:00:20 user nova-compute[73010]: DEBUG nova.network.neutron [req-5ad7c489-93bd-4587-8abe-a4ecc8031483 req-2611f284-eb62-4061-8ceb-1c9d7bd0a14c service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Updating instance_info_cache with network_info: [{"id": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "address": "fa:16:3e:d7:26:86", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb08a1cd-71", "ovs_interfaceid": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:00:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5ad7c489-93bd-4587-8abe-a4ecc8031483 req-2611f284-eb62-4061-8ceb-1c9d7bd0a14c service nova] Releasing lock "refresh_cache-20d92360-d4f7-4f17-8a32-fb901dd8feb8" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:00:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:24 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:00:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:00:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:00:24 user nova-compute[73010]: INFO nova.compute.manager [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Shelving
Aug 15 01:00:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-896cad5e-d309-4f58-beae-c1efff16d31f req-d7776d6d-2909-42d2-9111-71805669a5a7 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Received event network-vif-unplugged-bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:00:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-896cad5e-d309-4f58-beae-c1efff16d31f req-d7776d6d-2909-42d2-9111-71805669a5a7 service nova] Acquiring lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:00:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-896cad5e-d309-4f58-beae-c1efff16d31f req-d7776d6d-2909-42d2-9111-71805669a5a7 service nova] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:00:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-896cad5e-d309-4f58-beae-c1efff16d31f req-d7776d6d-2909-42d2-9111-71805669a5a7 service nova] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:00:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-896cad5e-d309-4f58-beae-c1efff16d31f req-d7776d6d-2909-42d2-9111-71805669a5a7 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] No waiting events found dispatching network-vif-unplugged-bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:00:25 user nova-compute[73010]: WARNING nova.compute.manager [req-896cad5e-d309-4f58-beae-c1efff16d31f req-d7776d6d-2909-42d2-9111-71805669a5a7 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Received unexpected event network-vif-unplugged-bb08a1cd-7152-4c81-b416-ac00f5bb59be for instance with vm_state active and task_state shelving.
Aug 15 01:00:25 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Instance destroyed successfully.
Aug 15 01:00:25 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Beginning cold snapshot process
Aug 15 01:00:25 user nova-compute[73010]: DEBUG nova.privsep.utils [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73010) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 01:00:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk /opt/stack/data/nova/instances/snapshots/tmpsvd925w3/2fa43a63ea454991b4983676f0055d92 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:26 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk /opt/stack/data/nova/instances/snapshots/tmpsvd925w3/2fa43a63ea454991b4983676f0055d92" returned: 0 in 0.487s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:26 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Snapshot extracted, beginning image upload
Aug 15 01:00:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:27 user nova-compute[73010]: DEBUG nova.compute.manager [req-138381f8-8793-4e5f-a96b-7190d2cebda0 req-278e5342-bf87-4b1f-9c64-ce28271d13a8 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Received event network-vif-plugged-bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:00:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-138381f8-8793-4e5f-a96b-7190d2cebda0 req-278e5342-bf87-4b1f-9c64-ce28271d13a8 service nova] Acquiring lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:00:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-138381f8-8793-4e5f-a96b-7190d2cebda0 req-278e5342-bf87-4b1f-9c64-ce28271d13a8 service nova] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:00:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-138381f8-8793-4e5f-a96b-7190d2cebda0 req-278e5342-bf87-4b1f-9c64-ce28271d13a8 service nova] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:00:27 user nova-compute[73010]: DEBUG nova.compute.manager [req-138381f8-8793-4e5f-a96b-7190d2cebda0 req-278e5342-bf87-4b1f-9c64-ce28271d13a8 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] No waiting events found dispatching network-vif-plugged-bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:00:27 user nova-compute[73010]: WARNING nova.compute.manager [req-138381f8-8793-4e5f-a96b-7190d2cebda0 req-278e5342-bf87-4b1f-9c64-ce28271d13a8 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Received unexpected event network-vif-plugged-bb08a1cd-7152-4c81-b416-ac00f5bb59be for instance with vm_state active and task_state shelving_image_uploading.
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.compute.manager [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 01:00:28 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Creating image(s)
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Did not create local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Ensure instance console log exists: /opt/stack/data/nova/instances/39a36324-d323-4169-abaa-09028eeb5598/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Start _get_guest_xml network_info=[{"id": "18919d62-63b4-4622-af68-05b0ecfb2002", "address": "fa:16:3e:d7:7a:a7", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18919d62-63", "ovs_interfaceid": "18919d62-63b4-4622-af68-05b0ecfb2002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IYBDknor', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '39a36324-d323-4169-abaa-09028eeb5598', 'attached_at': '', 'detached_at': '', 'volume_id': '7096a68e-26fc-49bc-bc01-438af11bb87d', 'serial': '7096a68e-26fc-49bc-bc01-438af11bb87d'}, 'disk_bus': 'virtio', 'attachment_id': 'e2b45385-dec1-4153-b94e-364df6253b37', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 01:00:28 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:00:28 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IYBDknor', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:00:28 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:00:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:00:28 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:00:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:00:28 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:28 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Snapshot image upload complete
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.compute.manager [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bb1d80-b300-4a06-85c9-4704df955dc4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 01:00:28 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ead4240-ee89-48d1-aab6-563b1fb55504]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d] added
Aug 15 01:00:28 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d1116d-94b9-4b43-9474-22bc17f09dc7]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5185ea6-a2d8-414a-bfb1-accb1d976603]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IYBDknor {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:28 user nova-compute[73010]: INFO nova.compute.manager [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Shelve offloading
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IYBDknor" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[476e2c05-7e74-461e-8a51-1dc453b0f718]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IYBDknor'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:28 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Instance destroyed successfully.
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.compute.manager [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "refresh_cache-20d92360-d4f7-4f17-8a32-fb901dd8feb8" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquired lock "refresh_cache-20d92360-d4f7-4f17-8a32-fb901dd8feb8" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG nova.network.neutron [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0caf0385-d405-44a3-a202-90c5614047f1]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[798287b6-0b32-4a66-bd80-e06f3f4645a2]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:00:28 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:00:28 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[264a4d5f-1fd4-4cf2-8b28-c6f7e5ba0385]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d, portal: 172.16.0.220,3260]
Aug 15 01:00:28 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d, portal: 172.16.0.220,3260] successful.
Aug 15 01:00:28 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72bd6ac-4f36-4986-a687-84fc1dd69ebd]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea1fe11-c214-480e-9f5b-513f74a49f50]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:00:28 user nova-compute[73010]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:00:28 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:00:28 user nova-compute[73010]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:00:28 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[237d98bf-8b51-456c-a01c-9a9bf966a3ef]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 01:00:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IYBDknor', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 01:00:29 user nova-compute[73010]: DEBUG nova.network.neutron [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Updating instance_info_cache with network_info: [{"id": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "address": "fa:16:3e:d7:26:86", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb08a1cd-71", "ovs_interfaceid": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:00:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Releasing lock "refresh_cache-20d92360-d4f7-4f17-8a32-fb901dd8feb8" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:00:29 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Instance destroyed successfully.
Aug 15 01:00:29 user nova-compute[73010]: DEBUG nova.objects.instance [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lazy-loading 'resources' on Instance uuid 20d92360-d4f7-4f17-8a32-fb901dd8feb8 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:00:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:58:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-250049231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-250049231',id=44,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB68T4Tfh7suf54gX4WwC1EAatBAA0f+1a93JBgelOv/aFsQJIUeViaEqJv62ELVcOXfDPqS4j5ENQxQZplvmlKnUkW3CYdpGB4XrHmlOoqKR080R20EdRsZnzavNv1BQQ==',key_name='tempest-keypair-449371876',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:58:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='586bed330893488081bb21738b1a6ec4',ramdisk_id='',reservation_id='r-ckgkv059',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-563974852',owner_user_name='tempest-AttachVolumeShelveTestJSON-563974852-project-member',shelved_at='2023-08-15T01:00:28.698063',shelved_host='user',shelved_image_id='35cb6b0d-880c-4a9c-bb70-27b456e5a316'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T01:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c5655da76eb4671b4db00e086232f05',uuid=20d92360-d4f7-4f17-8a32-fb901dd8feb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "address": "fa:16:3e:d7:26:86", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb08a1cd-71", "ovs_interfaceid": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 01:00:29 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Converting VIF {"id": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "address": "fa:16:3e:d7:26:86", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb08a1cd-71", "ovs_interfaceid": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:00:29 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:26:86,bridge_name='br-int',has_traffic_filtering=True,id=bb08a1cd-7152-4c81-b416-ac00f5bb59be,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb08a1cd-71') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:00:29 user nova-compute[73010]: DEBUG os_vif [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:26:86,bridge_name='br-int',has_traffic_filtering=True,id=bb08a1cd-7152-4c81-b416-ac00f5bb59be,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb08a1cd-71') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 01:00:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb08a1cd-71, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:00:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:29 user nova-compute[73010]: DEBUG nova.compute.manager [req-ca6e3bb7-3cb2-4d38-a9e9-2510ec36c96c req-36b41d47-d8ae-4e30-8bb8-f50aa3e9a61e service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Received event network-changed-bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:00:29 user nova-compute[73010]: DEBUG nova.compute.manager [req-ca6e3bb7-3cb2-4d38-a9e9-2510ec36c96c req-36b41d47-d8ae-4e30-8bb8-f50aa3e9a61e service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Refreshing instance network info cache due to event network-changed-bb08a1cd-7152-4c81-b416-ac00f5bb59be. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 01:00:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ca6e3bb7-3cb2-4d38-a9e9-2510ec36c96c req-36b41d47-d8ae-4e30-8bb8-f50aa3e9a61e service nova] Acquiring lock "refresh_cache-20d92360-d4f7-4f17-8a32-fb901dd8feb8" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:00:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ca6e3bb7-3cb2-4d38-a9e9-2510ec36c96c req-36b41d47-d8ae-4e30-8bb8-f50aa3e9a61e service nova] Acquired lock "refresh_cache-20d92360-d4f7-4f17-8a32-fb901dd8feb8" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:00:29 user nova-compute[73010]: DEBUG nova.network.neutron [req-ca6e3bb7-3cb2-4d38-a9e9-2510ec36c96c req-36b41d47-d8ae-4e30-8bb8-f50aa3e9a61e service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Refreshing network info cache for port bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 01:00:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:00:29 user nova-compute[73010]: INFO os_vif [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:26:86,bridge_name='br-int',has_traffic_filtering=True,id=bb08a1cd-7152-4c81-b416-ac00f5bb59be,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb08a1cd-71')
Aug 15 01:00:29 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Deleting instance files /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8_del
Aug 15 01:00:29 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Deletion of /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8_del complete
Aug 15 01:00:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:00:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23532633264626437', 'path': '/dev/sdc'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:00:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532633264626437', 'path': '/dev/sdc'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 01:00:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1935653473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1935653473',id=47,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6db1cb9145b49999d0f102f8cfb867a',ramdisk_id='',reservation_id='r-6x067bjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T01:00:14Z,user_data=None,user_id='8e1e98c9bae145f0909011bb46c6e104',uuid=39a36324-d323-4169-abaa-09028eeb5598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18919d62-63b4-4622-af68-05b0ecfb2002", "address": "fa:16:3e:d7:7a:a7", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18919d62-63", "ovs_interfaceid": "18919d62-63b4-4622-af68-05b0ecfb2002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 01:00:29 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converting VIF {"id": "18919d62-63b4-4622-af68-05b0ecfb2002", "address": "fa:16:3e:d7:7a:a7", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18919d62-63", "ovs_interfaceid": "18919d62-63b4-4622-af68-05b0ecfb2002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:00:29 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:7a:a7,bridge_name='br-int',has_traffic_filtering=True,id=18919d62-63b4-4622-af68-05b0ecfb2002,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18919d62-63') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG nova.objects.instance [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lazy-loading 'pci_devices' on Instance uuid 39a36324-d323-4169-abaa-09028eeb5598 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] End _get_guest_xml xml=<domain type="kvm">
Aug 15 01:00:30 user nova-compute[73010]:   <uuid>39a36324-d323-4169-abaa-09028eeb5598</uuid>
Aug 15 01:00:30 user nova-compute[73010]:   <name>instance-0000002f</name>
Aug 15 01:00:30 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 01:00:30 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 01:00:30 user nova-compute[73010]:   <metadata>
Aug 15 01:00:30 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 01:00:30 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 01:00:30 user nova-compute[73010]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1935653473</nova:name>
Aug 15 01:00:30 user nova-compute[73010]:       <nova:creationTime>2023-08-15 01:00:28</nova:creationTime>
Aug 15 01:00:30 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 01:00:30 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 01:00:30 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 01:00:30 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 01:00:30 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 01:00:30 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 01:00:30 user nova-compute[73010]:       </nova:flavor>
Aug 15 01:00:30 user nova-compute[73010]:       <nova:owner>
Aug 15 01:00:30 user nova-compute[73010]:         <nova:user uuid="8e1e98c9bae145f0909011bb46c6e104">tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member</nova:user>
Aug 15 01:00:30 user nova-compute[73010]:         <nova:project uuid="f6db1cb9145b49999d0f102f8cfb867a">tempest-ServerBootFromVolumeStableRescueTest-1758225981</nova:project>
Aug 15 01:00:30 user nova-compute[73010]:       </nova:owner>
Aug 15 01:00:30 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 01:00:30 user nova-compute[73010]:       <nova:ports>
Aug 15 01:00:30 user nova-compute[73010]:         <nova:port uuid="18919d62-63b4-4622-af68-05b0ecfb2002">
Aug 15 01:00:30 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 01:00:30 user nova-compute[73010]:         </nova:port>
Aug 15 01:00:30 user nova-compute[73010]:       </nova:ports>
Aug 15 01:00:30 user nova-compute[73010]:     </nova:instance>
Aug 15 01:00:30 user nova-compute[73010]:   </metadata>
Aug 15 01:00:30 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 01:00:30 user nova-compute[73010]:     <system>
Aug 15 01:00:30 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 01:00:30 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 01:00:30 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 01:00:30 user nova-compute[73010]:       <entry name="serial">39a36324-d323-4169-abaa-09028eeb5598</entry>
Aug 15 01:00:30 user nova-compute[73010]:       <entry name="uuid">39a36324-d323-4169-abaa-09028eeb5598</entry>
Aug 15 01:00:30 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 01:00:30 user nova-compute[73010]:     </system>
Aug 15 01:00:30 user nova-compute[73010]:   </sysinfo>
Aug 15 01:00:30 user nova-compute[73010]:   <os>
Aug 15 01:00:30 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 01:00:30 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 01:00:30 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 01:00:30 user nova-compute[73010]:   </os>
Aug 15 01:00:30 user nova-compute[73010]:   <features>
Aug 15 01:00:30 user nova-compute[73010]:     <acpi/>
Aug 15 01:00:30 user nova-compute[73010]:     <apic/>
Aug 15 01:00:30 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 01:00:30 user nova-compute[73010]:   </features>
Aug 15 01:00:30 user nova-compute[73010]:   <clock offset="utc">
Aug 15 01:00:30 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 01:00:30 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 01:00:30 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 01:00:30 user nova-compute[73010]:   </clock>
Aug 15 01:00:30 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 01:00:30 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 01:00:30 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 01:00:30 user nova-compute[73010]:   </cpu>
Aug 15 01:00:30 user nova-compute[73010]:   <devices>
Aug 15 01:00:30 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 01:00:30 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:00:30 user nova-compute[73010]:       <source dev="/dev/sdc"/>
Aug 15 01:00:30 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 01:00:30 user nova-compute[73010]:       <serial>7096a68e-26fc-49bc-bc01-438af11bb87d</serial>
Aug 15 01:00:30 user nova-compute[73010]:     </disk>
Aug 15 01:00:30 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 01:00:30 user nova-compute[73010]:       <mac address="fa:16:3e:d7:7a:a7"/>
Aug 15 01:00:30 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:00:30 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 01:00:30 user nova-compute[73010]:       <target dev="tap18919d62-63"/>
Aug 15 01:00:30 user nova-compute[73010]:     </interface>
Aug 15 01:00:30 user nova-compute[73010]:     <serial type="pty">
Aug 15 01:00:30 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/39a36324-d323-4169-abaa-09028eeb5598/console.log" append="off"/>
Aug 15 01:00:30 user nova-compute[73010]:     </serial>
Aug 15 01:00:30 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 01:00:30 user nova-compute[73010]:     <video>
Aug 15 01:00:30 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:00:30 user nova-compute[73010]:     </video>
Aug 15 01:00:30 user nova-compute[73010]:     <rng model="virtio">
Aug 15 01:00:30 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 01:00:30 user nova-compute[73010]:     </rng>
Aug 15 01:00:30 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 01:00:30 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 01:00:30 user nova-compute[73010]:       <stats period="10"/>
Aug 15 01:00:30 user nova-compute[73010]:     </memballoon>
Aug 15 01:00:30 user nova-compute[73010]:   </devices>
Aug 15 01:00:30 user nova-compute[73010]: </domain>
Aug 15 01:00:30 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1935653473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1935653473',id=47,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6db1cb9145b49999d0f102f8cfb867a',ramdisk_id='',reservation_id='r-6x067bjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T01:00:14Z,user_data=None,user_id='8e1e98c9bae145f0909011bb46c6e104',uuid=39a36324-d323-4169-abaa-09028eeb5598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18919d62-63b4-4622-af68-05b0ecfb2002", "address": "fa:16:3e:d7:7a:a7", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18919d62-63", "ovs_interfaceid": "18919d62-63b4-4622-af68-05b0ecfb2002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converting VIF {"id": "18919d62-63b4-4622-af68-05b0ecfb2002", "address": "fa:16:3e:d7:7a:a7", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18919d62-63", "ovs_interfaceid": "18919d62-63b4-4622-af68-05b0ecfb2002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:7a:a7,bridge_name='br-int',has_traffic_filtering=True,id=18919d62-63b4-4622-af68-05b0ecfb2002,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18919d62-63') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG os_vif [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:7a:a7,bridge_name='br-int',has_traffic_filtering=True,id=18919d62-63b4-4622-af68-05b0ecfb2002,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18919d62-63') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18919d62-63, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18919d62-63, col_values=(('external_ids', {'iface-id': '18919d62-63b4-4622-af68-05b0ecfb2002', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:7a:a7', 'vm-uuid': '39a36324-d323-4169-abaa-09028eeb5598'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:30 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Deleted allocations for instance 20d92360-d4f7-4f17-8a32-fb901dd8feb8
Aug 15 01:00:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:30 user nova-compute[73010]: INFO os_vif [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:7a:a7,bridge_name='br-int',has_traffic_filtering=True,id=18919d62-63b4-4622-af68-05b0ecfb2002,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18919d62-63')
Aug 15 01:00:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG nova.objects.instance [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lazy-loading 'numa_topology' on Instance uuid 20d92360-d4f7-4f17-8a32-fb901dd8feb8 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] No VIF found with MAC fa:16:3e:d7:7a:a7, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-2600cc9a-bed0-4663-81bc-78cfb4edb39b tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.467s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG nova.network.neutron [req-ca6e3bb7-3cb2-4d38-a9e9-2510ec36c96c req-36b41d47-d8ae-4e30-8bb8-f50aa3e9a61e service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Updated VIF entry in instance network info cache for port bb08a1cd-7152-4c81-b416-ac00f5bb59be. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG nova.network.neutron [req-ca6e3bb7-3cb2-4d38-a9e9-2510ec36c96c req-36b41d47-d8ae-4e30-8bb8-f50aa3e9a61e service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Updating instance_info_cache with network_info: [{"id": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "address": "fa:16:3e:d7:26:86", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapbb08a1cd-71", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:00:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-ca6e3bb7-3cb2-4d38-a9e9-2510ec36c96c req-36b41d47-d8ae-4e30-8bb8-f50aa3e9a61e service nova] Releasing lock "refresh_cache-20d92360-d4f7-4f17-8a32-fb901dd8feb8" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:00:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:31 user nova-compute[73010]: DEBUG nova.compute.manager [req-c109252b-912f-4259-b5bd-2eabe51c2ac4 req-0e453bf3-8ce6-4699-998d-b51f850bc72c service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received event network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:00:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c109252b-912f-4259-b5bd-2eabe51c2ac4 req-0e453bf3-8ce6-4699-998d-b51f850bc72c service nova] Acquiring lock "39a36324-d323-4169-abaa-09028eeb5598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:00:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c109252b-912f-4259-b5bd-2eabe51c2ac4 req-0e453bf3-8ce6-4699-998d-b51f850bc72c service nova] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:00:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c109252b-912f-4259-b5bd-2eabe51c2ac4 req-0e453bf3-8ce6-4699-998d-b51f850bc72c service nova] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:00:31 user nova-compute[73010]: DEBUG nova.compute.manager [req-c109252b-912f-4259-b5bd-2eabe51c2ac4 req-0e453bf3-8ce6-4699-998d-b51f850bc72c service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] No waiting events found dispatching network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:00:31 user nova-compute[73010]: WARNING nova.compute.manager [req-c109252b-912f-4259-b5bd-2eabe51c2ac4 req-0e453bf3-8ce6-4699-998d-b51f850bc72c service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received unexpected event network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 for instance with vm_state building and task_state spawning.
Aug 15 01:00:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:33 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061233.433859, 39a36324-d323-4169-abaa-09028eeb5598 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:00:33 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] VM Resumed (Lifecycle Event)
Aug 15 01:00:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 01:00:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 01:00:33 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Instance spawned successfully.
Aug 15 01:00:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 01:00:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:00:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:00:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:00:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:00:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:00:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:00:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:00:33 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:00:33 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 01:00:33 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061233.4352565, 39a36324-d323-4169-abaa-09028eeb5598 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:00:33 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] VM Started (Lifecycle Event)
Aug 15 01:00:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:00:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:00:33 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 01:00:33 user nova-compute[73010]: DEBUG nova.compute.manager [req-a5c64428-85d5-47b7-a76f-6162c5c77073 req-9d7add8a-25be-436b-9104-e6ffe398f3b3 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received event network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:00:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a5c64428-85d5-47b7-a76f-6162c5c77073 req-9d7add8a-25be-436b-9104-e6ffe398f3b3 service nova] Acquiring lock "39a36324-d323-4169-abaa-09028eeb5598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:00:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a5c64428-85d5-47b7-a76f-6162c5c77073 req-9d7add8a-25be-436b-9104-e6ffe398f3b3 service nova] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:00:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a5c64428-85d5-47b7-a76f-6162c5c77073 req-9d7add8a-25be-436b-9104-e6ffe398f3b3 service nova] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:00:33 user nova-compute[73010]: DEBUG nova.compute.manager [req-a5c64428-85d5-47b7-a76f-6162c5c77073 req-9d7add8a-25be-436b-9104-e6ffe398f3b3 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] No waiting events found dispatching network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:00:33 user nova-compute[73010]: WARNING nova.compute.manager [req-a5c64428-85d5-47b7-a76f-6162c5c77073 req-9d7add8a-25be-436b-9104-e6ffe398f3b3 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received unexpected event network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 for instance with vm_state building and task_state spawning.
Aug 15 01:00:33 user nova-compute[73010]: INFO nova.compute.manager [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Took 4.95 seconds to spawn the instance on the hypervisor.
Aug 15 01:00:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:00:33 user nova-compute[73010]: INFO nova.compute.manager [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Took 20.15 seconds to build instance.
Aug 15 01:00:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cffb2feb-9f3f-4464-bcb8-a537952186d0 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "39a36324-d323-4169-abaa-09028eeb5598" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.263s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:00:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:40 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692061225.6752648, 20d92360-d4f7-4f17-8a32-fb901dd8feb8 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:00:40 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] VM Stopped (Lifecycle Event)
Aug 15 01:00:40 user nova-compute[73010]: DEBUG nova.compute.manager [None req-9a17ec01-b9bf-4563-a465-1ce99562f616 None None] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:00:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:00:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:01:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:01:03 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:01:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:01:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:01:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:01:03 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:01:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:01:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:01:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:01:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:01:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:01:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:01:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:01:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:01:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:01:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:01:04 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:01:04 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:01:04 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8420MB free_disk=25.421875GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:01:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:01:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:01:04 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance d79e3854-769c-430a-b980-3a551c7ee34d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:01:04 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 634979eb-b706-4bdd-bb72-c2d163d3f8c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:01:04 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6b931225-177c-4b6c-9989-8e036ad58987 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:01:04 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 39a36324-d323-4169-abaa-09028eeb5598 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:01:04 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:01:04 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:01:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:01:05 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:01:05 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:01:05 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:01:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.306s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:01:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:01:12 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:01:12 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:01:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:01:15 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:01:15 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:01:15 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Skipping network cache update for instance because it has been migrated to another host. {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 15 01:01:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-634979eb-b706-4bdd-bb72-c2d163d3f8c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:01:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-634979eb-b706-4bdd-bb72-c2d163d3f8c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:01:15 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 01:01:16 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Updating instance_info_cache with network_info: [{"id": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "address": "fa:16:3e:29:2e:78", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d42bd2-15", "ovs_interfaceid": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:01:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-634979eb-b706-4bdd-bb72-c2d163d3f8c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:01:16 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 01:01:17 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:01:17 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:01:17 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:01:17 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:01:19 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:01:19 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:01:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:01:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:01:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:01:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:01:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:01:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:01:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:01:46 user nova-compute[73010]: DEBUG nova.compute.manager [req-71a2e33a-2bab-4896-8434-d01f1f409a09 req-204c5190-db9a-4a42-a018-eb50458a6fa5 service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Received event network-changed-a0d42bd2-1517-4cc8-9783-b7d6f124c301 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:01:46 user nova-compute[73010]: DEBUG nova.compute.manager [req-71a2e33a-2bab-4896-8434-d01f1f409a09 req-204c5190-db9a-4a42-a018-eb50458a6fa5 service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Refreshing instance network info cache due to event network-changed-a0d42bd2-1517-4cc8-9783-b7d6f124c301. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 01:01:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-71a2e33a-2bab-4896-8434-d01f1f409a09 req-204c5190-db9a-4a42-a018-eb50458a6fa5 service nova] Acquiring lock "refresh_cache-634979eb-b706-4bdd-bb72-c2d163d3f8c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:01:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-71a2e33a-2bab-4896-8434-d01f1f409a09 req-204c5190-db9a-4a42-a018-eb50458a6fa5 service nova] Acquired lock "refresh_cache-634979eb-b706-4bdd-bb72-c2d163d3f8c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:01:46 user nova-compute[73010]: DEBUG nova.network.neutron [req-71a2e33a-2bab-4896-8434-d01f1f409a09 req-204c5190-db9a-4a42-a018-eb50458a6fa5 service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Refreshing network info cache for port a0d42bd2-1517-4cc8-9783-b7d6f124c301 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 01:01:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:01:47 user nova-compute[73010]: DEBUG nova.network.neutron [req-71a2e33a-2bab-4896-8434-d01f1f409a09 req-204c5190-db9a-4a42-a018-eb50458a6fa5 service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Updated VIF entry in instance network info cache for port a0d42bd2-1517-4cc8-9783-b7d6f124c301. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 01:01:47 user nova-compute[73010]: DEBUG nova.network.neutron [req-71a2e33a-2bab-4896-8434-d01f1f409a09 req-204c5190-db9a-4a42-a018-eb50458a6fa5 service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Updating instance_info_cache with network_info: [{"id": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "address": "fa:16:3e:29:2e:78", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d42bd2-15", "ovs_interfaceid": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:01:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-71a2e33a-2bab-4896-8434-d01f1f409a09 req-204c5190-db9a-4a42-a018-eb50458a6fa5 service nova] Releasing lock "refresh_cache-634979eb-b706-4bdd-bb72-c2d163d3f8c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:01:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:01:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:01:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:01:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "6b931225-177c-4b6c-9989-8e036ad58987" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "6b931225-177c-4b6c-9989-8e036ad58987" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG nova.objects.instance [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lazy-loading 'flavor' on Instance uuid 6b931225-177c-4b6c-9989-8e036ad58987 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "6b931225-177c-4b6c-9989-8e036ad58987" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "6b931225-177c-4b6c-9989-8e036ad58987" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "6b931225-177c-4b6c-9989-8e036ad58987" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:01:58 user nova-compute[73010]: INFO nova.compute.manager [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Attaching volume 15660223-5084-4b21-bec1-f9f08cc0e8d4 to /dev/vdb
Aug 15 01:01:58 user nova-compute[73010]: DEBUG os_brick.utils [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8e944c-a7fb-4e24-94ff-0f68b8902b6a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7593416-86a3-4a39-ba2e-46d84e52b4ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[640e6214-2082-4e57-9c12-835f2660aff7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffb507f-a667-4421-a96e-601677fbaf0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 01:01:58 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 01:01:58 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[802ff84b-5b3c-467d-a4a2-d0d505616802]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG os_brick.utils [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:01:58 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Updating existing volume attachment record: 8f778ccd-9ccd-4fe1-9a2b-c0f32a634c42 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 01:01:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "1a664ead-4fec-454d-bca2-023afecb409a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:01:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "1a664ead-4fec-454d-bca2-023afecb409a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:01:59 user nova-compute[73010]: DEBUG nova.compute.manager [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 01:01:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:01:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:01:59 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 01:01:59 user nova-compute[73010]: INFO nova.compute.claims [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Claim successful on node user
Aug 15 01:01:59 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:01:59 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:01:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:01:59 user nova-compute[73010]: DEBUG nova.compute.manager [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG nova.network.neutron [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 01:02:00 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 01:02:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG nova.policy [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'daa4eb788f724a6fbf908b029315a02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67d1031d3cb4c8fb66342a7888ca1c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 01:02:00 user nova-compute[73010]: INFO nova.virt.block_device [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Booting with volume 7a4cec08-99b4-4055-b567-7906c7650ad2 at /dev/vda
Aug 15 01:02:00 user nova-compute[73010]: DEBUG os_brick.utils [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[291b3217-d747-44c9-98f2-b1cb0b515a95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c25f12-55f4-4d24-b1bb-0c29cba7b378]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[782f1e7a-f4fc-4a82-9c9a-eead2356222e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e9c483-ad4b-498f-9d20-1574835034da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 01:02:00 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 01:02:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[04edfbb8-d7e6-47fe-a0a7-1a853fbc5d63]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG os_brick.utils [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Updating existing volume attachment record: afd9b5e6-6c9e-4a7b-85ab-98b81f70aebf {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 01:02:00 user nova-compute[73010]: DEBUG nova.network.neutron [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Successfully created port: bca0154b-0273-4c6d-a4a3-52f45ed0b79f {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 01:02:01 user nova-compute[73010]: DEBUG nova.network.neutron [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Successfully updated port: bca0154b-0273-4c6d-a4a3-52f45ed0b79f {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 01:02:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "refresh_cache-1a664ead-4fec-454d-bca2-023afecb409a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:02:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquired lock "refresh_cache-1a664ead-4fec-454d-bca2-023afecb409a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:02:01 user nova-compute[73010]: DEBUG nova.network.neutron [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 01:02:01 user nova-compute[73010]: DEBUG nova.compute.manager [req-c476274a-58e3-437d-a976-d1d8c4a49c9d req-90fb6adb-58e9-46e1-a259-32cb762a7f5a service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Received event network-changed-bca0154b-0273-4c6d-a4a3-52f45ed0b79f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:02:01 user nova-compute[73010]: DEBUG nova.compute.manager [req-c476274a-58e3-437d-a976-d1d8c4a49c9d req-90fb6adb-58e9-46e1-a259-32cb762a7f5a service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Refreshing instance network info cache due to event network-changed-bca0154b-0273-4c6d-a4a3-52f45ed0b79f. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 01:02:01 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c476274a-58e3-437d-a976-d1d8c4a49c9d req-90fb6adb-58e9-46e1-a259-32cb762a7f5a service nova] Acquiring lock "refresh_cache-1a664ead-4fec-454d-bca2-023afecb409a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:02:02 user nova-compute[73010]: DEBUG nova.network.neutron [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 01:02:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:02 user nova-compute[73010]: DEBUG nova.network.neutron [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Updating instance_info_cache with network_info: [{"id": "bca0154b-0273-4c6d-a4a3-52f45ed0b79f", "address": "fa:16:3e:92:fb:07", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca0154b-02", "ovs_interfaceid": "bca0154b-0273-4c6d-a4a3-52f45ed0b79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:02:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Releasing lock "refresh_cache-1a664ead-4fec-454d-bca2-023afecb409a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:02:02 user nova-compute[73010]: DEBUG nova.compute.manager [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Instance network_info: |[{"id": "bca0154b-0273-4c6d-a4a3-52f45ed0b79f", "address": "fa:16:3e:92:fb:07", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca0154b-02", "ovs_interfaceid": "bca0154b-0273-4c6d-a4a3-52f45ed0b79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 01:02:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c476274a-58e3-437d-a976-d1d8c4a49c9d req-90fb6adb-58e9-46e1-a259-32cb762a7f5a service nova] Acquired lock "refresh_cache-1a664ead-4fec-454d-bca2-023afecb409a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:02:02 user nova-compute[73010]: DEBUG nova.network.neutron [req-c476274a-58e3-437d-a976-d1d8c4a49c9d req-90fb6adb-58e9-46e1-a259-32cb762a7f5a service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Refreshing network info cache for port bca0154b-0273-4c6d-a4a3-52f45ed0b79f {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 01:02:02 user nova-compute[73010]: DEBUG nova.network.neutron [req-c476274a-58e3-437d-a976-d1d8c4a49c9d req-90fb6adb-58e9-46e1-a259-32cb762a7f5a service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Updated VIF entry in instance network info cache for port bca0154b-0273-4c6d-a4a3-52f45ed0b79f. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 01:02:02 user nova-compute[73010]: DEBUG nova.network.neutron [req-c476274a-58e3-437d-a976-d1d8c4a49c9d req-90fb6adb-58e9-46e1-a259-32cb762a7f5a service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Updating instance_info_cache with network_info: [{"id": "bca0154b-0273-4c6d-a4a3-52f45ed0b79f", "address": "fa:16:3e:92:fb:07", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca0154b-02", "ovs_interfaceid": "bca0154b-0273-4c6d-a4a3-52f45ed0b79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:02:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c476274a-58e3-437d-a976-d1d8c4a49c9d req-90fb6adb-58e9-46e1-a259-32cb762a7f5a service nova] Releasing lock "refresh_cache-1a664ead-4fec-454d-bca2-023afecb409a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:02:03 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:02:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:03 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:03 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:02:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:03 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:02:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:04 user nova-compute[73010]: INFO nova.compute.manager [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Rescuing
Aug 15 01:02:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "refresh_cache-39a36324-d323-4169-abaa-09028eeb5598" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:02:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquired lock "refresh_cache-39a36324-d323-4169-abaa-09028eeb5598" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:02:04 user nova-compute[73010]: DEBUG nova.network.neutron [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 01:02:04 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:02:04 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:02:04 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:02:04 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8467MB free_disk=25.420494079589844GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:02:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:04 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance d79e3854-769c-430a-b980-3a551c7ee34d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:02:04 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 634979eb-b706-4bdd-bb72-c2d163d3f8c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:02:04 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6b931225-177c-4b6c-9989-8e036ad58987 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:02:04 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 39a36324-d323-4169-abaa-09028eeb5598 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:02:04 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 1a664ead-4fec-454d-bca2-023afecb409a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:02:04 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:02:04 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:02:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:05 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:02:05 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:02:05 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:02:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.310s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:05 user nova-compute[73010]: DEBUG nova.network.neutron [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Updating instance_info_cache with network_info: [{"id": "18919d62-63b4-4622-af68-05b0ecfb2002", "address": "fa:16:3e:d7:7a:a7", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18919d62-63", "ovs_interfaceid": "18919d62-63b4-4622-af68-05b0ecfb2002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:02:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Releasing lock "refresh_cache-39a36324-d323-4169-abaa-09028eeb5598" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:02:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:05 user nova-compute[73010]: DEBUG nova.compute.manager [req-71667004-d883-48ff-867c-b1c3b3b82da3 req-971e4ee0-f693-4a6a-b57d-2546cf44f4cc service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received event network-vif-unplugged-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:02:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-71667004-d883-48ff-867c-b1c3b3b82da3 req-971e4ee0-f693-4a6a-b57d-2546cf44f4cc service nova] Acquiring lock "39a36324-d323-4169-abaa-09028eeb5598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-71667004-d883-48ff-867c-b1c3b3b82da3 req-971e4ee0-f693-4a6a-b57d-2546cf44f4cc service nova] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-71667004-d883-48ff-867c-b1c3b3b82da3 req-971e4ee0-f693-4a6a-b57d-2546cf44f4cc service nova] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:05 user nova-compute[73010]: DEBUG nova.compute.manager [req-71667004-d883-48ff-867c-b1c3b3b82da3 req-971e4ee0-f693-4a6a-b57d-2546cf44f4cc service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] No waiting events found dispatching network-vif-unplugged-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:02:05 user nova-compute[73010]: WARNING nova.compute.manager [req-71667004-d883-48ff-867c-b1c3b3b82da3 req-971e4ee0-f693-4a6a-b57d-2546cf44f4cc service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received unexpected event network-vif-unplugged-18919d62-63b4-4622-af68-05b0ecfb2002 for instance with vm_state active and task_state rescuing.
Aug 15 01:02:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:06 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Instance destroyed successfully.
Aug 15 01:02:06 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Attempting a stable device rescue
Aug 15 01:02:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73010) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 01:02:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Instance directory exists: not creating {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 01:02:06 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Creating image(s)
Aug 15 01:02:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "/opt/stack/data/nova/instances/39a36324-d323-4169-abaa-09028eeb5598/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "/opt/stack/data/nova/instances/39a36324-d323-4169-abaa-09028eeb5598/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "/opt/stack/data/nova/instances/39a36324-d323-4169-abaa-09028eeb5598/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:06 user nova-compute[73010]: DEBUG nova.objects.instance [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lazy-loading 'trusted_certs' on Instance uuid 39a36324-d323-4169-abaa-09028eeb5598 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:02:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "03eb72688e0bb7c3ddf53c173e3057a39bf06910" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "03eb72688e0bb7c3ddf53c173e3057a39bf06910" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03eb72688e0bb7c3ddf53c173e3057a39bf06910.part --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03eb72688e0bb7c3ddf53c173e3057a39bf06910.part --force-share --output=json" returned: 0 in 0.187s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG nova.virt.images [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] de00eb3e-3b63-4eb2-903d-03a8fc60db98 was qcow2, converting to raw {{(pid=73010) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG nova.privsep.utils [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73010) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/03eb72688e0bb7c3ddf53c173e3057a39bf06910.part /opt/stack/data/nova/instances/_base/03eb72688e0bb7c3ddf53c173e3057a39bf06910.converted {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG nova.compute.manager [req-d300090c-9442-4ca5-bb5a-17e8d6c994b4 req-10879737-2f3e-40bf-a3b3-264e18a5395f service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received event network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d300090c-9442-4ca5-bb5a-17e8d6c994b4 req-10879737-2f3e-40bf-a3b3-264e18a5395f service nova] Acquiring lock "39a36324-d323-4169-abaa-09028eeb5598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d300090c-9442-4ca5-bb5a-17e8d6c994b4 req-10879737-2f3e-40bf-a3b3-264e18a5395f service nova] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d300090c-9442-4ca5-bb5a-17e8d6c994b4 req-10879737-2f3e-40bf-a3b3-264e18a5395f service nova] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG nova.compute.manager [req-d300090c-9442-4ca5-bb5a-17e8d6c994b4 req-10879737-2f3e-40bf-a3b3-264e18a5395f service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] No waiting events found dispatching network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:02:07 user nova-compute[73010]: WARNING nova.compute.manager [req-d300090c-9442-4ca5-bb5a-17e8d6c994b4 req-10879737-2f3e-40bf-a3b3-264e18a5395f service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received unexpected event network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 for instance with vm_state active and task_state rescuing.
Aug 15 01:02:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/03eb72688e0bb7c3ddf53c173e3057a39bf06910.part /opt/stack/data/nova/instances/_base/03eb72688e0bb7c3ddf53c173e3057a39bf06910.converted" returned: 0 in 0.414s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03eb72688e0bb7c3ddf53c173e3057a39bf06910.converted --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIbCsXeH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:02:07 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:02:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:02:07 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:02:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:02:07 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 01:02:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb37a9a9-43f7-4e8b-97a9-f63362900ccb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 01:02:07 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fafe09-3c4c-4c0e-ad8d-acb26e4d5057]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4] added
Aug 15 01:02:07 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[000fd362-cbb8-4ebc-9fad-0fe4fa23963e]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8bac92-fcd0-4556-b2b8-e63d1cdf8c8f]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vIbCsXeH {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vIbCsXeH" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b887e3-a269-40a0-88bc-b6edca43dbe0]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vIbCsXeH'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03eb72688e0bb7c3ddf53c173e3057a39bf06910.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "03eb72688e0bb7c3ddf53c173e3057a39bf06910" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.845s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "03eb72688e0bb7c3ddf53c173e3057a39bf06910" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "03eb72688e0bb7c3ddf53c173e3057a39bf06910" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03eb72688e0bb7c3ddf53c173e3057a39bf06910 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b65c8b-9936-4d4b-997d-287b8931aa9c]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe6916e-6a28-4039-989f-95f5b984649a]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:02:08 user nova-compute[73010]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:02:08 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:02:08 user nova-compute[73010]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:02:08 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbf17ac-aedc-44ef-9a90-95b1adb37cd2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4, portal: 172.16.0.220,3260]
Aug 15 01:02:08 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4, portal: 172.16.0.220,3260] successful.
Aug 15 01:02:08 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61d757f-14fa-456b-b3d8-6b89c2977655]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03eb72688e0bb7c3ddf53c173e3057a39bf06910 --force-share --output=json" returned: 0 in 0.180s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/03eb72688e0bb7c3ddf53c173e3057a39bf06910,backing_fmt=raw /opt/stack/data/nova/instances/39a36324-d323-4169-abaa-09028eeb5598/disk.rescue {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ea935e-7747-4aa4-a044-a0a18efacd2e]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:02:08 user nova-compute[73010]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:02:08 user nova-compute[73010]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)
Aug 15 01:02:08 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:02:08 user nova-compute[73010]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:02:08 user nova-compute[73010]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)
Aug 15 01:02:08 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] HCTL ('35', '-', '-', 0) found on session 58 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/03eb72688e0bb7c3ddf53c173e3057a39bf06910,backing_fmt=raw /opt/stack/data/nova/instances/39a36324-d323-4169-abaa-09028eeb5598/disk.rescue" returned: 0 in 0.053s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "03eb72688e0bb7c3ddf53c173e3057a39bf06910" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG nova.objects.instance [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lazy-loading 'migration_context' on Instance uuid 39a36324-d323-4169-abaa-09028eeb5598 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b78cc61-85b1-4398-8dea-30e85404789e]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: None {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Start _get_guest_xml network_info=[{"id": "18919d62-63b4-4622-af68-05b0ecfb2002", "address": "fa:16:3e:d7:7a:a7", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "vif_mac": "fa:16:3e:d7:7a:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18919d62-63", "ovs_interfaceid": "18919d62-63b4-4622-af68-05b0ecfb2002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'de00eb3e-3b63-4eb2-903d-03a8fc60db98', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IYBDknor', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '39a36324-d323-4169-abaa-09028eeb5598', 'attached_at': '', 'detached_at': '', 'volume_id': '7096a68e-26fc-49bc-bc01-438af11bb87d', 'serial': '7096a68e-26fc-49bc-bc01-438af11bb87d'}, 'disk_bus': 'virtio', 'attachment_id': 'e2b45385-dec1-4153-b94e-364df6253b37', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG nova.objects.instance [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lazy-loading 'resources' on Instance uuid 39a36324-d323-4169-abaa-09028eeb5598 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG nova.objects.instance [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lazy-loading 'numa_topology' on Instance uuid 39a36324-d323-4169-abaa-09028eeb5598 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:02:08 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:02:08 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:02:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG nova.objects.instance [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lazy-loading 'vcpu_model' on Instance uuid 39a36324-d323-4169-abaa-09028eeb5598 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 01:02:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IYBDknor', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:02:08 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:02:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIbCsXeH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23962623466633037', 'path': '/dev/sdd'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962623466633037', 'path': '/dev/sdd'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.890s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:02:09 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:02:09 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.objects.instance [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lazy-loading 'flavor' on Instance uuid 6b931225-177c-4b6c-9989-8e036ad58987 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fed046-7eb3-4c99-af79-5e4ff4f0ccb0]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = IYBDknor\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 01:02:09 user nova-compute[73010]: node.name = iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d
Aug 15 01:02:09 user nova-compute[73010]: node.tpgt = -1
Aug 15 01:02:09 user nova-compute[73010]: node.startup = automatic
Aug 15 01:02:09 user nova-compute[73010]: node.leading_login = No
Aug 15 01:02:09 user nova-compute[73010]: iface.iscsi_ifacename = default
Aug 15 01:02:09 user nova-compute[73010]: iface.net_ifacename = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.ipaddress = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.prefix_len = 0
Aug 15 01:02:09 user nova-compute[73010]: iface.hwaddress = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.transport_name = tcp
Aug 15 01:02:09 user nova-compute[73010]: iface.initiatorname = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.state = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.vlan_id = 0
Aug 15 01:02:09 user nova-compute[73010]: iface.vlan_priority = 0
Aug 15 01:02:09 user nova-compute[73010]: iface.vlan_state = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.iface_num = 0
Aug 15 01:02:09 user nova-compute[73010]: iface.mtu = 0
Aug 15 01:02:09 user nova-compute[73010]: iface.port = 0
Aug 15 01:02:09 user nova-compute[73010]: iface.bootproto = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.subnet_mask = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.gateway = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.dhcp_alt_client_id = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.dhcp_dns = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.dhcp_learn_iqn = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.dhcp_vendor_id_state = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.dhcp_vendor_id = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.dhcp_slp_da = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.fragmentation = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.gratuitous_arp = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.incoming_forwarding = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.tos_state = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.tos = 0
Aug 15 01:02:09 user nova-compute[73010]: iface.ttl = 0
Aug 15 01:02:09 user nova-compute[73010]: iface.delayed_ack = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.tcp_nagle = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.tcp_wsf_state = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.tcp_wsf = 0
Aug 15 01:02:09 user nova-compute[73010]: iface.tcp_timer_scale = 0
Aug 15 01:02:09 user nova-compute[73010]: iface.tcp_timestamp = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.redirect = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.def_task_mgmt_timeout = 0
Aug 15 01:02:09 user nova-compute[73010]: iface.header_digest = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.data_digest = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.immediate_data = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.initial_r2t = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.data_seq_inorder = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.data_pdu_inorder = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.erl = 0
Aug 15 01:02:09 user nova-compute[73010]: iface.max_receive_data_len = 0
Aug 15 01:02:09 user nova-compute[73010]: iface.first_burst_len = 0
Aug 15 01:02:09 user nova-compute[73010]: iface.max_outstanding_r2t = 0
Aug 15 01:02:09 user nova-compute[73010]: iface.max_burst_len = 0
Aug 15 01:02:09 user nova-compute[73010]: iface.chap_auth = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.bidi_chap = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.strict_login_compliance = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.discovery_auth = <empty>
Aug 15 01:02:09 user nova-compute[73010]: iface.discovery_logout = <empty>
Aug 15 01:02:09 user nova-compute[73010]: node.discovery_address = <empty>
Aug 15 01:02:09 user nova-compute[73010]: node.discovery_port = 0
Aug 15 01:02:09 user nova-compute[73010]: node.discovery_type = static
Aug 15 01:02:09 user nova-compute[73010]: node.session.initial_cmdsn = 0
Aug 15 01:02:09 user nova-compute[73010]: node.session.initial_login_retry_max = 8
Aug 15 01:02:09 user nova-compute[73010]: node.session.xmit_thread_priority = -20
Aug 15 01:02:09 user nova-compute[73010]: node.session.cmds_max = 128
Aug 15 01:02:09 user nova-compute[73010]: node.session.queue_depth = 32
Aug 15 01:02:09 user nova-compute[73010]: node.session.nr_sessions = 1
Aug 15 01:02:09 user nova-compute[73010]: node.session.auth.authmethod = CHAP
Aug 15 01:02:09 user nova-compute[73010]: node.session.auth.username = IYBDknor
Aug 15 01:02:09 user nova-compute[73010]: node.session.auth.password = ***
Aug 15 01:02:09 user nova-compute[73010]: node.session.auth.username_in = <empty>
Aug 15 01:02:09 user nova-compute[73010]: node.session.auth.password_in = <empty>
Aug 15 01:02:09 user nova-compute[73010]: node.session.auth.chap_algs = MD5
Aug 15 01:02:09 user nova-compute[73010]: node.session.timeo.replacement_timeout = 120
Aug 15 01:02:09 user nova-compute[73010]: node.session.err_timeo.abort_timeout = 15
Aug 15 01:02:09 user nova-compute[73010]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 01:02:09 user nova-compute[73010]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 01:02:09 user nova-compute[73010]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 01:02:09 user nova-compute[73010]: node.session.iscsi.FastAbort = Yes
Aug 15 01:02:09 user nova-compute[73010]: node.session.iscsi.InitialR2T = No
Aug 15 01:02:09 user nova-compute[73010]: node.session.iscsi.ImmediateData = Yes
Aug 15 01:02:09 user nova-compute[73010]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 01:02:09 user nova-compute[73010]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 01:02:09 user nova-compute[73010]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 01:02:09 user nova-compute[73010]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 01:02:09 user nova-compute[73010]: node.session.iscsi.MaxConnections = 1
Aug 15 01:02:09 user nova-compute[73010]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 01:02:09 user nova-compute[73010]: node.session.iscsi.ERL = 0
Aug 15 01:02:09 user nova-compute[73010]: node.session.scan = manual
Aug 15 01:02:09 user nova-compute[73010]: node.session.reopen_max = 0
Aug 15 01:02:09 user nova-compute[73010]: node.conn[0].address = 172.16.0.220
Aug 15 01:02:09 user nova-compute[73010]: node.conn[0].port = 3260
Aug 15 01:02:09 user nova-compute[73010]: node.conn[0].startup = manual
Aug 15 01:02:09 user nova-compute[73010]: node.conn[0].tcp.window_size = 524288
Aug 15 01:02:09 user nova-compute[73010]: node.conn[0].tcp.type_of_service = 0
Aug 15 01:02:09 user nova-compute[73010]: node.conn[0].timeo.logout_timeout = 15
Aug 15 01:02:09 user nova-compute[73010]: node.conn[0].timeo.login_timeout = 15
Aug 15 01:02:09 user nova-compute[73010]: node.conn[0].timeo.auth_timeout = 45
Aug 15 01:02:09 user nova-compute[73010]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 01:02:09 user nova-compute[73010]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 01:02:09 user nova-compute[73010]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 01:02:09 user nova-compute[73010]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 01:02:09 user nova-compute[73010]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 01:02:09 user nova-compute[73010]: node.conn[0].iscsi.DataDigest = None
Aug 15 01:02:09 user nova-compute[73010]: node.conn[0].iscsi.IFMarker = No
Aug 15 01:02:09 user nova-compute[73010]: node.conn[0].iscsi.OFMarker = No
Aug 15 01:02:09 user nova-compute[73010]: # END RECORD
Aug 15 01:02:09 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 01:02:09 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:02:09 user nova-compute[73010]:   <source dev="/dev/sdd"/>
Aug 15 01:02:09 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 01:02:09 user nova-compute[73010]:   <serial>15660223-5084-4b21-bec1-f9f08cc0e8d4</serial>
Aug 15 01:02:09 user nova-compute[73010]: </disk>
Aug 15 01:02:09 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f41332a-5513-4a6e-b368-847602c243c6]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a20cd5c-5e26-4508-a843-ed9fa7c8631a]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IYBDknor {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IYBDknor" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f830bc0-0e45-471c-a1eb-b40a08caf020]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IYBDknor'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2ef211-f2cd-4be2-b495-81f269daf53b]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cf4ed9-2d67-4191-94db-31257c36c24b]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:02:09 user nova-compute[73010]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:02:09 user nova-compute[73010]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)
Aug 15 01:02:09 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:02:09 user nova-compute[73010]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:02:09 user nova-compute[73010]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)
Aug 15 01:02:09 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.150s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] HCTL ('34', '0', '0', 0) found on session 57 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[01611529-05bd-4daa-b5ee-60e8f3bd1d71]: (4, ('0 0 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Searching for a device in session 57 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IYBDknor', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.176s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] <== connect_volume: return (1067ms) {'type': 'block', 'scsi_wwn': '23532633264626437', 'path': '/dev/sdc'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532633264626437', 'path': '/dev/sdc'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1935653473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1935653473',id=47,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T01:00:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6db1cb9145b49999d0f102f8cfb867a',ramdisk_id='',reservation_id='r-6x067bjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T01:00:34Z,user_data=None,user_id='8e1e98c9bae145f0909011bb46c6e104',uuid=39a36324-d323-4169-abaa-09028eeb5598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18919d62-63b4-4622-af68-05b0ecfb2002", "address": "fa:16:3e:d7:7a:a7", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "vif_mac": "fa:16:3e:d7:7a:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18919d62-63", "ovs_interfaceid": "18919d62-63b4-4622-af68-05b0ecfb2002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converting VIF {"id": "18919d62-63b4-4622-af68-05b0ecfb2002", "address": "fa:16:3e:d7:7a:a7", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "vif_mac": "fa:16:3e:d7:7a:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18919d62-63", "ovs_interfaceid": "18919d62-63b4-4622-af68-05b0ecfb2002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:7a:a7,bridge_name='br-int',has_traffic_filtering=True,id=18919d62-63b4-4622-af68-05b0ecfb2002,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18919d62-63') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.objects.instance [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lazy-loading 'pci_devices' on Instance uuid 39a36324-d323-4169-abaa-09028eeb5598 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] End _get_guest_xml xml=<domain type="kvm">
Aug 15 01:02:09 user nova-compute[73010]:   <uuid>39a36324-d323-4169-abaa-09028eeb5598</uuid>
Aug 15 01:02:09 user nova-compute[73010]:   <name>instance-0000002f</name>
Aug 15 01:02:09 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 01:02:09 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 01:02:09 user nova-compute[73010]:   <metadata>
Aug 15 01:02:09 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 01:02:09 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 01:02:09 user nova-compute[73010]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1935653473</nova:name>
Aug 15 01:02:09 user nova-compute[73010]:       <nova:creationTime>2023-08-15 01:02:08</nova:creationTime>
Aug 15 01:02:09 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 01:02:09 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 01:02:09 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 01:02:09 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 01:02:09 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 01:02:09 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 01:02:09 user nova-compute[73010]:       </nova:flavor>
Aug 15 01:02:09 user nova-compute[73010]:       <nova:owner>
Aug 15 01:02:09 user nova-compute[73010]:         <nova:user uuid="8e1e98c9bae145f0909011bb46c6e104">tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member</nova:user>
Aug 15 01:02:09 user nova-compute[73010]:         <nova:project uuid="f6db1cb9145b49999d0f102f8cfb867a">tempest-ServerBootFromVolumeStableRescueTest-1758225981</nova:project>
Aug 15 01:02:09 user nova-compute[73010]:       </nova:owner>
Aug 15 01:02:09 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 01:02:09 user nova-compute[73010]:       <nova:ports>
Aug 15 01:02:09 user nova-compute[73010]:         <nova:port uuid="18919d62-63b4-4622-af68-05b0ecfb2002">
Aug 15 01:02:09 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 01:02:09 user nova-compute[73010]:         </nova:port>
Aug 15 01:02:09 user nova-compute[73010]:       </nova:ports>
Aug 15 01:02:09 user nova-compute[73010]:     </nova:instance>
Aug 15 01:02:09 user nova-compute[73010]:   </metadata>
Aug 15 01:02:09 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 01:02:09 user nova-compute[73010]:     <system>
Aug 15 01:02:09 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 01:02:09 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 01:02:09 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 01:02:09 user nova-compute[73010]:       <entry name="serial">39a36324-d323-4169-abaa-09028eeb5598</entry>
Aug 15 01:02:09 user nova-compute[73010]:       <entry name="uuid">39a36324-d323-4169-abaa-09028eeb5598</entry>
Aug 15 01:02:09 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 01:02:09 user nova-compute[73010]:     </system>
Aug 15 01:02:09 user nova-compute[73010]:   </sysinfo>
Aug 15 01:02:09 user nova-compute[73010]:   <os>
Aug 15 01:02:09 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 01:02:09 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 01:02:09 user nova-compute[73010]:   </os>
Aug 15 01:02:09 user nova-compute[73010]:   <features>
Aug 15 01:02:09 user nova-compute[73010]:     <acpi/>
Aug 15 01:02:09 user nova-compute[73010]:     <apic/>
Aug 15 01:02:09 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 01:02:09 user nova-compute[73010]:   </features>
Aug 15 01:02:09 user nova-compute[73010]:   <clock offset="utc">
Aug 15 01:02:09 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 01:02:09 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 01:02:09 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 01:02:09 user nova-compute[73010]:   </clock>
Aug 15 01:02:09 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 01:02:09 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 01:02:09 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 01:02:09 user nova-compute[73010]:   </cpu>
Aug 15 01:02:09 user nova-compute[73010]:   <devices>
Aug 15 01:02:09 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 01:02:09 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:02:09 user nova-compute[73010]:       <source dev="/dev/sdc"/>
Aug 15 01:02:09 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 01:02:09 user nova-compute[73010]:       <serial>7096a68e-26fc-49bc-bc01-438af11bb87d</serial>
Aug 15 01:02:09 user nova-compute[73010]:     </disk>
Aug 15 01:02:09 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 01:02:09 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 01:02:09 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/39a36324-d323-4169-abaa-09028eeb5598/disk.rescue"/>
Aug 15 01:02:09 user nova-compute[73010]:       <target dev="vdb" bus="virtio"/>
Aug 15 01:02:09 user nova-compute[73010]:       <boot order="1"/>
Aug 15 01:02:09 user nova-compute[73010]:     </disk>
Aug 15 01:02:09 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 01:02:09 user nova-compute[73010]:       <mac address="fa:16:3e:d7:7a:a7"/>
Aug 15 01:02:09 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:02:09 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 01:02:09 user nova-compute[73010]:       <target dev="tap18919d62-63"/>
Aug 15 01:02:09 user nova-compute[73010]:     </interface>
Aug 15 01:02:09 user nova-compute[73010]:     <serial type="pty">
Aug 15 01:02:09 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/39a36324-d323-4169-abaa-09028eeb5598/console.log" append="off"/>
Aug 15 01:02:09 user nova-compute[73010]:     </serial>
Aug 15 01:02:09 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 01:02:09 user nova-compute[73010]:     <video>
Aug 15 01:02:09 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:02:09 user nova-compute[73010]:     </video>
Aug 15 01:02:09 user nova-compute[73010]:     <rng model="virtio">
Aug 15 01:02:09 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 01:02:09 user nova-compute[73010]:     </rng>
Aug 15 01:02:09 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 01:02:09 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 01:02:09 user nova-compute[73010]:       <stats period="10"/>
Aug 15 01:02:09 user nova-compute[73010]:     </memballoon>
Aug 15 01:02:09 user nova-compute[73010]:   </devices>
Aug 15 01:02:09 user nova-compute[73010]: </domain>
Aug 15 01:02:09 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 01:02:09 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Instance destroyed successfully.
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] No VIF found with MAC fa:16:3e:d7:7a:a7, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 01:02:09 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Creating image(s)
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Did not create local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Ensure instance console log exists: /opt/stack/data/nova/instances/1a664ead-4fec-454d-bca2-023afecb409a/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Start _get_guest_xml network_info=[{"id": "bca0154b-0273-4c6d-a4a3-52f45ed0b79f", "address": "fa:16:3e:92:fb:07", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca0154b-02", "ovs_interfaceid": "bca0154b-0273-4c6d-a4a3-52f45ed0b79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yTSiVFsd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1a664ead-4fec-454d-bca2-023afecb409a', 'attached_at': '', 'detached_at': '', 'volume_id': '7a4cec08-99b4-4055-b567-7906c7650ad2', 'serial': '7a4cec08-99b4-4055-b567-7906c7650ad2'}, 'disk_bus': 'virtio', 'attachment_id': 'afd9b5e6-6c9e-4a7b-85ab-98b81f70aebf', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] No VIF found with MAC fa:16:3e:b7:84:04, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 01:02:09 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:02:09 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yTSiVFsd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:02:09 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:02:09 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:02:09 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc9c275-279c-4bf6-8fad-ff17576c9da5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 01:02:09 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f74a402-eb77-4690-879a-d15bab088d12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2] added
Aug 15 01:02:09 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ba3f13-d706-4702-96a1-15aaab889b19]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-1732aabe-8957-4e83-a5c3-16bd4f1d9437 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "6b931225-177c-4b6c-9989-8e036ad58987" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.471s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b28dc99-9c77-4805-bb9b-3b9427132538]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yTSiVFsd {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yTSiVFsd" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[17463155-df7c-487b-8a66-aa69d58f8ac8]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yTSiVFsd'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3d07f0-d38c-4a48-8246-c92ee0f707a4]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1457b8b-8cee-4ae5-9f49-851866d4c0df]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:02:09 user nova-compute[73010]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:02:09 user nova-compute[73010]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)
Aug 15 01:02:09 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:02:09 user nova-compute[73010]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:02:09 user nova-compute[73010]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)
Aug 15 01:02:09 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:02:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9444c86b-235a-4cdd-a5a3-a48a9043b989]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2, portal: 172.16.0.220,3260]
Aug 15 01:02:10 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2, portal: 172.16.0.220,3260] successful.
Aug 15 01:02:10 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e157b8cc-324c-4137-a8df-98a7234824cd]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f7f44a-b299-4de7-b278-91819d11df60]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:02:10 user nova-compute[73010]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:02:10 user nova-compute[73010]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)
Aug 15 01:02:10 user nova-compute[73010]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 (non-flash)
Aug 15 01:02:10 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:02:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:02:10 user nova-compute[73010]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:02:10 user nova-compute[73010]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)
Aug 15 01:02:10 user nova-compute[73010]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 (non-flash)
Aug 15 01:02:10 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:02:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:02:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 01:02:10 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] HCTL ('36', '-', '-', 0) found on session 59 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 01:02:10 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 01:02:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:10 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c8e425-2a40-416a-bf61-b9c8c6683cf9]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:10 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Searching for a device in session 59 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 01:02:10 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yTSiVFsd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 01:02:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23464343133346162', 'path': '/dev/sde'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464343133346162', 'path': '/dev/sde'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:01:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1187119549',display_name='tempest-TestVolumeBootPattern-server-1187119549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1187119549',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1zaN+b+VydDVLamZvE8X1Kd/Q5Q2Sojr9sHX021PLtuvBNvO93jAR1znkRwvthrtxRfhwBKAX8n8oRWo/mH1ipr8A9qzs9a0e/tyPo6tpDcd6aKpdp/ZnfjKtEL/p1Mg==',key_name='tempest-TestVolumeBootPattern-1981746338',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f67d1031d3cb4c8fb66342a7888ca1c4',ramdisk_id='',reservation_id='r-zqtpw94w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1953358779',owner_user_name='tempest-TestVolumeBootPattern-1953358779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T01:02:00Z,user_data=None,user_id='daa4eb788f724a6fbf908b029315a02b',uuid=1a664ead-4fec-454d-bca2-023afecb409a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bca0154b-0273-4c6d-a4a3-52f45ed0b79f", "address": "fa:16:3e:92:fb:07", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca0154b-02", "ovs_interfaceid": "bca0154b-0273-4c6d-a4a3-52f45ed0b79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converting VIF {"id": "bca0154b-0273-4c6d-a4a3-52f45ed0b79f", "address": "fa:16:3e:92:fb:07", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca0154b-02", "ovs_interfaceid": "bca0154b-0273-4c6d-a4a3-52f45ed0b79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:fb:07,bridge_name='br-int',has_traffic_filtering=True,id=bca0154b-0273-4c6d-a4a3-52f45ed0b79f,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca0154b-02') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG nova.objects.instance [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a664ead-4fec-454d-bca2-023afecb409a {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 01:02:11 user nova-compute[73010]:   <uuid>1a664ead-4fec-454d-bca2-023afecb409a</uuid>
Aug 15 01:02:11 user nova-compute[73010]:   <name>instance-00000030</name>
Aug 15 01:02:11 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 01:02:11 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 01:02:11 user nova-compute[73010]:   <metadata>
Aug 15 01:02:11 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 01:02:11 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 01:02:11 user nova-compute[73010]:       <nova:name>tempest-TestVolumeBootPattern-server-1187119549</nova:name>
Aug 15 01:02:11 user nova-compute[73010]:       <nova:creationTime>2023-08-15 01:02:09</nova:creationTime>
Aug 15 01:02:11 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 01:02:11 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 01:02:11 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 01:02:11 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 01:02:11 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 01:02:11 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 01:02:11 user nova-compute[73010]:       </nova:flavor>
Aug 15 01:02:11 user nova-compute[73010]:       <nova:owner>
Aug 15 01:02:11 user nova-compute[73010]:         <nova:user uuid="daa4eb788f724a6fbf908b029315a02b">tempest-TestVolumeBootPattern-1953358779-project-member</nova:user>
Aug 15 01:02:11 user nova-compute[73010]:         <nova:project uuid="f67d1031d3cb4c8fb66342a7888ca1c4">tempest-TestVolumeBootPattern-1953358779</nova:project>
Aug 15 01:02:11 user nova-compute[73010]:       </nova:owner>
Aug 15 01:02:11 user nova-compute[73010]:       <nova:ports>
Aug 15 01:02:11 user nova-compute[73010]:         <nova:port uuid="bca0154b-0273-4c6d-a4a3-52f45ed0b79f">
Aug 15 01:02:11 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 01:02:11 user nova-compute[73010]:         </nova:port>
Aug 15 01:02:11 user nova-compute[73010]:       </nova:ports>
Aug 15 01:02:11 user nova-compute[73010]:     </nova:instance>
Aug 15 01:02:11 user nova-compute[73010]:   </metadata>
Aug 15 01:02:11 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 01:02:11 user nova-compute[73010]:     <system>
Aug 15 01:02:11 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 01:02:11 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 01:02:11 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 01:02:11 user nova-compute[73010]:       <entry name="serial">1a664ead-4fec-454d-bca2-023afecb409a</entry>
Aug 15 01:02:11 user nova-compute[73010]:       <entry name="uuid">1a664ead-4fec-454d-bca2-023afecb409a</entry>
Aug 15 01:02:11 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 01:02:11 user nova-compute[73010]:     </system>
Aug 15 01:02:11 user nova-compute[73010]:   </sysinfo>
Aug 15 01:02:11 user nova-compute[73010]:   <os>
Aug 15 01:02:11 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 01:02:11 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 01:02:11 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 01:02:11 user nova-compute[73010]:   </os>
Aug 15 01:02:11 user nova-compute[73010]:   <features>
Aug 15 01:02:11 user nova-compute[73010]:     <acpi/>
Aug 15 01:02:11 user nova-compute[73010]:     <apic/>
Aug 15 01:02:11 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 01:02:11 user nova-compute[73010]:   </features>
Aug 15 01:02:11 user nova-compute[73010]:   <clock offset="utc">
Aug 15 01:02:11 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 01:02:11 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 01:02:11 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 01:02:11 user nova-compute[73010]:   </clock>
Aug 15 01:02:11 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 01:02:11 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 01:02:11 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 01:02:11 user nova-compute[73010]:   </cpu>
Aug 15 01:02:11 user nova-compute[73010]:   <devices>
Aug 15 01:02:11 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 01:02:11 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:02:11 user nova-compute[73010]:       <source dev="/dev/sde"/>
Aug 15 01:02:11 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 01:02:11 user nova-compute[73010]:       <serial>7a4cec08-99b4-4055-b567-7906c7650ad2</serial>
Aug 15 01:02:11 user nova-compute[73010]:     </disk>
Aug 15 01:02:11 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 01:02:11 user nova-compute[73010]:       <mac address="fa:16:3e:92:fb:07"/>
Aug 15 01:02:11 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:02:11 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 01:02:11 user nova-compute[73010]:       <target dev="tapbca0154b-02"/>
Aug 15 01:02:11 user nova-compute[73010]:     </interface>
Aug 15 01:02:11 user nova-compute[73010]:     <serial type="pty">
Aug 15 01:02:11 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/1a664ead-4fec-454d-bca2-023afecb409a/console.log" append="off"/>
Aug 15 01:02:11 user nova-compute[73010]:     </serial>
Aug 15 01:02:11 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 01:02:11 user nova-compute[73010]:     <video>
Aug 15 01:02:11 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:02:11 user nova-compute[73010]:     </video>
Aug 15 01:02:11 user nova-compute[73010]:     <rng model="virtio">
Aug 15 01:02:11 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 01:02:11 user nova-compute[73010]:     </rng>
Aug 15 01:02:11 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 01:02:11 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 01:02:11 user nova-compute[73010]:       <stats period="10"/>
Aug 15 01:02:11 user nova-compute[73010]:     </memballoon>
Aug 15 01:02:11 user nova-compute[73010]:   </devices>
Aug 15 01:02:11 user nova-compute[73010]: </domain>
Aug 15 01:02:11 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:01:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1187119549',display_name='tempest-TestVolumeBootPattern-server-1187119549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1187119549',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1zaN+b+VydDVLamZvE8X1Kd/Q5Q2Sojr9sHX021PLtuvBNvO93jAR1znkRwvthrtxRfhwBKAX8n8oRWo/mH1ipr8A9qzs9a0e/tyPo6tpDcd6aKpdp/ZnfjKtEL/p1Mg==',key_name='tempest-TestVolumeBootPattern-1981746338',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f67d1031d3cb4c8fb66342a7888ca1c4',ramdisk_id='',reservation_id='r-zqtpw94w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1953358779',owner_user_name='tempest-TestVolumeBootPattern-1953358779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T01:02:00Z,user_data=None,user_id='daa4eb788f724a6fbf908b029315a02b',uuid=1a664ead-4fec-454d-bca2-023afecb409a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bca0154b-0273-4c6d-a4a3-52f45ed0b79f", "address": "fa:16:3e:92:fb:07", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca0154b-02", "ovs_interfaceid": "bca0154b-0273-4c6d-a4a3-52f45ed0b79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converting VIF {"id": "bca0154b-0273-4c6d-a4a3-52f45ed0b79f", "address": "fa:16:3e:92:fb:07", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca0154b-02", "ovs_interfaceid": "bca0154b-0273-4c6d-a4a3-52f45ed0b79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:fb:07,bridge_name='br-int',has_traffic_filtering=True,id=bca0154b-0273-4c6d-a4a3-52f45ed0b79f,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca0154b-02') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG os_vif [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:fb:07,bridge_name='br-int',has_traffic_filtering=True,id=bca0154b-0273-4c6d-a4a3-52f45ed0b79f,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca0154b-02') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbca0154b-02, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbca0154b-02, col_values=(('external_ids', {'iface-id': 'bca0154b-0273-4c6d-a4a3-52f45ed0b79f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:fb:07', 'vm-uuid': '1a664ead-4fec-454d-bca2-023afecb409a'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:11 user nova-compute[73010]: INFO os_vif [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:fb:07,bridge_name='br-int',has_traffic_filtering=True,id=bca0154b-0273-4c6d-a4a3-52f45ed0b79f,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca0154b-02')
Aug 15 01:02:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] No VIF found with MAC fa:16:3e:92:fb:07, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-204cb435-9912-49ca-97e5-9dfc5ca7666e req-5b0deab6-7faf-43c2-a5c4-26c595eaae9a service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received event network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-204cb435-9912-49ca-97e5-9dfc5ca7666e req-5b0deab6-7faf-43c2-a5c4-26c595eaae9a service nova] Acquiring lock "39a36324-d323-4169-abaa-09028eeb5598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-204cb435-9912-49ca-97e5-9dfc5ca7666e req-5b0deab6-7faf-43c2-a5c4-26c595eaae9a service nova] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-204cb435-9912-49ca-97e5-9dfc5ca7666e req-5b0deab6-7faf-43c2-a5c4-26c595eaae9a service nova] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-204cb435-9912-49ca-97e5-9dfc5ca7666e req-5b0deab6-7faf-43c2-a5c4-26c595eaae9a service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] No waiting events found dispatching network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:02:11 user nova-compute[73010]: WARNING nova.compute.manager [req-204cb435-9912-49ca-97e5-9dfc5ca7666e req-5b0deab6-7faf-43c2-a5c4-26c595eaae9a service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received unexpected event network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 for instance with vm_state active and task_state rescuing.
Aug 15 01:02:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-fd2acb44-bedf-4c22-8dec-af82bd8e6630 req-17b9d9a6-0a73-4ff4-897b-589c78b6db0a service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Received event network-changed-c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:02:12 user nova-compute[73010]: DEBUG nova.compute.manager [req-fd2acb44-bedf-4c22-8dec-af82bd8e6630 req-17b9d9a6-0a73-4ff4-897b-589c78b6db0a service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Refreshing instance network info cache due to event network-changed-c94c8a3a-6c88-482c-8c90-86341f11658d. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 01:02:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-fd2acb44-bedf-4c22-8dec-af82bd8e6630 req-17b9d9a6-0a73-4ff4-897b-589c78b6db0a service nova] Acquiring lock "refresh_cache-6b931225-177c-4b6c-9989-8e036ad58987" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:02:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-fd2acb44-bedf-4c22-8dec-af82bd8e6630 req-17b9d9a6-0a73-4ff4-897b-589c78b6db0a service nova] Acquired lock "refresh_cache-6b931225-177c-4b6c-9989-8e036ad58987" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:02:12 user nova-compute[73010]: DEBUG nova.network.neutron [req-fd2acb44-bedf-4c22-8dec-af82bd8e6630 req-17b9d9a6-0a73-4ff4-897b-589c78b6db0a service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Refreshing network info cache for port c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 01:02:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:13 user nova-compute[73010]: DEBUG nova.compute.manager [req-05c2c66f-0d4a-4738-8549-c2fa677c7b82 req-f2c5d694-a794-4425-9c9d-9e21442bb5f9 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received event network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:02:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-05c2c66f-0d4a-4738-8549-c2fa677c7b82 req-f2c5d694-a794-4425-9c9d-9e21442bb5f9 service nova] Acquiring lock "39a36324-d323-4169-abaa-09028eeb5598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-05c2c66f-0d4a-4738-8549-c2fa677c7b82 req-f2c5d694-a794-4425-9c9d-9e21442bb5f9 service nova] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-05c2c66f-0d4a-4738-8549-c2fa677c7b82 req-f2c5d694-a794-4425-9c9d-9e21442bb5f9 service nova] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:13 user nova-compute[73010]: DEBUG nova.compute.manager [req-05c2c66f-0d4a-4738-8549-c2fa677c7b82 req-f2c5d694-a794-4425-9c9d-9e21442bb5f9 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] No waiting events found dispatching network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:02:13 user nova-compute[73010]: WARNING nova.compute.manager [req-05c2c66f-0d4a-4738-8549-c2fa677c7b82 req-f2c5d694-a794-4425-9c9d-9e21442bb5f9 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received unexpected event network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 for instance with vm_state active and task_state rescuing.
Aug 15 01:02:13 user nova-compute[73010]: DEBUG nova.network.neutron [req-fd2acb44-bedf-4c22-8dec-af82bd8e6630 req-17b9d9a6-0a73-4ff4-897b-589c78b6db0a service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Updated VIF entry in instance network info cache for port c94c8a3a-6c88-482c-8c90-86341f11658d. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 01:02:13 user nova-compute[73010]: DEBUG nova.network.neutron [req-fd2acb44-bedf-4c22-8dec-af82bd8e6630 req-17b9d9a6-0a73-4ff4-897b-589c78b6db0a service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Updating instance_info_cache with network_info: [{"id": "c94c8a3a-6c88-482c-8c90-86341f11658d", "address": "fa:16:3e:b7:84:04", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c8a3a-6c", "ovs_interfaceid": "c94c8a3a-6c88-482c-8c90-86341f11658d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:02:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-fd2acb44-bedf-4c22-8dec-af82bd8e6630 req-17b9d9a6-0a73-4ff4-897b-589c78b6db0a service nova] Releasing lock "refresh_cache-6b931225-177c-4b6c-9989-8e036ad58987" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Removed pending event for 39a36324-d323-4169-abaa-09028eeb5598 due to event {{(pid=73010) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061334.4356813, 39a36324-d323-4169-abaa-09028eeb5598 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:02:14 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] VM Resumed (Lifecycle Event)
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.compute.manager [None req-665683a4-3d00-4789-8c8c-2a5bb731103b tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:02:14 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061334.4372904, 39a36324-d323-4169-abaa-09028eeb5598 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:02:14 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] VM Started (Lifecycle Event)
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.compute.manager [req-a6fb5452-bcdf-4794-825d-ef1e75fc9e4f req-efb8ef6d-8447-4508-9345-8179182fbb71 service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Received event network-vif-plugged-bca0154b-0273-4c6d-a4a3-52f45ed0b79f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a6fb5452-bcdf-4794-825d-ef1e75fc9e4f req-efb8ef6d-8447-4508-9345-8179182fbb71 service nova] Acquiring lock "1a664ead-4fec-454d-bca2-023afecb409a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a6fb5452-bcdf-4794-825d-ef1e75fc9e4f req-efb8ef6d-8447-4508-9345-8179182fbb71 service nova] Lock "1a664ead-4fec-454d-bca2-023afecb409a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a6fb5452-bcdf-4794-825d-ef1e75fc9e4f req-efb8ef6d-8447-4508-9345-8179182fbb71 service nova] Lock "1a664ead-4fec-454d-bca2-023afecb409a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.compute.manager [req-a6fb5452-bcdf-4794-825d-ef1e75fc9e4f req-efb8ef6d-8447-4508-9345-8179182fbb71 service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] No waiting events found dispatching network-vif-plugged-bca0154b-0273-4c6d-a4a3-52f45ed0b79f {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:02:14 user nova-compute[73010]: WARNING nova.compute.manager [req-a6fb5452-bcdf-4794-825d-ef1e75fc9e4f req-efb8ef6d-8447-4508-9345-8179182fbb71 service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Received unexpected event network-vif-plugged-bca0154b-0273-4c6d-a4a3-52f45ed0b79f for instance with vm_state building and task_state spawning.
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.compute.manager [req-a6fb5452-bcdf-4794-825d-ef1e75fc9e4f req-efb8ef6d-8447-4508-9345-8179182fbb71 service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Received event network-vif-plugged-bca0154b-0273-4c6d-a4a3-52f45ed0b79f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a6fb5452-bcdf-4794-825d-ef1e75fc9e4f req-efb8ef6d-8447-4508-9345-8179182fbb71 service nova] Acquiring lock "1a664ead-4fec-454d-bca2-023afecb409a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a6fb5452-bcdf-4794-825d-ef1e75fc9e4f req-efb8ef6d-8447-4508-9345-8179182fbb71 service nova] Lock "1a664ead-4fec-454d-bca2-023afecb409a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a6fb5452-bcdf-4794-825d-ef1e75fc9e4f req-efb8ef6d-8447-4508-9345-8179182fbb71 service nova] Lock "1a664ead-4fec-454d-bca2-023afecb409a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.compute.manager [req-a6fb5452-bcdf-4794-825d-ef1e75fc9e4f req-efb8ef6d-8447-4508-9345-8179182fbb71 service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] No waiting events found dispatching network-vif-plugged-bca0154b-0273-4c6d-a4a3-52f45ed0b79f {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:02:14 user nova-compute[73010]: WARNING nova.compute.manager [req-a6fb5452-bcdf-4794-825d-ef1e75fc9e4f req-efb8ef6d-8447-4508-9345-8179182fbb71 service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Received unexpected event network-vif-plugged-bca0154b-0273-4c6d-a4a3-52f45ed0b79f for instance with vm_state building and task_state spawning.
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061334.9286008, 1a664ead-4fec-454d-bca2-023afecb409a => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:02:14 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] VM Resumed (Lifecycle Event)
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.compute.manager [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:02:14 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Instance spawned successfully.
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:02:14 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 01:02:14 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061334.9320025, 1a664ead-4fec-454d-bca2-023afecb409a => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:02:14 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] VM Started (Lifecycle Event)
Aug 15 01:02:15 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:02:15 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:02:15 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 01:02:15 user nova-compute[73010]: INFO nova.compute.manager [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Took 5.31 seconds to spawn the instance on the hypervisor.
Aug 15 01:02:15 user nova-compute[73010]: DEBUG nova.compute.manager [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:02:15 user nova-compute[73010]: INFO nova.compute.manager [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Took 15.53 seconds to build instance.
Aug 15 01:02:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9f7480fb-99d3-4dde-b521-fb47acbd4941 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "1a664ead-4fec-454d-bca2-023afecb409a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.643s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a787714e-7ff6-4d91-87f0-3a8c3b0fad0f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "6b931225-177c-4b6c-9989-8e036ad58987" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a787714e-7ff6-4d91-87f0-3a8c3b0fad0f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "6b931225-177c-4b6c-9989-8e036ad58987" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:15 user nova-compute[73010]: INFO nova.compute.manager [None req-a787714e-7ff6-4d91-87f0-3a8c3b0fad0f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Rebooting instance
Aug 15 01:02:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a787714e-7ff6-4d91-87f0-3a8c3b0fad0f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "refresh_cache-6b931225-177c-4b6c-9989-8e036ad58987" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:02:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a787714e-7ff6-4d91-87f0-3a8c3b0fad0f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquired lock "refresh_cache-6b931225-177c-4b6c-9989-8e036ad58987" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:02:15 user nova-compute[73010]: DEBUG nova.network.neutron [None req-a787714e-7ff6-4d91-87f0-3a8c3b0fad0f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 01:02:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-79e1e530-2b86-4a77-9360-87f03d5ccae8 req-d7cbbb61-9c6b-4361-ab3a-d664373cc8d3 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Received event network-changed-c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:02:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-79e1e530-2b86-4a77-9360-87f03d5ccae8 req-d7cbbb61-9c6b-4361-ab3a-d664373cc8d3 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Refreshing instance network info cache due to event network-changed-c94c8a3a-6c88-482c-8c90-86341f11658d. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 01:02:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-79e1e530-2b86-4a77-9360-87f03d5ccae8 req-d7cbbb61-9c6b-4361-ab3a-d664373cc8d3 service nova] Acquiring lock "refresh_cache-6b931225-177c-4b6c-9989-8e036ad58987" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:02:15 user nova-compute[73010]: DEBUG nova.network.neutron [None req-a787714e-7ff6-4d91-87f0-3a8c3b0fad0f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Updating instance_info_cache with network_info: [{"id": "c94c8a3a-6c88-482c-8c90-86341f11658d", "address": "fa:16:3e:b7:84:04", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c8a3a-6c", "ovs_interfaceid": "c94c8a3a-6c88-482c-8c90-86341f11658d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:02:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a787714e-7ff6-4d91-87f0-3a8c3b0fad0f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Releasing lock "refresh_cache-6b931225-177c-4b6c-9989-8e036ad58987" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:02:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-79e1e530-2b86-4a77-9360-87f03d5ccae8 req-d7cbbb61-9c6b-4361-ab3a-d664373cc8d3 service nova] Acquired lock "refresh_cache-6b931225-177c-4b6c-9989-8e036ad58987" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:02:15 user nova-compute[73010]: DEBUG nova.network.neutron [req-79e1e530-2b86-4a77-9360-87f03d5ccae8 req-d7cbbb61-9c6b-4361-ab3a-d664373cc8d3 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Refreshing network info cache for port c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 01:02:15 user nova-compute[73010]: DEBUG nova.compute.manager [None req-a787714e-7ff6-4d91-87f0-3a8c3b0fad0f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:02:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:16 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:02:16 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:02:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-6b931225-177c-4b6c-9989-8e036ad58987" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:02:16 user nova-compute[73010]: DEBUG nova.network.neutron [req-79e1e530-2b86-4a77-9360-87f03d5ccae8 req-d7cbbb61-9c6b-4361-ab3a-d664373cc8d3 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Updated VIF entry in instance network info cache for port c94c8a3a-6c88-482c-8c90-86341f11658d. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 01:02:16 user nova-compute[73010]: DEBUG nova.network.neutron [req-79e1e530-2b86-4a77-9360-87f03d5ccae8 req-d7cbbb61-9c6b-4361-ab3a-d664373cc8d3 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Updating instance_info_cache with network_info: [{"id": "c94c8a3a-6c88-482c-8c90-86341f11658d", "address": "fa:16:3e:b7:84:04", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c8a3a-6c", "ovs_interfaceid": "c94c8a3a-6c88-482c-8c90-86341f11658d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:02:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-79e1e530-2b86-4a77-9360-87f03d5ccae8 req-d7cbbb61-9c6b-4361-ab3a-d664373cc8d3 service nova] Releasing lock "refresh_cache-6b931225-177c-4b6c-9989-8e036ad58987" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:02:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-6b931225-177c-4b6c-9989-8e036ad58987" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:02:16 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:17 user nova-compute[73010]: INFO nova.compute.manager [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Unshelving
Aug 15 01:02:17 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Updating instance_info_cache with network_info: [{"id": "c94c8a3a-6c88-482c-8c90-86341f11658d", "address": "fa:16:3e:b7:84:04", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c8a3a-6c", "ovs_interfaceid": "c94c8a3a-6c88-482c-8c90-86341f11658d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-6b931225-177c-4b6c-9989-8e036ad58987" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:02:17 user nova-compute[73010]: INFO nova.virt.block_device [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Booting with volume f1be21ab-24ec-4988-bc02-dc2c82f3fd0b at /dev/vdc
Aug 15 01:02:17 user nova-compute[73010]: DEBUG os_brick.utils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d83c3d-36b6-463b-80cd-0bdf8859d2ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[758abd4e-7823-4c38-ab49-21623acff005]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2aca56-541b-4543-bdc8-35358fc6375e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bb40af-71de-4462-b5c3-a89af349a35a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 01:02:17 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 01:02:17 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4430c0-1d91-49fb-b909-12920f288ebc]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG os_brick.utils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:02:17 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Updating existing volume attachment record: 16fb9e10-c508-4d78-bfaa-2141aa1ff151 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 01:02:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:18 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:02:18 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:02:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:02:18 user nova-compute[73010]: DEBUG nova.compute.manager [req-dcb165ae-25b6-4921-9d7c-6eb15fce2ac8 req-26c84a2f-59ea-4f52-8ad1-31ac55d99ea5 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Received event network-vif-unplugged-c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:02:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dcb165ae-25b6-4921-9d7c-6eb15fce2ac8 req-26c84a2f-59ea-4f52-8ad1-31ac55d99ea5 service nova] Acquiring lock "6b931225-177c-4b6c-9989-8e036ad58987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dcb165ae-25b6-4921-9d7c-6eb15fce2ac8 req-26c84a2f-59ea-4f52-8ad1-31ac55d99ea5 service nova] Lock "6b931225-177c-4b6c-9989-8e036ad58987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dcb165ae-25b6-4921-9d7c-6eb15fce2ac8 req-26c84a2f-59ea-4f52-8ad1-31ac55d99ea5 service nova] Lock "6b931225-177c-4b6c-9989-8e036ad58987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:18 user nova-compute[73010]: DEBUG nova.compute.manager [req-dcb165ae-25b6-4921-9d7c-6eb15fce2ac8 req-26c84a2f-59ea-4f52-8ad1-31ac55d99ea5 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] No waiting events found dispatching network-vif-unplugged-c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:02:18 user nova-compute[73010]: WARNING nova.compute.manager [req-dcb165ae-25b6-4921-9d7c-6eb15fce2ac8 req-26c84a2f-59ea-4f52-8ad1-31ac55d99ea5 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Received unexpected event network-vif-unplugged-c94c8a3a-6c88-482c-8c90-86341f11658d for instance with vm_state active and task_state reboot_started.
Aug 15 01:02:19 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-a787714e-7ff6-4d91-87f0-3a8c3b0fad0f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Instance shutdown successfully.
Aug 15 01:02:20 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:02:20 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:02:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-2bd0d0c5-a2e5-4c9d-b745-a4dd43537c2d req-9814d6d4-5396-4626-9544-6c2985296938 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Received event network-vif-plugged-c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:02:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2bd0d0c5-a2e5-4c9d-b745-a4dd43537c2d req-9814d6d4-5396-4626-9544-6c2985296938 service nova] Acquiring lock "6b931225-177c-4b6c-9989-8e036ad58987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2bd0d0c5-a2e5-4c9d-b745-a4dd43537c2d req-9814d6d4-5396-4626-9544-6c2985296938 service nova] Lock "6b931225-177c-4b6c-9989-8e036ad58987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2bd0d0c5-a2e5-4c9d-b745-a4dd43537c2d req-9814d6d4-5396-4626-9544-6c2985296938 service nova] Lock "6b931225-177c-4b6c-9989-8e036ad58987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-2bd0d0c5-a2e5-4c9d-b745-a4dd43537c2d req-9814d6d4-5396-4626-9544-6c2985296938 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] No waiting events found dispatching network-vif-plugged-c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:02:20 user nova-compute[73010]: WARNING nova.compute.manager [req-2bd0d0c5-a2e5-4c9d-b745-a4dd43537c2d req-9814d6d4-5396-4626-9544-6c2985296938 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Received unexpected event network-vif-plugged-c94c8a3a-6c88-482c-8c90-86341f11658d for instance with vm_state active and task_state reboot_started.
Aug 15 01:02:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:22 user nova-compute[73010]: DEBUG nova.compute.manager [req-f5813574-6739-44d6-ace5-2e516630399c req-8fa08232-1bf3-4e7c-9c7c-08be8572b72d service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Received event network-vif-plugged-c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:02:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f5813574-6739-44d6-ace5-2e516630399c req-8fa08232-1bf3-4e7c-9c7c-08be8572b72d service nova] Acquiring lock "6b931225-177c-4b6c-9989-8e036ad58987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f5813574-6739-44d6-ace5-2e516630399c req-8fa08232-1bf3-4e7c-9c7c-08be8572b72d service nova] Lock "6b931225-177c-4b6c-9989-8e036ad58987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f5813574-6739-44d6-ace5-2e516630399c req-8fa08232-1bf3-4e7c-9c7c-08be8572b72d service nova] Lock "6b931225-177c-4b6c-9989-8e036ad58987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:22 user nova-compute[73010]: DEBUG nova.compute.manager [req-f5813574-6739-44d6-ace5-2e516630399c req-8fa08232-1bf3-4e7c-9c7c-08be8572b72d service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] No waiting events found dispatching network-vif-plugged-c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:02:22 user nova-compute[73010]: WARNING nova.compute.manager [req-f5813574-6739-44d6-ace5-2e516630399c req-8fa08232-1bf3-4e7c-9c7c-08be8572b72d service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Received unexpected event network-vif-plugged-c94c8a3a-6c88-482c-8c90-86341f11658d for instance with vm_state active and task_state reboot_started.
Aug 15 01:02:22 user nova-compute[73010]: DEBUG nova.compute.manager [req-f5813574-6739-44d6-ace5-2e516630399c req-8fa08232-1bf3-4e7c-9c7c-08be8572b72d service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Received event network-vif-plugged-c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:02:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f5813574-6739-44d6-ace5-2e516630399c req-8fa08232-1bf3-4e7c-9c7c-08be8572b72d service nova] Acquiring lock "6b931225-177c-4b6c-9989-8e036ad58987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f5813574-6739-44d6-ace5-2e516630399c req-8fa08232-1bf3-4e7c-9c7c-08be8572b72d service nova] Lock "6b931225-177c-4b6c-9989-8e036ad58987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f5813574-6739-44d6-ace5-2e516630399c req-8fa08232-1bf3-4e7c-9c7c-08be8572b72d service nova] Lock "6b931225-177c-4b6c-9989-8e036ad58987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:22 user nova-compute[73010]: DEBUG nova.compute.manager [req-f5813574-6739-44d6-ace5-2e516630399c req-8fa08232-1bf3-4e7c-9c7c-08be8572b72d service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] No waiting events found dispatching network-vif-plugged-c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:02:22 user nova-compute[73010]: WARNING nova.compute.manager [req-f5813574-6739-44d6-ace5-2e516630399c req-8fa08232-1bf3-4e7c-9c7c-08be8572b72d service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Received unexpected event network-vif-plugged-c94c8a3a-6c88-482c-8c90-86341f11658d for instance with vm_state active and task_state reboot_started.
Aug 15 01:02:22 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Removed pending event for 6b931225-177c-4b6c-9989-8e036ad58987 due to event {{(pid=73010) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 01:02:22 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061342.8327258, 6b931225-177c-4b6c-9989-8e036ad58987 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:02:22 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] VM Resumed (Lifecycle Event)
Aug 15 01:02:22 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Instance running successfully.
Aug 15 01:02:22 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-a787714e-7ff6-4d91-87f0-3a8c3b0fad0f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Instance soft rebooted successfully.
Aug 15 01:02:22 user nova-compute[73010]: DEBUG nova.compute.manager [None req-a787714e-7ff6-4d91-87f0-3a8c3b0fad0f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:02:22 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:02:22 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:02:22 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 15 01:02:22 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061342.8347304, 6b931225-177c-4b6c-9989-8e036ad58987 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:02:22 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] VM Started (Lifecycle Event)
Aug 15 01:02:22 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:02:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-a787714e-7ff6-4d91-87f0-3a8c3b0fad0f tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "6b931225-177c-4b6c-9989-8e036ad58987" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.593s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:22 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:02:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:29 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:02:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:33 user nova-compute[73010]: DEBUG nova.objects.instance [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lazy-loading 'pci_requests' on Instance uuid 20d92360-d4f7-4f17-8a32-fb901dd8feb8 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:02:34 user nova-compute[73010]: DEBUG nova.objects.instance [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lazy-loading 'numa_topology' on Instance uuid 20d92360-d4f7-4f17-8a32-fb901dd8feb8 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:02:34 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 01:02:34 user nova-compute[73010]: INFO nova.compute.claims [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Claim successful on node user
Aug 15 01:02:34 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:02:34 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:02:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:34 user nova-compute[73010]: INFO nova.network.neutron [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Updating port bb08a1cd-7152-4c81-b416-ac00f5bb59be with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 01:02:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "refresh_cache-20d92360-d4f7-4f17-8a32-fb901dd8feb8" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:02:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquired lock "refresh_cache-20d92360-d4f7-4f17-8a32-fb901dd8feb8" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:02:35 user nova-compute[73010]: DEBUG nova.network.neutron [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 01:02:35 user nova-compute[73010]: DEBUG nova.compute.manager [req-967d8e0e-93ff-4353-9311-33c8e77d72f7 req-c3de8116-2b57-49e9-b2c2-9d1a74f3ec43 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Received event network-changed-bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:02:35 user nova-compute[73010]: DEBUG nova.compute.manager [req-967d8e0e-93ff-4353-9311-33c8e77d72f7 req-c3de8116-2b57-49e9-b2c2-9d1a74f3ec43 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Refreshing instance network info cache due to event network-changed-bb08a1cd-7152-4c81-b416-ac00f5bb59be. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 01:02:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-967d8e0e-93ff-4353-9311-33c8e77d72f7 req-c3de8116-2b57-49e9-b2c2-9d1a74f3ec43 service nova] Acquiring lock "refresh_cache-20d92360-d4f7-4f17-8a32-fb901dd8feb8" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:02:35 user nova-compute[73010]: DEBUG nova.network.neutron [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Updating instance_info_cache with network_info: [{"id": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "address": "fa:16:3e:d7:26:86", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb08a1cd-71", "ovs_interfaceid": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:02:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Releasing lock "refresh_cache-20d92360-d4f7-4f17-8a32-fb901dd8feb8" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:02:35 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 01:02:35 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Creating image(s)
Aug 15 01:02:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "/opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "/opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "/opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:35 user nova-compute[73010]: DEBUG nova.objects.instance [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lazy-loading 'trusted_certs' on Instance uuid 20d92360-d4f7-4f17-8a32-fb901dd8feb8 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:02:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-967d8e0e-93ff-4353-9311-33c8e77d72f7 req-c3de8116-2b57-49e9-b2c2-9d1a74f3ec43 service nova] Acquired lock "refresh_cache-20d92360-d4f7-4f17-8a32-fb901dd8feb8" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:02:35 user nova-compute[73010]: DEBUG nova.network.neutron [req-967d8e0e-93ff-4353-9311-33c8e77d72f7 req-c3de8116-2b57-49e9-b2c2-9d1a74f3ec43 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Refreshing network info cache for port bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 01:02:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "dd7217b480916a9ebbf9dc8130135994e4918e2e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:35 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "dd7217b480916a9ebbf9dc8130135994e4918e2e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd7217b480916a9ebbf9dc8130135994e4918e2e.part --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd7217b480916a9ebbf9dc8130135994e4918e2e.part --force-share --output=json" returned: 0 in 0.191s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:36 user nova-compute[73010]: DEBUG nova.virt.images [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] 35cb6b0d-880c-4a9c-bb70-27b456e5a316 was qcow2, converting to raw {{(pid=73010) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 01:02:36 user nova-compute[73010]: DEBUG nova.privsep.utils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73010) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 01:02:36 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dd7217b480916a9ebbf9dc8130135994e4918e2e.part /opt/stack/data/nova/instances/_base/dd7217b480916a9ebbf9dc8130135994e4918e2e.converted {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:36 user nova-compute[73010]: DEBUG nova.network.neutron [req-967d8e0e-93ff-4353-9311-33c8e77d72f7 req-c3de8116-2b57-49e9-b2c2-9d1a74f3ec43 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Updated VIF entry in instance network info cache for port bb08a1cd-7152-4c81-b416-ac00f5bb59be. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 01:02:36 user nova-compute[73010]: DEBUG nova.network.neutron [req-967d8e0e-93ff-4353-9311-33c8e77d72f7 req-c3de8116-2b57-49e9-b2c2-9d1a74f3ec43 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Updating instance_info_cache with network_info: [{"id": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "address": "fa:16:3e:d7:26:86", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb08a1cd-71", "ovs_interfaceid": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:02:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-967d8e0e-93ff-4353-9311-33c8e77d72f7 req-c3de8116-2b57-49e9-b2c2-9d1a74f3ec43 service nova] Releasing lock "refresh_cache-20d92360-d4f7-4f17-8a32-fb901dd8feb8" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:02:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dd7217b480916a9ebbf9dc8130135994e4918e2e.part /opt/stack/data/nova/instances/_base/dd7217b480916a9ebbf9dc8130135994e4918e2e.converted" returned: 0 in 0.396s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd7217b480916a9ebbf9dc8130135994e4918e2e.converted --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd7217b480916a9ebbf9dc8130135994e4918e2e.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "dd7217b480916a9ebbf9dc8130135994e4918e2e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.762s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd7217b480916a9ebbf9dc8130135994e4918e2e --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd7217b480916a9ebbf9dc8130135994e4918e2e --force-share --output=json" returned: 0 in 0.177s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "dd7217b480916a9ebbf9dc8130135994e4918e2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "dd7217b480916a9ebbf9dc8130135994e4918e2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd7217b480916a9ebbf9dc8130135994e4918e2e --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd7217b480916a9ebbf9dc8130135994e4918e2e --force-share --output=json" returned: 0 in 0.177s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd7217b480916a9ebbf9dc8130135994e4918e2e,backing_fmt=raw /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd7217b480916a9ebbf9dc8130135994e4918e2e,backing_fmt=raw /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk 1073741824" returned: 0 in 0.086s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "dd7217b480916a9ebbf9dc8130135994e4918e2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:37 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd7217b480916a9ebbf9dc8130135994e4918e2e --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd7217b480916a9ebbf9dc8130135994e4918e2e --force-share --output=json" returned: 0 in 0.174s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:38 user nova-compute[73010]: DEBUG nova.objects.instance [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lazy-loading 'migration_context' on Instance uuid 20d92360-d4f7-4f17-8a32-fb901dd8feb8 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:02:38 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Rebasing disk image.
Aug 15 01:02:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.180s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 -F raw /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 -F raw /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk" returned: 0 in 1.868s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Ensure instance console log exists: /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Start _get_guest_xml network_info=[{"id": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "address": "fa:16:3e:d7:26:86", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb08a1cd-71", "ovs_interfaceid": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='6d2d3a70477a2e7e10bf36d452f06b13',container_format='bare',created_at=2023-08-15T01:00:25Z,direct_url=<?>,disk_format='qcow2',id=35cb6b0d-880c-4a9c-bb70-27b456e5a316,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-250049231-shelved',owner='586bed330893488081bb21738b1a6ec4',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-15T01:00:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grpBHhxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '20d92360-d4f7-4f17-8a32-fb901dd8feb8', 'attached_at': '', 'detached_at': '', 'volume_id': 'f1be21ab-24ec-4988-bc02-dc2c82f3fd0b', 'serial': 'f1be21ab-24ec-4988-bc02-dc2c82f3fd0b'}, 'disk_bus': 'virtio', 'attachment_id': '16fb9e10-c508-4d78-bfaa-2141aa1ff151', 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdc', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 01:02:40 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:02:40 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:02:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6d2d3a70477a2e7e10bf36d452f06b13',container_format='bare',created_at=2023-08-15T01:00:25Z,direct_url=<?>,disk_format='qcow2',id=35cb6b0d-880c-4a9c-bb70-27b456e5a316,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-250049231-shelved',owner='586bed330893488081bb21738b1a6ec4',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-15T01:00:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG nova.objects.instance [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lazy-loading 'vcpu_model' on Instance uuid 20d92360-d4f7-4f17-8a32-fb901dd8feb8 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grpBHhxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:02:40 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:02:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:02:40 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:02:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:02:40 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2bbf68-8b85-4685-a414-20c5e0a13d39]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 01:02:40 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95c5b34-7d55-419c-84da-87327bb38830]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b] added
Aug 15 01:02:40 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a811f5-d747-4b15-83b5-09b54d6ea2c8]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a4be2b-02aa-492d-9e8b-6f017508ecca]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v grpBHhxz {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v grpBHhxz" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b16121-8372-434f-8b45-3e35177a9cc7]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'grpBHhxz'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3a8526-fb87-4f8a-ab44-ff935b411e4d]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bc9d87-07b3-4650-9eb9-7a0c0519b545]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:02:40 user nova-compute[73010]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:02:40 user nova-compute[73010]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)
Aug 15 01:02:40 user nova-compute[73010]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 (non-flash)
Aug 15 01:02:40 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:02:40 user nova-compute[73010]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:02:40 user nova-compute[73010]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)
Aug 15 01:02:40 user nova-compute[73010]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 (non-flash)
Aug 15 01:02:40 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8af7c4-4ab9-452d-818b-8a49cc7fe25e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b, portal: 172.16.0.220,3260]
Aug 15 01:02:40 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b, portal: 172.16.0.220,3260] successful.
Aug 15 01:02:40 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[377539c2-f26a-48d9-a322-b09502aacead]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fee101e-bc9f-4228-a7a3-e1d89cd4ec1b]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:02:40 user nova-compute[73010]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:02:40 user nova-compute[73010]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)
Aug 15 01:02:40 user nova-compute[73010]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 (non-flash)
Aug 15 01:02:40 user nova-compute[73010]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b (non-flash)
Aug 15 01:02:40 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:02:40 user nova-compute[73010]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:02:40 user nova-compute[73010]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)
Aug 15 01:02:40 user nova-compute[73010]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 (non-flash)
Aug 15 01:02:40 user nova-compute[73010]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b (non-flash)
Aug 15 01:02:40 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] HCTL ('37', '-', '-', 0) found on session 60 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1051fd87-cd0b-4321-8f9b-884408d02e68]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Searching for a device in session 60 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 01:02:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grpBHhxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 01:02:41 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:02:41 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23661363136396339', 'path': '/dev/sdf'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:02:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661363136396339', 'path': '/dev/sdf'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 01:02:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T00:58:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-250049231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-250049231',id=44,image_ref='35cb6b0d-880c-4a9c-bb70-27b456e5a316',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-449371876',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:58:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='586bed330893488081bb21738b1a6ec4',ramdisk_id='',reservation_id='r-ckgkv059',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-563974852',owner_user_name='tempest-AttachVolumeShelveTestJSON-563974852-project-member',shelved_at='2023-08-15T01:00:28.698063',shelved_host='user',shelved_image_id='35cb6b0d-880c-4a9c-bb70-27b456e5a316'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T01:02:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c5655da76eb4671b4db00e086232f05',uuid=20d92360-d4f7-4f17-8a32-fb901dd8feb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "address": "fa:16:3e:d7:26:86", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb08a1cd-71", "ovs_interfaceid": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 01:02:41 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Converting VIF {"id": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "address": "fa:16:3e:d7:26:86", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb08a1cd-71", "ovs_interfaceid": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:02:41 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:26:86,bridge_name='br-int',has_traffic_filtering=True,id=bb08a1cd-7152-4c81-b416-ac00f5bb59be,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb08a1cd-71') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:02:41 user nova-compute[73010]: DEBUG nova.objects.instance [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lazy-loading 'pci_devices' on Instance uuid 20d92360-d4f7-4f17-8a32-fb901dd8feb8 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:02:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] End _get_guest_xml xml=<domain type="kvm">
Aug 15 01:02:41 user nova-compute[73010]:   <uuid>20d92360-d4f7-4f17-8a32-fb901dd8feb8</uuid>
Aug 15 01:02:41 user nova-compute[73010]:   <name>instance-0000002c</name>
Aug 15 01:02:41 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 01:02:41 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 01:02:41 user nova-compute[73010]:   <metadata>
Aug 15 01:02:41 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 01:02:41 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 01:02:41 user nova-compute[73010]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-250049231</nova:name>
Aug 15 01:02:41 user nova-compute[73010]:       <nova:creationTime>2023-08-15 01:02:40</nova:creationTime>
Aug 15 01:02:41 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 01:02:41 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 01:02:41 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 01:02:41 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 01:02:41 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 01:02:41 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 01:02:41 user nova-compute[73010]:       </nova:flavor>
Aug 15 01:02:41 user nova-compute[73010]:       <nova:owner>
Aug 15 01:02:41 user nova-compute[73010]:         <nova:user uuid="0c5655da76eb4671b4db00e086232f05">tempest-AttachVolumeShelveTestJSON-563974852-project-member</nova:user>
Aug 15 01:02:41 user nova-compute[73010]:         <nova:project uuid="586bed330893488081bb21738b1a6ec4">tempest-AttachVolumeShelveTestJSON-563974852</nova:project>
Aug 15 01:02:41 user nova-compute[73010]:       </nova:owner>
Aug 15 01:02:41 user nova-compute[73010]:       <nova:root type="image" uuid="35cb6b0d-880c-4a9c-bb70-27b456e5a316"/>
Aug 15 01:02:41 user nova-compute[73010]:       <nova:ports>
Aug 15 01:02:41 user nova-compute[73010]:         <nova:port uuid="bb08a1cd-7152-4c81-b416-ac00f5bb59be">
Aug 15 01:02:41 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 01:02:41 user nova-compute[73010]:         </nova:port>
Aug 15 01:02:41 user nova-compute[73010]:       </nova:ports>
Aug 15 01:02:41 user nova-compute[73010]:     </nova:instance>
Aug 15 01:02:41 user nova-compute[73010]:   </metadata>
Aug 15 01:02:41 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 01:02:41 user nova-compute[73010]:     <system>
Aug 15 01:02:41 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 01:02:41 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 01:02:41 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 01:02:41 user nova-compute[73010]:       <entry name="serial">20d92360-d4f7-4f17-8a32-fb901dd8feb8</entry>
Aug 15 01:02:41 user nova-compute[73010]:       <entry name="uuid">20d92360-d4f7-4f17-8a32-fb901dd8feb8</entry>
Aug 15 01:02:41 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 01:02:41 user nova-compute[73010]:     </system>
Aug 15 01:02:41 user nova-compute[73010]:   </sysinfo>
Aug 15 01:02:41 user nova-compute[73010]:   <os>
Aug 15 01:02:41 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 01:02:41 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 01:02:41 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 01:02:41 user nova-compute[73010]:   </os>
Aug 15 01:02:41 user nova-compute[73010]:   <features>
Aug 15 01:02:41 user nova-compute[73010]:     <acpi/>
Aug 15 01:02:41 user nova-compute[73010]:     <apic/>
Aug 15 01:02:41 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 01:02:41 user nova-compute[73010]:   </features>
Aug 15 01:02:41 user nova-compute[73010]:   <clock offset="utc">
Aug 15 01:02:41 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 01:02:41 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 01:02:41 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 01:02:41 user nova-compute[73010]:   </clock>
Aug 15 01:02:41 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 01:02:41 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 01:02:41 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 01:02:41 user nova-compute[73010]:   </cpu>
Aug 15 01:02:41 user nova-compute[73010]:   <devices>
Aug 15 01:02:41 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 01:02:41 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 01:02:41 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk"/>
Aug 15 01:02:41 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 01:02:41 user nova-compute[73010]:     </disk>
Aug 15 01:02:41 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 01:02:41 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:02:41 user nova-compute[73010]:       <source dev="/dev/sdf"/>
Aug 15 01:02:41 user nova-compute[73010]:       <target dev="vdc" bus="virtio"/>
Aug 15 01:02:41 user nova-compute[73010]:       <serial>f1be21ab-24ec-4988-bc02-dc2c82f3fd0b</serial>
Aug 15 01:02:41 user nova-compute[73010]:     </disk>
Aug 15 01:02:41 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 01:02:41 user nova-compute[73010]:       <mac address="fa:16:3e:d7:26:86"/>
Aug 15 01:02:41 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:02:41 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 01:02:41 user nova-compute[73010]:       <target dev="tapbb08a1cd-71"/>
Aug 15 01:02:41 user nova-compute[73010]:     </interface>
Aug 15 01:02:41 user nova-compute[73010]:     <serial type="pty">
Aug 15 01:02:41 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/console.log" append="off"/>
Aug 15 01:02:41 user nova-compute[73010]:     </serial>
Aug 15 01:02:41 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 01:02:41 user nova-compute[73010]:     <video>
Aug 15 01:02:41 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:02:41 user nova-compute[73010]:     </video>
Aug 15 01:02:41 user nova-compute[73010]:     <rng model="virtio">
Aug 15 01:02:41 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 01:02:41 user nova-compute[73010]:     </rng>
Aug 15 01:02:41 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 01:02:41 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 01:02:41 user nova-compute[73010]:       <stats period="10"/>
Aug 15 01:02:41 user nova-compute[73010]:     </memballoon>
Aug 15 01:02:41 user nova-compute[73010]:   </devices>
Aug 15 01:02:41 user nova-compute[73010]: </domain>
Aug 15 01:02:41 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 01:02:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T00:58:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-250049231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-250049231',id=44,image_ref='35cb6b0d-880c-4a9c-bb70-27b456e5a316',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-449371876',keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:58:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='586bed330893488081bb21738b1a6ec4',ramdisk_id='',reservation_id='r-ckgkv059',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-563974852',owner_user_name='tempest-AttachVolumeShelveTestJSON-563974852-project-member',shelved_at='2023-08-15T01:00:28.698063',shelved_host='user',shelved_image_id='35cb6b0d-880c-4a9c-bb70-27b456e5a316'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T01:02:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c5655da76eb4671b4db00e086232f05',uuid=20d92360-d4f7-4f17-8a32-fb901dd8feb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "address": "fa:16:3e:d7:26:86", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb08a1cd-71", "ovs_interfaceid": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 01:02:41 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Converting VIF {"id": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "address": "fa:16:3e:d7:26:86", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb08a1cd-71", "ovs_interfaceid": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:02:41 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:26:86,bridge_name='br-int',has_traffic_filtering=True,id=bb08a1cd-7152-4c81-b416-ac00f5bb59be,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb08a1cd-71') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:02:41 user nova-compute[73010]: DEBUG os_vif [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:26:86,bridge_name='br-int',has_traffic_filtering=True,id=bb08a1cd-7152-4c81-b416-ac00f5bb59be,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb08a1cd-71') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 01:02:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:02:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 01:02:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb08a1cd-71, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:02:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb08a1cd-71, col_values=(('external_ids', {'iface-id': 'bb08a1cd-7152-4c81-b416-ac00f5bb59be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:26:86', 'vm-uuid': '20d92360-d4f7-4f17-8a32-fb901dd8feb8'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:02:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:02:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:41 user nova-compute[73010]: INFO os_vif [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:26:86,bridge_name='br-int',has_traffic_filtering=True,id=bb08a1cd-7152-4c81-b416-ac00f5bb59be,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb08a1cd-71')
Aug 15 01:02:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:02:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:02:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] No VIF found with MAC fa:16:3e:d7:26:86, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 01:02:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:43 user nova-compute[73010]: DEBUG nova.compute.manager [req-055691ec-4e52-4d1a-ba25-b9fb5d9f5f72 req-4463dbea-1642-4bf3-8451-0ffe3704d56d service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Received event network-vif-plugged-bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:02:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-055691ec-4e52-4d1a-ba25-b9fb5d9f5f72 req-4463dbea-1642-4bf3-8451-0ffe3704d56d service nova] Acquiring lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-055691ec-4e52-4d1a-ba25-b9fb5d9f5f72 req-4463dbea-1642-4bf3-8451-0ffe3704d56d service nova] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-055691ec-4e52-4d1a-ba25-b9fb5d9f5f72 req-4463dbea-1642-4bf3-8451-0ffe3704d56d service nova] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:43 user nova-compute[73010]: DEBUG nova.compute.manager [req-055691ec-4e52-4d1a-ba25-b9fb5d9f5f72 req-4463dbea-1642-4bf3-8451-0ffe3704d56d service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] No waiting events found dispatching network-vif-plugged-bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:02:43 user nova-compute[73010]: WARNING nova.compute.manager [req-055691ec-4e52-4d1a-ba25-b9fb5d9f5f72 req-4463dbea-1642-4bf3-8451-0ffe3704d56d service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Received unexpected event network-vif-plugged-bb08a1cd-7152-4c81-b416-ac00f5bb59be for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 01:02:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:45 user nova-compute[73010]: DEBUG nova.compute.manager [req-3c65305c-e302-4d0c-b2e2-970504a43d94 req-d2281768-c05e-4f98-ab6a-9878f86750e4 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Received event network-vif-plugged-bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:02:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3c65305c-e302-4d0c-b2e2-970504a43d94 req-d2281768-c05e-4f98-ab6a-9878f86750e4 service nova] Acquiring lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:02:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3c65305c-e302-4d0c-b2e2-970504a43d94 req-d2281768-c05e-4f98-ab6a-9878f86750e4 service nova] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:02:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3c65305c-e302-4d0c-b2e2-970504a43d94 req-d2281768-c05e-4f98-ab6a-9878f86750e4 service nova] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:45 user nova-compute[73010]: DEBUG nova.compute.manager [req-3c65305c-e302-4d0c-b2e2-970504a43d94 req-d2281768-c05e-4f98-ab6a-9878f86750e4 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] No waiting events found dispatching network-vif-plugged-bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:02:45 user nova-compute[73010]: WARNING nova.compute.manager [req-3c65305c-e302-4d0c-b2e2-970504a43d94 req-d2281768-c05e-4f98-ab6a-9878f86750e4 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Received unexpected event network-vif-plugged-bb08a1cd-7152-4c81-b416-ac00f5bb59be for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 01:02:45 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061365.3123379, 20d92360-d4f7-4f17-8a32-fb901dd8feb8 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:02:45 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] VM Resumed (Lifecycle Event)
Aug 15 01:02:45 user nova-compute[73010]: DEBUG nova.compute.manager [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 01:02:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 01:02:45 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Instance spawned successfully.
Aug 15 01:02:45 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:02:45 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:02:45 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 01:02:45 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061365.314392, 20d92360-d4f7-4f17-8a32-fb901dd8feb8 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:02:45 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] VM Started (Lifecycle Event)
Aug 15 01:02:45 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:02:45 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:02:45 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 01:02:45 user nova-compute[73010]: DEBUG nova.compute.manager [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:02:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-cbee01f0-5340-41dd-8bd1-bfc3e6cc63c3 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 28.179s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:02:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:02:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:03:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:05 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:03:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:03:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:03:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:03:05 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:03:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:03:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:03:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:03:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:03:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:03:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:03:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a36324-d323-4169-abaa-09028eeb5598/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:03:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a36324-d323-4169-abaa-09028eeb5598/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:03:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a36324-d323-4169-abaa-09028eeb5598/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:03:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a36324-d323-4169-abaa-09028eeb5598/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:03:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:03:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:03:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:03:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:03:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:03:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:03:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:03:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.382s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:03:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:03:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:03:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:03:08 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:03:08 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:03:08 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8019MB free_disk=25.295795440673828GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:03:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:03:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:03:08 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance d79e3854-769c-430a-b980-3a551c7ee34d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:03:08 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 634979eb-b706-4bdd-bb72-c2d163d3f8c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:03:08 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6b931225-177c-4b6c-9989-8e036ad58987 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:03:08 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 39a36324-d323-4169-abaa-09028eeb5598 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:03:08 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 1a664ead-4fec-454d-bca2-023afecb409a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:03:08 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 20d92360-d4f7-4f17-8a32-fb901dd8feb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:03:08 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:03:08 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:03:08 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:03:08 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:03:08 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:03:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.371s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:03:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:15 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:03:15 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:03:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:18 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:03:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:03:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 01:03:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-d79e3854-769c-430a-b980-3a551c7ee34d" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:03:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-d79e3854-769c-430a-b980-3a551c7ee34d" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:03:18 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 01:03:18 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lazy-loading 'info_cache' on Instance uuid d79e3854-769c-430a-b980-3a551c7ee34d {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:03:19 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Updating instance_info_cache with network_info: [{"id": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "address": "fa:16:3e:07:08:aa", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1f2867-31", "ovs_interfaceid": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:03:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-d79e3854-769c-430a-b980-3a551c7ee34d" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:03:19 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 01:03:19 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:03:19 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:03:19 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:03:19 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:03:20 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:03:21 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:03:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:03:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:03:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:03:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:03:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:03:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:03:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:03:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:03:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:28 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:03:28 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Cleaning up deleted instances {{(pid=73010) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 01:03:28 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] There are 0 instances to clean {{(pid=73010) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 01:03:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:03:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:03:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:03:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:03:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:03:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:03:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:03:37 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:03:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73010) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 01:03:40 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:03:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:03:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:03:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:03:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:03:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:03:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:03:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:03:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:03:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:03:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:03:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:03:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:51 user nova-compute[73010]: DEBUG nova.compute.manager [req-651b4f4c-4634-44b7-8028-2e7eaff7420f req-8e9ffb05-0941-40b1-b95f-9a03c491aff6 service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Received event network-changed-bca0154b-0273-4c6d-a4a3-52f45ed0b79f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:03:51 user nova-compute[73010]: DEBUG nova.compute.manager [req-651b4f4c-4634-44b7-8028-2e7eaff7420f req-8e9ffb05-0941-40b1-b95f-9a03c491aff6 service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Refreshing instance network info cache due to event network-changed-bca0154b-0273-4c6d-a4a3-52f45ed0b79f. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 01:03:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-651b4f4c-4634-44b7-8028-2e7eaff7420f req-8e9ffb05-0941-40b1-b95f-9a03c491aff6 service nova] Acquiring lock "refresh_cache-1a664ead-4fec-454d-bca2-023afecb409a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:03:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-651b4f4c-4634-44b7-8028-2e7eaff7420f req-8e9ffb05-0941-40b1-b95f-9a03c491aff6 service nova] Acquired lock "refresh_cache-1a664ead-4fec-454d-bca2-023afecb409a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:03:51 user nova-compute[73010]: DEBUG nova.network.neutron [req-651b4f4c-4634-44b7-8028-2e7eaff7420f req-8e9ffb05-0941-40b1-b95f-9a03c491aff6 service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Refreshing network info cache for port bca0154b-0273-4c6d-a4a3-52f45ed0b79f {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 01:03:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:51 user nova-compute[73010]: DEBUG nova.network.neutron [req-651b4f4c-4634-44b7-8028-2e7eaff7420f req-8e9ffb05-0941-40b1-b95f-9a03c491aff6 service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Updated VIF entry in instance network info cache for port bca0154b-0273-4c6d-a4a3-52f45ed0b79f. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 01:03:51 user nova-compute[73010]: DEBUG nova.network.neutron [req-651b4f4c-4634-44b7-8028-2e7eaff7420f req-8e9ffb05-0941-40b1-b95f-9a03c491aff6 service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Updating instance_info_cache with network_info: [{"id": "bca0154b-0273-4c6d-a4a3-52f45ed0b79f", "address": "fa:16:3e:92:fb:07", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca0154b-02", "ovs_interfaceid": "bca0154b-0273-4c6d-a4a3-52f45ed0b79f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:03:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-651b4f4c-4634-44b7-8028-2e7eaff7420f req-8e9ffb05-0941-40b1-b95f-9a03c491aff6 service nova] Releasing lock "refresh_cache-1a664ead-4fec-454d-bca2-023afecb409a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:03:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "1a664ead-4fec-454d-bca2-023afecb409a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:03:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "1a664ead-4fec-454d-bca2-023afecb409a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:03:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "1a664ead-4fec-454d-bca2-023afecb409a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:03:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "1a664ead-4fec-454d-bca2-023afecb409a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:03:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "1a664ead-4fec-454d-bca2-023afecb409a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:03:52 user nova-compute[73010]: INFO nova.compute.manager [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Terminating instance
Aug 15 01:03:52 user nova-compute[73010]: DEBUG nova.compute.manager [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 01:03:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:52 user nova-compute[73010]: DEBUG nova.compute.manager [req-20ec32af-49c8-4a47-92ea-a82fc1e28c48 req-76e64942-8eff-410d-b251-c7267967df79 service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Received event network-vif-unplugged-bca0154b-0273-4c6d-a4a3-52f45ed0b79f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:03:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-20ec32af-49c8-4a47-92ea-a82fc1e28c48 req-76e64942-8eff-410d-b251-c7267967df79 service nova] Acquiring lock "1a664ead-4fec-454d-bca2-023afecb409a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:03:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-20ec32af-49c8-4a47-92ea-a82fc1e28c48 req-76e64942-8eff-410d-b251-c7267967df79 service nova] Lock "1a664ead-4fec-454d-bca2-023afecb409a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:03:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-20ec32af-49c8-4a47-92ea-a82fc1e28c48 req-76e64942-8eff-410d-b251-c7267967df79 service nova] Lock "1a664ead-4fec-454d-bca2-023afecb409a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:03:52 user nova-compute[73010]: DEBUG nova.compute.manager [req-20ec32af-49c8-4a47-92ea-a82fc1e28c48 req-76e64942-8eff-410d-b251-c7267967df79 service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] No waiting events found dispatching network-vif-unplugged-bca0154b-0273-4c6d-a4a3-52f45ed0b79f {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:03:52 user nova-compute[73010]: DEBUG nova.compute.manager [req-20ec32af-49c8-4a47-92ea-a82fc1e28c48 req-76e64942-8eff-410d-b251-c7267967df79 service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Received event network-vif-unplugged-bca0154b-0273-4c6d-a4a3-52f45ed0b79f for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 01:03:53 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Instance destroyed successfully.
Aug 15 01:03:53 user nova-compute[73010]: DEBUG nova.objects.instance [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lazy-loading 'resources' on Instance uuid 1a664ead-4fec-454d-bca2-023afecb409a {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:01:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1187119549',display_name='tempest-TestVolumeBootPattern-server-1187119549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1187119549',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1zaN+b+VydDVLamZvE8X1Kd/Q5Q2Sojr9sHX021PLtuvBNvO93jAR1znkRwvthrtxRfhwBKAX8n8oRWo/mH1ipr8A9qzs9a0e/tyPo6tpDcd6aKpdp/ZnfjKtEL/p1Mg==',key_name='tempest-TestVolumeBootPattern-1981746338',keypairs=<?>,launch_index=0,launched_at=2023-08-15T01:02:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f67d1031d3cb4c8fb66342a7888ca1c4',ramdisk_id='',reservation_id='r-zqtpw94w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1953358779',owner_user_name='tempest-TestVolumeBootPattern-1953358779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T01:02:15Z,user_data=None,user_id='daa4eb788f724a6fbf908b029315a02b',uuid=1a664ead-4fec-454d-bca2-023afecb409a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bca0154b-0273-4c6d-a4a3-52f45ed0b79f", "address": "fa:16:3e:92:fb:07", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca0154b-02", "ovs_interfaceid": "bca0154b-0273-4c6d-a4a3-52f45ed0b79f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converting VIF {"id": "bca0154b-0273-4c6d-a4a3-52f45ed0b79f", "address": "fa:16:3e:92:fb:07", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca0154b-02", "ovs_interfaceid": "bca0154b-0273-4c6d-a4a3-52f45ed0b79f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:fb:07,bridge_name='br-int',has_traffic_filtering=True,id=bca0154b-0273-4c6d-a4a3-52f45ed0b79f,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca0154b-02') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG os_vif [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:fb:07,bridge_name='br-int',has_traffic_filtering=True,id=bca0154b-0273-4c6d-a4a3-52f45ed0b79f,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca0154b-02') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbca0154b-02, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:03:53 user nova-compute[73010]: INFO os_vif [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:fb:07,bridge_name='br-int',has_traffic_filtering=True,id=bca0154b-0273-4c6d-a4a3-52f45ed0b79f,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca0154b-02')
Aug 15 01:03:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yTSiVFsd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:03:53 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:03:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG nova.compute.manager [req-d9ff2543-00a2-4605-8a0e-0642f2a63739 req-ac96b95a-47f1-445f-9f06-819f6fcbcfed service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Received event network-changed-bca0154b-0273-4c6d-a4a3-52f45ed0b79f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG nova.compute.manager [req-d9ff2543-00a2-4605-8a0e-0642f2a63739 req-ac96b95a-47f1-445f-9f06-819f6fcbcfed service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Refreshing instance network info cache due to event network-changed-bca0154b-0273-4c6d-a4a3-52f45ed0b79f. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d9ff2543-00a2-4605-8a0e-0642f2a63739 req-ac96b95a-47f1-445f-9f06-819f6fcbcfed service nova] Acquiring lock "refresh_cache-1a664ead-4fec-454d-bca2-023afecb409a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d9ff2543-00a2-4605-8a0e-0642f2a63739 req-ac96b95a-47f1-445f-9f06-819f6fcbcfed service nova] Acquired lock "refresh_cache-1a664ead-4fec-454d-bca2-023afecb409a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG nova.network.neutron [req-d9ff2543-00a2-4605-8a0e-0642f2a63739 req-ac96b95a-47f1-445f-9f06-819f6fcbcfed service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Refreshing network info cache for port bca0154b-0273-4c6d-a4a3-52f45ed0b79f {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a4705f-fdde-48aa-8833-5a70870358a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[268d77db-1617-4308-ab0b-d466fd323ad5]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:03:53 user nova-compute[73010]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:03:53 user nova-compute[73010]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)
Aug 15 01:03:53 user nova-compute[73010]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 (non-flash)
Aug 15 01:03:53 user nova-compute[73010]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b (non-flash)
Aug 15 01:03:53 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:03:53 user nova-compute[73010]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:03:53 user nova-compute[73010]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)
Aug 15 01:03:53 user nova-compute[73010]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 (non-flash)
Aug 15 01:03:53 user nova-compute[73010]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b (non-flash)
Aug 15 01:03:53 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec3042d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2'): ({'sde'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Removing single pathed devices sde {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b270213-83b5-416e-8ea0-02b1aa7d75b0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a3ef89-79a3-4592-b2c6-b5295b08d92f]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Flushing IO for device /dev/sde {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[86530bee-9e88-458b-950b-2e5af1ed9b03]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[053f8567-e56a-442e-afc5-717e15c2670f]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] SCSI volumes sde have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23464343133346162', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_28b47b38', '/dev/disk/by-id/scsi-1SCST_BIO28b47b38-4d4134ab020c6bad') {{(pid=84080) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a002b5-e223-4d20-b83e-538c27868a81]: (4, None) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9744e7da-3ba9-47a6-9858-fe2bd043a2e2]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbf7b64-4ad1-41a4-9e38-91ee2d984116]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2, portal: 172.16.0.220,3260]
Aug 15 01:03:53 user nova-compute[73010]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2, portal: 172.16.0.220,3260] successful.
Aug 15 01:03:53 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a4cec08-99b4-4055-b567-7906c7650ad2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b86ba7-e31f-44ae-8b7d-3be4ed69f0c3]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] <== disconnect_volume: return (316ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 01:03:53 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Deleting instance files /opt/stack/data/nova/instances/1a664ead-4fec-454d-bca2-023afecb409a_del
Aug 15 01:03:53 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Deletion of /opt/stack/data/nova/instances/1a664ead-4fec-454d-bca2-023afecb409a_del complete
Aug 15 01:03:53 user nova-compute[73010]: INFO nova.compute.manager [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG nova.network.neutron [req-d9ff2543-00a2-4605-8a0e-0642f2a63739 req-ac96b95a-47f1-445f-9f06-819f6fcbcfed service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Updated VIF entry in instance network info cache for port bca0154b-0273-4c6d-a4a3-52f45ed0b79f. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG nova.network.neutron [req-d9ff2543-00a2-4605-8a0e-0642f2a63739 req-ac96b95a-47f1-445f-9f06-819f6fcbcfed service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Updating instance_info_cache with network_info: [{"id": "bca0154b-0273-4c6d-a4a3-52f45ed0b79f", "address": "fa:16:3e:92:fb:07", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca0154b-02", "ovs_interfaceid": "bca0154b-0273-4c6d-a4a3-52f45ed0b79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:03:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d9ff2543-00a2-4605-8a0e-0642f2a63739 req-ac96b95a-47f1-445f-9f06-819f6fcbcfed service nova] Releasing lock "refresh_cache-1a664ead-4fec-454d-bca2-023afecb409a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:03:54 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:03:54 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Took 0.63 seconds to deallocate network for instance.
Aug 15 01:03:54 user nova-compute[73010]: DEBUG nova.compute.manager [req-704df866-5bf0-4ac5-9886-30548ee52758 req-40064548-206e-4fa9-bdb5-9b8869d873bf service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Received event network-vif-deleted-bca0154b-0273-4c6d-a4a3-52f45ed0b79f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:03:54 user nova-compute[73010]: DEBUG nova.compute.manager [req-c5cdf788-93d2-4583-a9fe-344b88eb3327 req-651a6550-d175-48cf-b376-4a51a0cf0b2a service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Received event network-vif-plugged-bca0154b-0273-4c6d-a4a3-52f45ed0b79f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:03:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c5cdf788-93d2-4583-a9fe-344b88eb3327 req-651a6550-d175-48cf-b376-4a51a0cf0b2a service nova] Acquiring lock "1a664ead-4fec-454d-bca2-023afecb409a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:03:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c5cdf788-93d2-4583-a9fe-344b88eb3327 req-651a6550-d175-48cf-b376-4a51a0cf0b2a service nova] Lock "1a664ead-4fec-454d-bca2-023afecb409a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:03:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c5cdf788-93d2-4583-a9fe-344b88eb3327 req-651a6550-d175-48cf-b376-4a51a0cf0b2a service nova] Lock "1a664ead-4fec-454d-bca2-023afecb409a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:03:54 user nova-compute[73010]: DEBUG nova.compute.manager [req-c5cdf788-93d2-4583-a9fe-344b88eb3327 req-651a6550-d175-48cf-b376-4a51a0cf0b2a service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] No waiting events found dispatching network-vif-plugged-bca0154b-0273-4c6d-a4a3-52f45ed0b79f {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:03:54 user nova-compute[73010]: WARNING nova.compute.manager [req-c5cdf788-93d2-4583-a9fe-344b88eb3327 req-651a6550-d175-48cf-b376-4a51a0cf0b2a service nova] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Received unexpected event network-vif-plugged-bca0154b-0273-4c6d-a4a3-52f45ed0b79f for instance with vm_state active and task_state deleting.
Aug 15 01:03:55 user nova-compute[73010]: INFO nova.compute.manager [None req-0111b658-2acb-4ef4-8809-b1d72d0b3069 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Unrescuing
Aug 15 01:03:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0111b658-2acb-4ef4-8809-b1d72d0b3069 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "refresh_cache-39a36324-d323-4169-abaa-09028eeb5598" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:03:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0111b658-2acb-4ef4-8809-b1d72d0b3069 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquired lock "refresh_cache-39a36324-d323-4169-abaa-09028eeb5598" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:03:55 user nova-compute[73010]: DEBUG nova.network.neutron [None req-0111b658-2acb-4ef4-8809-b1d72d0b3069 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 01:03:55 user nova-compute[73010]: INFO nova.compute.manager [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Took 0.75 seconds to detach 1 volumes for instance.
Aug 15 01:03:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:03:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:03:55 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:03:55 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:03:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:03:55 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Deleted allocations for instance 1a664ead-4fec-454d-bca2-023afecb409a
Aug 15 01:03:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-9a656071-5ee1-418f-b3a3-270a7222c475 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "1a664ead-4fec-454d-bca2-023afecb409a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.988s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:03:55 user nova-compute[73010]: DEBUG nova.network.neutron [None req-0111b658-2acb-4ef4-8809-b1d72d0b3069 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Updating instance_info_cache with network_info: [{"id": "18919d62-63b4-4622-af68-05b0ecfb2002", "address": "fa:16:3e:d7:7a:a7", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18919d62-63", "ovs_interfaceid": "18919d62-63b4-4622-af68-05b0ecfb2002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:03:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-0111b658-2acb-4ef4-8809-b1d72d0b3069 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Releasing lock "refresh_cache-39a36324-d323-4169-abaa-09028eeb5598" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:03:55 user nova-compute[73010]: DEBUG nova.objects.instance [None req-0111b658-2acb-4ef4-8809-b1d72d0b3069 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lazy-loading 'flavor' on Instance uuid 39a36324-d323-4169-abaa-09028eeb5598 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:03:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:56 user nova-compute[73010]: DEBUG nova.compute.manager [req-9d7c1b37-e1dd-4a31-a529-5ab58e176580 req-085da04c-df0b-4a96-b061-61b3a702dbf7 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received event network-vif-unplugged-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:03:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9d7c1b37-e1dd-4a31-a529-5ab58e176580 req-085da04c-df0b-4a96-b061-61b3a702dbf7 service nova] Acquiring lock "39a36324-d323-4169-abaa-09028eeb5598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:03:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9d7c1b37-e1dd-4a31-a529-5ab58e176580 req-085da04c-df0b-4a96-b061-61b3a702dbf7 service nova] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:03:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9d7c1b37-e1dd-4a31-a529-5ab58e176580 req-085da04c-df0b-4a96-b061-61b3a702dbf7 service nova] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:03:56 user nova-compute[73010]: DEBUG nova.compute.manager [req-9d7c1b37-e1dd-4a31-a529-5ab58e176580 req-085da04c-df0b-4a96-b061-61b3a702dbf7 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] No waiting events found dispatching network-vif-unplugged-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:03:56 user nova-compute[73010]: WARNING nova.compute.manager [req-9d7c1b37-e1dd-4a31-a529-5ab58e176580 req-085da04c-df0b-4a96-b061-61b3a702dbf7 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received unexpected event network-vif-unplugged-18919d62-63b4-4622-af68-05b0ecfb2002 for instance with vm_state rescued and task_state unrescuing.
Aug 15 01:03:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:56 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Instance destroyed successfully.
Aug 15 01:03:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:03:58 user nova-compute[73010]: DEBUG nova.compute.manager [req-d7699fd1-0887-4703-a657-5bb91b32c3a3 req-7d97ffde-90f5-434c-a0b2-2c579f4d4c1e service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received event network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:03:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d7699fd1-0887-4703-a657-5bb91b32c3a3 req-7d97ffde-90f5-434c-a0b2-2c579f4d4c1e service nova] Acquiring lock "39a36324-d323-4169-abaa-09028eeb5598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:03:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d7699fd1-0887-4703-a657-5bb91b32c3a3 req-7d97ffde-90f5-434c-a0b2-2c579f4d4c1e service nova] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:03:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d7699fd1-0887-4703-a657-5bb91b32c3a3 req-7d97ffde-90f5-434c-a0b2-2c579f4d4c1e service nova] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:03:58 user nova-compute[73010]: DEBUG nova.compute.manager [req-d7699fd1-0887-4703-a657-5bb91b32c3a3 req-7d97ffde-90f5-434c-a0b2-2c579f4d4c1e service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] No waiting events found dispatching network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:03:58 user nova-compute[73010]: WARNING nova.compute.manager [req-d7699fd1-0887-4703-a657-5bb91b32c3a3 req-7d97ffde-90f5-434c-a0b2-2c579f4d4c1e service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received unexpected event network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 for instance with vm_state rescued and task_state unrescuing.
Aug 15 01:03:58 user nova-compute[73010]: DEBUG nova.compute.manager [req-d7699fd1-0887-4703-a657-5bb91b32c3a3 req-7d97ffde-90f5-434c-a0b2-2c579f4d4c1e service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received event network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:03:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d7699fd1-0887-4703-a657-5bb91b32c3a3 req-7d97ffde-90f5-434c-a0b2-2c579f4d4c1e service nova] Acquiring lock "39a36324-d323-4169-abaa-09028eeb5598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:03:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d7699fd1-0887-4703-a657-5bb91b32c3a3 req-7d97ffde-90f5-434c-a0b2-2c579f4d4c1e service nova] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:03:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d7699fd1-0887-4703-a657-5bb91b32c3a3 req-7d97ffde-90f5-434c-a0b2-2c579f4d4c1e service nova] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:03:58 user nova-compute[73010]: DEBUG nova.compute.manager [req-d7699fd1-0887-4703-a657-5bb91b32c3a3 req-7d97ffde-90f5-434c-a0b2-2c579f4d4c1e service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] No waiting events found dispatching network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:03:58 user nova-compute[73010]: WARNING nova.compute.manager [req-d7699fd1-0887-4703-a657-5bb91b32c3a3 req-7d97ffde-90f5-434c-a0b2-2c579f4d4c1e service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received unexpected event network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 for instance with vm_state rescued and task_state unrescuing.
Aug 15 01:03:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Removed pending event for 39a36324-d323-4169-abaa-09028eeb5598 due to event {{(pid=73010) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 01:04:00 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061440.0815518, 39a36324-d323-4169-abaa-09028eeb5598 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:04:00 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] VM Resumed (Lifecycle Event)
Aug 15 01:04:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-0111b658-2acb-4ef4-8809-b1d72d0b3069 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:04:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:04:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:04:00 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 01:04:00 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061440.085699, 39a36324-d323-4169-abaa-09028eeb5598 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:04:00 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] VM Started (Lifecycle Event)
Aug 15 01:04:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:04:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:04:00 user nova-compute[73010]: DEBUG nova.compute.manager [req-dcfa51bd-4a85-49fc-933d-b846a4bcf5d9 req-afba1636-3dd2-405b-bc87-608d3c1bcf94 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received event network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:04:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dcfa51bd-4a85-49fc-933d-b846a4bcf5d9 req-afba1636-3dd2-405b-bc87-608d3c1bcf94 service nova] Acquiring lock "39a36324-d323-4169-abaa-09028eeb5598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:04:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dcfa51bd-4a85-49fc-933d-b846a4bcf5d9 req-afba1636-3dd2-405b-bc87-608d3c1bcf94 service nova] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:04:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dcfa51bd-4a85-49fc-933d-b846a4bcf5d9 req-afba1636-3dd2-405b-bc87-608d3c1bcf94 service nova] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:04:00 user nova-compute[73010]: DEBUG nova.compute.manager [req-dcfa51bd-4a85-49fc-933d-b846a4bcf5d9 req-afba1636-3dd2-405b-bc87-608d3c1bcf94 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] No waiting events found dispatching network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:04:00 user nova-compute[73010]: WARNING nova.compute.manager [req-dcfa51bd-4a85-49fc-933d-b846a4bcf5d9 req-afba1636-3dd2-405b-bc87-608d3c1bcf94 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received unexpected event network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 for instance with vm_state active and task_state None.
Aug 15 01:04:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:07 user nova-compute[73010]: DEBUG nova.compute.manager [req-74ea52cf-5117-488f-b1a1-0802fb872211 req-0a19a553-9ca8-4925-91ac-6de688a1ed2d service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Received event network-changed-c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:04:07 user nova-compute[73010]: DEBUG nova.compute.manager [req-74ea52cf-5117-488f-b1a1-0802fb872211 req-0a19a553-9ca8-4925-91ac-6de688a1ed2d service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Refreshing instance network info cache due to event network-changed-c94c8a3a-6c88-482c-8c90-86341f11658d. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 01:04:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-74ea52cf-5117-488f-b1a1-0802fb872211 req-0a19a553-9ca8-4925-91ac-6de688a1ed2d service nova] Acquiring lock "refresh_cache-6b931225-177c-4b6c-9989-8e036ad58987" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:04:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-74ea52cf-5117-488f-b1a1-0802fb872211 req-0a19a553-9ca8-4925-91ac-6de688a1ed2d service nova] Acquired lock "refresh_cache-6b931225-177c-4b6c-9989-8e036ad58987" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:04:07 user nova-compute[73010]: DEBUG nova.network.neutron [req-74ea52cf-5117-488f-b1a1-0802fb872211 req-0a19a553-9ca8-4925-91ac-6de688a1ed2d service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Refreshing network info cache for port c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 01:04:07 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:04:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:04:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:04:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:04:07 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:04:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:04:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:04:07 user nova-compute[73010]: INFO nova.compute.manager [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Detaching volume f1be21ab-24ec-4988-bc02-dc2c82f3fd0b
Aug 15 01:04:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:07 user nova-compute[73010]: INFO nova.virt.block_device [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Attempting to driver detach volume f1be21ab-24ec-4988-bc02-dc2c82f3fd0b from mountpoint /dev/vdc
Aug 15 01:04:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Attempting to detach device vdc from instance 20d92360-d4f7-4f17-8a32-fb901dd8feb8 from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 01:04:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 01:04:07 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:04:07 user nova-compute[73010]:   <source dev="/dev/sdf"/>
Aug 15 01:04:07 user nova-compute[73010]:   <target dev="vdc" bus="virtio"/>
Aug 15 01:04:07 user nova-compute[73010]:   <serial>f1be21ab-24ec-4988-bc02-dc2c82f3fd0b</serial>
Aug 15 01:04:07 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 01:04:07 user nova-compute[73010]: </disk>
Aug 15 01:04:07 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 01:04:07 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Successfully detached device vdc from instance 20d92360-d4f7-4f17-8a32-fb901dd8feb8 from the persistent domain config.
Aug 15 01:04:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 20d92360-d4f7-4f17-8a32-fb901dd8feb8 from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 01:04:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 01:04:07 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:04:07 user nova-compute[73010]:   <source dev="/dev/sdf"/>
Aug 15 01:04:07 user nova-compute[73010]:   <target dev="vdc" bus="virtio"/>
Aug 15 01:04:07 user nova-compute[73010]:   <serial>f1be21ab-24ec-4988-bc02-dc2c82f3fd0b</serial>
Aug 15 01:04:07 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 01:04:07 user nova-compute[73010]: </disk>
Aug 15 01:04:07 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 01:04:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:07 user nova-compute[73010]: DEBUG nova.network.neutron [req-74ea52cf-5117-488f-b1a1-0802fb872211 req-0a19a553-9ca8-4925-91ac-6de688a1ed2d service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Updated VIF entry in instance network info cache for port c94c8a3a-6c88-482c-8c90-86341f11658d. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 01:04:07 user nova-compute[73010]: DEBUG nova.network.neutron [req-74ea52cf-5117-488f-b1a1-0802fb872211 req-0a19a553-9ca8-4925-91ac-6de688a1ed2d service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Updating instance_info_cache with network_info: [{"id": "c94c8a3a-6c88-482c-8c90-86341f11658d", "address": "fa:16:3e:b7:84:04", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c8a3a-6c", "ovs_interfaceid": "c94c8a3a-6c88-482c-8c90-86341f11658d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:04:07 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-74ea52cf-5117-488f-b1a1-0802fb872211 req-0a19a553-9ca8-4925-91ac-6de688a1ed2d service nova] Releasing lock "refresh_cache-6b931225-177c-4b6c-9989-8e036ad58987" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692061448.2214446, 20d92360-d4f7-4f17-8a32-fb901dd8feb8 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 20d92360-d4f7-4f17-8a32-fb901dd8feb8 {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:08 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Successfully detached device vdc from instance 20d92360-d4f7-4f17-8a32-fb901dd8feb8 from the live domain config.
Aug 15 01:04:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grpBHhxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:04:08 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:04:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a252fd-0891-4436-945d-28f627d4033d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f568ce5-213b-4ab7-9b84-04db80fd1abc]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:04:08 user nova-compute[73010]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:04:08 user nova-compute[73010]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)
Aug 15 01:04:08 user nova-compute[73010]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b (non-flash)
Aug 15 01:04:08 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:04:08 user nova-compute[73010]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:04:08 user nova-compute[73010]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)
Aug 15 01:04:08 user nova-compute[73010]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b (non-flash)
Aug 15 01:04:08 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec3042e8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b'): ({'sdf'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Removing single pathed devices sdf {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692061433.3433204, 1a664ead-4fec-454d-bca2-023afecb409a => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:04:08 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] VM Stopped (Lifecycle Event)
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "6b931225-177c-4b6c-9989-8e036ad58987" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "6b931225-177c-4b6c-9989-8e036ad58987" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG nova.compute.manager [None req-c5ee291b-3b26-45d3-a1a2-0631dead846d None None] [instance: 1a664ead-4fec-454d-bca2-023afecb409a] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f51a26a-f4f4-4a20-81e2-6d1b83968976]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:08 user nova-compute[73010]: INFO nova.compute.manager [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Detaching volume 15660223-5084-4b21-bec1-f9f08cc0e8d4
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf956d7-fb07-49c3-919c-d29665bf35b9]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Flushing IO for device /dev/sdf {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca83f563-33f9-467e-9188-d824ae48827f]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0c2642-1e29-4193-b412-caefbdb97283]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:08 user nova-compute[73010]: INFO nova.virt.block_device [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Attempting to driver detach volume 15660223-5084-4b21-bec1-f9f08cc0e8d4 from mountpoint /dev/vdb
Aug 15 01:04:08 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] SCSI volumes sdf have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Attempting to detach device vdb from instance 6b931225-177c-4b6c-9989-8e036ad58987 from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 01:04:08 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:04:08 user nova-compute[73010]:   <source dev="/dev/sdd"/>
Aug 15 01:04:08 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 01:04:08 user nova-compute[73010]:   <serial>15660223-5084-4b21-bec1-f9f08cc0e8d4</serial>
Aug 15 01:04:08 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 01:04:08 user nova-compute[73010]: </disk>
Aug 15 01:04:08 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 01:04:08 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Successfully detached device vdb from instance 6b931225-177c-4b6c-9989-8e036ad58987 from the persistent domain config.
Aug 15 01:04:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6b931225-177c-4b6c-9989-8e036ad58987 from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 01:04:08 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:04:08 user nova-compute[73010]:   <source dev="/dev/sdd"/>
Aug 15 01:04:08 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 01:04:08 user nova-compute[73010]:   <serial>15660223-5084-4b21-bec1-f9f08cc0e8d4</serial>
Aug 15 01:04:08 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 01:04:08 user nova-compute[73010]: </disk>
Aug 15 01:04:08 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8d0602-5316-4124-a6db-3119ef3bc2fd]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[64491714-0399-4921-9a08-c601a40bd765]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b, portal: 172.16.0.220,3260]
Aug 15 01:04:08 user nova-compute[73010]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b, portal: 172.16.0.220,3260] successful.
Aug 15 01:04:08 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1be21ab-24ec-4988-bc02-dc2c82f3fd0b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a2b78c-a1cc-4b71-92c5-327242e1c2f1]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] <== disconnect_volume: return (323ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692061448.9926815, 6b931225-177c-4b6c-9989-8e036ad58987 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6b931225-177c-4b6c-9989-8e036ad58987 {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:04:09 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Successfully detached device vdb from instance 6b931225-177c-4b6c-9989-8e036ad58987 from the live domain config.
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIbCsXeH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:04:09 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:04:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[473e103c-3cc6-42b9-abd5-c0b530e3cfcd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lazy-loading 'flavor' on Instance uuid 20d92360-d4f7-4f17-8a32-fb901dd8feb8 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d398f3c-565f-48c9-842a-b08b26a7124f]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:04:09 user nova-compute[73010]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:04:09 user nova-compute[73010]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)
Aug 15 01:04:09 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:04:09 user nova-compute[73010]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:04:09 user nova-compute[73010]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 (non-flash)
Aug 15 01:04:09 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec50247be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4'): ({'sdd'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Removing single pathed devices sdd {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.compute.manager [req-e73c5192-8628-44f3-8213-b888f4098785 req-f361e218-3bd0-4278-8787-31f2de623446 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Received event network-changed-c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.compute.manager [req-e73c5192-8628-44f3-8213-b888f4098785 req-f361e218-3bd0-4278-8787-31f2de623446 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Refreshing instance network info cache due to event network-changed-c94c8a3a-6c88-482c-8c90-86341f11658d. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e73c5192-8628-44f3-8213-b888f4098785 req-f361e218-3bd0-4278-8787-31f2de623446 service nova] Acquiring lock "refresh_cache-6b931225-177c-4b6c-9989-8e036ad58987" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e73c5192-8628-44f3-8213-b888f4098785 req-f361e218-3bd0-4278-8787-31f2de623446 service nova] Acquired lock "refresh_cache-6b931225-177c-4b6c-9989-8e036ad58987" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.network.neutron [req-e73c5192-8628-44f3-8213-b888f4098785 req-f361e218-3bd0-4278-8787-31f2de623446 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Refreshing network info cache for port c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[763edd8e-1715-41c3-bca6-461b1ae2f71c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:09 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:04:09 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8256MB free_disk=25.287498474121094GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f9ca042e-1e3f-4e6d-a2eb-b7f1865baf71 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.849s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4307e4-83f8-4ab1-9988-cc4aa73e7d63]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Flushing IO for device /dev/sdd {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c95bda-349d-4436-887a-e9af70c5122c]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b2e585-f3cf-4ad8-b298-4da65643c10f]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] SCSI volumes sdd have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2984e3db-da31-4669-8424-73427a103345]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance d79e3854-769c-430a-b980-3a551c7ee34d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 634979eb-b706-4bdd-bb72-c2d163d3f8c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 6b931225-177c-4b6c-9989-8e036ad58987 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 39a36324-d323-4169-abaa-09028eeb5598 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 20d92360-d4f7-4f17-8a32-fb901dd8feb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed48a876-7354-4776-95b0-34c787f84032]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4, portal: 172.16.0.220,3260]
Aug 15 01:04:09 user nova-compute[73010]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4, portal: 172.16.0.220,3260] successful.
Aug 15 01:04:09 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Refreshing inventories for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15660223-5084-4b21-bec1-f9f08cc0e8d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2528fc-41c9-48e4-b8b2-6a13305cb375]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.666s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] <== disconnect_volume: return (668ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Updating ProviderTree inventory for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Updating inventory in ProviderTree for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Refreshing aggregate associations for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e, aggregates: None {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Refreshing trait associations for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.network.neutron [req-e73c5192-8628-44f3-8213-b888f4098785 req-f361e218-3bd0-4278-8787-31f2de623446 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Updated VIF entry in instance network info cache for port c94c8a3a-6c88-482c-8c90-86341f11658d. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.network.neutron [req-e73c5192-8628-44f3-8213-b888f4098785 req-f361e218-3bd0-4278-8787-31f2de623446 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Updating instance_info_cache with network_info: [{"id": "c94c8a3a-6c88-482c-8c90-86341f11658d", "address": "fa:16:3e:b7:84:04", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c8a3a-6c", "ovs_interfaceid": "c94c8a3a-6c88-482c-8c90-86341f11658d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e73c5192-8628-44f3-8213-b888f4098785 req-f361e218-3bd0-4278-8787-31f2de623446 service nova] Releasing lock "refresh_cache-6b931225-177c-4b6c-9989-8e036ad58987" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:04:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:04:10 user nova-compute[73010]: DEBUG nova.objects.instance [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lazy-loading 'flavor' on Instance uuid 6b931225-177c-4b6c-9989-8e036ad58987 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:04:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-27a0bbb6-a742-43e0-aea5-5d3908983b4a tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "6b931225-177c-4b6c-9989-8e036ad58987" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.120s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:04:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:14 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:04:14 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:04:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:18 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:04:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:04:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-20d92360-d4f7-4f17-8a32-fb901dd8feb8" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:04:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-20d92360-d4f7-4f17-8a32-fb901dd8feb8" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:04:18 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 01:04:19 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Updating instance_info_cache with network_info: [{"id": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "address": "fa:16:3e:d7:26:86", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb08a1cd-71", "ovs_interfaceid": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:04:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-20d92360-d4f7-4f17-8a32-fb901dd8feb8" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:04:19 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 01:04:19 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:04:20 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:04:20 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:04:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:04:21 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:04:22 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:04:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:32 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:04:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:04:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:55 user nova-compute[73010]: DEBUG nova.compute.manager [req-23f8eea8-086f-4a12-8f38-dee866287306 req-07dfe20e-a59e-4b86-b73d-cbf67c22ef68 service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Received event network-changed-a0d42bd2-1517-4cc8-9783-b7d6f124c301 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:04:55 user nova-compute[73010]: DEBUG nova.compute.manager [req-23f8eea8-086f-4a12-8f38-dee866287306 req-07dfe20e-a59e-4b86-b73d-cbf67c22ef68 service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Refreshing instance network info cache due to event network-changed-a0d42bd2-1517-4cc8-9783-b7d6f124c301. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 01:04:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-23f8eea8-086f-4a12-8f38-dee866287306 req-07dfe20e-a59e-4b86-b73d-cbf67c22ef68 service nova] Acquiring lock "refresh_cache-634979eb-b706-4bdd-bb72-c2d163d3f8c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:04:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-23f8eea8-086f-4a12-8f38-dee866287306 req-07dfe20e-a59e-4b86-b73d-cbf67c22ef68 service nova] Acquired lock "refresh_cache-634979eb-b706-4bdd-bb72-c2d163d3f8c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:04:55 user nova-compute[73010]: DEBUG nova.network.neutron [req-23f8eea8-086f-4a12-8f38-dee866287306 req-07dfe20e-a59e-4b86-b73d-cbf67c22ef68 service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Refreshing network info cache for port a0d42bd2-1517-4cc8-9783-b7d6f124c301 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 01:04:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "634979eb-b706-4bdd-bb72-c2d163d3f8c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:04:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "634979eb-b706-4bdd-bb72-c2d163d3f8c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:04:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "634979eb-b706-4bdd-bb72-c2d163d3f8c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:04:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "634979eb-b706-4bdd-bb72-c2d163d3f8c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:04:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "634979eb-b706-4bdd-bb72-c2d163d3f8c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:04:55 user nova-compute[73010]: INFO nova.compute.manager [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Terminating instance
Aug 15 01:04:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 01:04:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:55 user nova-compute[73010]: DEBUG nova.compute.manager [req-4968b145-1371-43f3-84c5-a6caa6dfe0e3 req-847481cb-5511-455f-8839-6900ce55c1e9 service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Received event network-vif-unplugged-a0d42bd2-1517-4cc8-9783-b7d6f124c301 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:04:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4968b145-1371-43f3-84c5-a6caa6dfe0e3 req-847481cb-5511-455f-8839-6900ce55c1e9 service nova] Acquiring lock "634979eb-b706-4bdd-bb72-c2d163d3f8c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:04:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4968b145-1371-43f3-84c5-a6caa6dfe0e3 req-847481cb-5511-455f-8839-6900ce55c1e9 service nova] Lock "634979eb-b706-4bdd-bb72-c2d163d3f8c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:04:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-4968b145-1371-43f3-84c5-a6caa6dfe0e3 req-847481cb-5511-455f-8839-6900ce55c1e9 service nova] Lock "634979eb-b706-4bdd-bb72-c2d163d3f8c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:04:55 user nova-compute[73010]: DEBUG nova.compute.manager [req-4968b145-1371-43f3-84c5-a6caa6dfe0e3 req-847481cb-5511-455f-8839-6900ce55c1e9 service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] No waiting events found dispatching network-vif-unplugged-a0d42bd2-1517-4cc8-9783-b7d6f124c301 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:04:55 user nova-compute[73010]: DEBUG nova.compute.manager [req-4968b145-1371-43f3-84c5-a6caa6dfe0e3 req-847481cb-5511-455f-8839-6900ce55c1e9 service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Received event network-vif-unplugged-a0d42bd2-1517-4cc8-9783-b7d6f124c301 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 01:04:55 user nova-compute[73010]: DEBUG nova.network.neutron [req-23f8eea8-086f-4a12-8f38-dee866287306 req-07dfe20e-a59e-4b86-b73d-cbf67c22ef68 service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Updated VIF entry in instance network info cache for port a0d42bd2-1517-4cc8-9783-b7d6f124c301. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 01:04:55 user nova-compute[73010]: DEBUG nova.network.neutron [req-23f8eea8-086f-4a12-8f38-dee866287306 req-07dfe20e-a59e-4b86-b73d-cbf67c22ef68 service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Updating instance_info_cache with network_info: [{"id": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "address": "fa:16:3e:29:2e:78", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d42bd2-15", "ovs_interfaceid": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:04:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-23f8eea8-086f-4a12-8f38-dee866287306 req-07dfe20e-a59e-4b86-b73d-cbf67c22ef68 service nova] Releasing lock "refresh_cache-634979eb-b706-4bdd-bb72-c2d163d3f8c9" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:56 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Instance destroyed successfully.
Aug 15 01:04:56 user nova-compute[73010]: DEBUG nova.objects.instance [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lazy-loading 'resources' on Instance uuid 634979eb-b706-4bdd-bb72-c2d163d3f8c9 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1425881955',display_name='tempest-TestVolumeBootPattern-server-1425881955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1425881955',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1zaN+b+VydDVLamZvE8X1Kd/Q5Q2Sojr9sHX021PLtuvBNvO93jAR1znkRwvthrtxRfhwBKAX8n8oRWo/mH1ipr8A9qzs9a0e/tyPo6tpDcd6aKpdp/ZnfjKtEL/p1Mg==',key_name='tempest-TestVolumeBootPattern-1981746338',keypairs=<?>,launch_index=0,launched_at=2023-08-15T01:00:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f67d1031d3cb4c8fb66342a7888ca1c4',ramdisk_id='',reservation_id='r-7c3yr3ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1953358779',owner_user_name='tempest-TestVolumeBootPattern-1953358779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T01:00:10Z,user_data=None,user_id='daa4eb788f724a6fbf908b029315a02b',uuid=634979eb-b706-4bdd-bb72-c2d163d3f8c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "address": "fa:16:3e:29:2e:78", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d42bd2-15", "ovs_interfaceid": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converting VIF {"id": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "address": "fa:16:3e:29:2e:78", "network": {"id": "f0198fed-63b4-4b83-b68b-0187fce57278", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-367469776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f67d1031d3cb4c8fb66342a7888ca1c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d42bd2-15", "ovs_interfaceid": "a0d42bd2-1517-4cc8-9783-b7d6f124c301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:2e:78,bridge_name='br-int',has_traffic_filtering=True,id=a0d42bd2-1517-4cc8-9783-b7d6f124c301,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0d42bd2-15') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG os_vif [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:2e:78,bridge_name='br-int',has_traffic_filtering=True,id=a0d42bd2-1517-4cc8-9783-b7d6f124c301,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0d42bd2-15') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0d42bd2-15, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:04:56 user nova-compute[73010]: INFO os_vif [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:2e:78,bridge_name='br-int',has_traffic_filtering=True,id=a0d42bd2-1517-4cc8-9783-b7d6f124c301,network=Network(f0198fed-63b4-4b83-b68b-0187fce57278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0d42bd2-15')
Aug 15 01:04:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YtmOlWJi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:04:56 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:04:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a50a36e-daef-411d-9300-f4ea19aeb213]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[304446b1-2eed-4fd0-a803-2fbf6fec75e3]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:04:56 user nova-compute[73010]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:04:56 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f (non-flash)
Aug 15 01:04:56 user nova-compute[73010]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:04:56 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec304ad000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f'): ({'sdb'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Removing single pathed devices sdb {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a57c2b-f7fc-4c02-afb4-b0e45fd33cbf]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedb26f6-03cf-4804-a10f-8c547ade36a1]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Flushing IO for device /dev/sdb {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd0c909-6599-43ca-90c6-6bf571790da0]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcad209-a9b9-4583-bc0e-d08a8fb59b2e]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe07fa2f9-1d74e4440ad1f1ee', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e07fa2f9', '/dev/disk/by-id/scsi-23164373465343434') {{(pid=84080) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[289c1f80-809a-416f-8516-7b59e4a1208b]: (4, None) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[41757abf-df83-43c6-abfd-ac7d1efea34e]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d351e31c-c7da-451c-8cc0-a69f2222b1dd]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f, portal: 172.16.0.220,3260]
Aug 15 01:04:56 user nova-compute[73010]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f, portal: 172.16.0.220,3260] successful.
Aug 15 01:04:56 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048aabec-0774-43ba-b0e0-68effb43d98f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd619d9-a451-43e4-bafb-0e8d43b2ef52]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] <== disconnect_volume: return (287ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 01:04:56 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Deleting instance files /opt/stack/data/nova/instances/634979eb-b706-4bdd-bb72-c2d163d3f8c9_del
Aug 15 01:04:56 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Deletion of /opt/stack/data/nova/instances/634979eb-b706-4bdd-bb72-c2d163d3f8c9_del complete
Aug 15 01:04:56 user nova-compute[73010]: INFO nova.compute.manager [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 15 01:04:56 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 01:04:56 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 01:04:57 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:04:57 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Took 0.57 seconds to deallocate network for instance.
Aug 15 01:04:57 user nova-compute[73010]: DEBUG nova.compute.manager [req-84779d9f-675c-40f7-be8e-f5c7124468e5 req-9c3c908d-fc8c-4c29-a83c-1e73bb6e7f84 service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Received event network-vif-deleted-a0d42bd2-1517-4cc8-9783-b7d6f124c301 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:04:57 user nova-compute[73010]: DEBUG nova.compute.manager [req-1a5d3afb-645c-4ea9-8b93-86ec61f84ec3 req-66084fc2-6d29-40c2-b82d-8a9da07b11ac service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Received event network-vif-plugged-a0d42bd2-1517-4cc8-9783-b7d6f124c301 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:04:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1a5d3afb-645c-4ea9-8b93-86ec61f84ec3 req-66084fc2-6d29-40c2-b82d-8a9da07b11ac service nova] Acquiring lock "634979eb-b706-4bdd-bb72-c2d163d3f8c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:04:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1a5d3afb-645c-4ea9-8b93-86ec61f84ec3 req-66084fc2-6d29-40c2-b82d-8a9da07b11ac service nova] Lock "634979eb-b706-4bdd-bb72-c2d163d3f8c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:04:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1a5d3afb-645c-4ea9-8b93-86ec61f84ec3 req-66084fc2-6d29-40c2-b82d-8a9da07b11ac service nova] Lock "634979eb-b706-4bdd-bb72-c2d163d3f8c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:04:57 user nova-compute[73010]: DEBUG nova.compute.manager [req-1a5d3afb-645c-4ea9-8b93-86ec61f84ec3 req-66084fc2-6d29-40c2-b82d-8a9da07b11ac service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] No waiting events found dispatching network-vif-plugged-a0d42bd2-1517-4cc8-9783-b7d6f124c301 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:04:57 user nova-compute[73010]: WARNING nova.compute.manager [req-1a5d3afb-645c-4ea9-8b93-86ec61f84ec3 req-66084fc2-6d29-40c2-b82d-8a9da07b11ac service nova] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Received unexpected event network-vif-plugged-a0d42bd2-1517-4cc8-9783-b7d6f124c301 for instance with vm_state active and task_state deleting.
Aug 15 01:04:57 user nova-compute[73010]: INFO nova.compute.manager [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Took 0.73 seconds to detach 1 volumes for instance.
Aug 15 01:04:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6433e927-c867-40b4-b7ad-9f847a6fa905 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:04:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6433e927-c867-40b4-b7ad-9f847a6fa905 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:04:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6433e927-c867-40b4-b7ad-9f847a6fa905 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:04:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6433e927-c867-40b4-b7ad-9f847a6fa905 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:04:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6433e927-c867-40b4-b7ad-9f847a6fa905 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:04:57 user nova-compute[73010]: INFO nova.compute.manager [None req-6433e927-c867-40b4-b7ad-9f847a6fa905 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Terminating instance
Aug 15 01:04:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-6433e927-c867-40b4-b7ad-9f847a6fa905 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 01:04:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:04:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:04:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:58 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:04:58 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:04:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:04:58 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Deleted allocations for instance 634979eb-b706-4bdd-bb72-c2d163d3f8c9
Aug 15 01:04:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-61cd9d4c-d7e4-44a1-9db9-01d5176635c1 tempest-TestVolumeBootPattern-1953358779 tempest-TestVolumeBootPattern-1953358779-project-member] Lock "634979eb-b706-4bdd-bb72-c2d163d3f8c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.831s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:04:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Instance destroyed successfully.
Aug 15 01:04:58 user nova-compute[73010]: DEBUG nova.objects.instance [None req-6433e927-c867-40b4-b7ad-9f847a6fa905 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lazy-loading 'resources' on Instance uuid 20d92360-d4f7-4f17-8a32-fb901dd8feb8 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:04:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-6433e927-c867-40b4-b7ad-9f847a6fa905 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T00:58:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-250049231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-250049231',id=44,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB68T4Tfh7suf54gX4WwC1EAatBAA0f+1a93JBgelOv/aFsQJIUeViaEqJv62ELVcOXfDPqS4j5ENQxQZplvmlKnUkW3CYdpGB4XrHmlOoqKR080R20EdRsZnzavNv1BQQ==',key_name='tempest-keypair-449371876',keypairs=<?>,launch_index=0,launched_at=2023-08-15T01:02:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='586bed330893488081bb21738b1a6ec4',ramdisk_id='',reservation_id='r-ckgkv059',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-563974852',owner_user_name='tempest-AttachVolumeShelveTestJSON-563974852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T01:02:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c5655da76eb4671b4db00e086232f05',uuid=20d92360-d4f7-4f17-8a32-fb901dd8feb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "address": "fa:16:3e:d7:26:86", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb08a1cd-71", "ovs_interfaceid": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 01:04:58 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-6433e927-c867-40b4-b7ad-9f847a6fa905 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Converting VIF {"id": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "address": "fa:16:3e:d7:26:86", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb08a1cd-71", "ovs_interfaceid": "bb08a1cd-7152-4c81-b416-ac00f5bb59be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:04:58 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-6433e927-c867-40b4-b7ad-9f847a6fa905 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:26:86,bridge_name='br-int',has_traffic_filtering=True,id=bb08a1cd-7152-4c81-b416-ac00f5bb59be,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb08a1cd-71') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:04:58 user nova-compute[73010]: DEBUG os_vif [None req-6433e927-c867-40b4-b7ad-9f847a6fa905 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:26:86,bridge_name='br-int',has_traffic_filtering=True,id=bb08a1cd-7152-4c81-b416-ac00f5bb59be,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb08a1cd-71') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 01:04:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb08a1cd-71, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:04:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:04:58 user nova-compute[73010]: INFO os_vif [None req-6433e927-c867-40b4-b7ad-9f847a6fa905 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:26:86,bridge_name='br-int',has_traffic_filtering=True,id=bb08a1cd-7152-4c81-b416-ac00f5bb59be,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb08a1cd-71')
Aug 15 01:04:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-6433e927-c867-40b4-b7ad-9f847a6fa905 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Deleting instance files /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8_del
Aug 15 01:04:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-6433e927-c867-40b4-b7ad-9f847a6fa905 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Deletion of /opt/stack/data/nova/instances/20d92360-d4f7-4f17-8a32-fb901dd8feb8_del complete
Aug 15 01:04:58 user nova-compute[73010]: INFO nova.compute.manager [None req-6433e927-c867-40b4-b7ad-9f847a6fa905 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 15 01:04:58 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-6433e927-c867-40b4-b7ad-9f847a6fa905 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 01:04:58 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 01:04:58 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 01:04:59 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:04:59 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Took 1.01 seconds to deallocate network for instance.
Aug 15 01:04:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-96b77609-cb4c-4ba1-a03a-b153e6d332a3 req-b367c85c-dcb2-4957-b5ab-3ad37b11d66c service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Received event network-vif-deleted-bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:04:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-91d52f22-d547-43f2-ba63-ae79859ce96a req-45ff605c-4c6d-4d41-9adf-80b50a0b6744 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Received event network-vif-unplugged-bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:04:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-91d52f22-d547-43f2-ba63-ae79859ce96a req-45ff605c-4c6d-4d41-9adf-80b50a0b6744 service nova] Acquiring lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:04:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-91d52f22-d547-43f2-ba63-ae79859ce96a req-45ff605c-4c6d-4d41-9adf-80b50a0b6744 service nova] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:04:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-91d52f22-d547-43f2-ba63-ae79859ce96a req-45ff605c-4c6d-4d41-9adf-80b50a0b6744 service nova] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:04:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-91d52f22-d547-43f2-ba63-ae79859ce96a req-45ff605c-4c6d-4d41-9adf-80b50a0b6744 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] No waiting events found dispatching network-vif-unplugged-bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:04:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-91d52f22-d547-43f2-ba63-ae79859ce96a req-45ff605c-4c6d-4d41-9adf-80b50a0b6744 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Received event network-vif-unplugged-bb08a1cd-7152-4c81-b416-ac00f5bb59be for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 01:04:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-91d52f22-d547-43f2-ba63-ae79859ce96a req-45ff605c-4c6d-4d41-9adf-80b50a0b6744 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Received event network-vif-plugged-bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:04:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-91d52f22-d547-43f2-ba63-ae79859ce96a req-45ff605c-4c6d-4d41-9adf-80b50a0b6744 service nova] Acquiring lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:04:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-91d52f22-d547-43f2-ba63-ae79859ce96a req-45ff605c-4c6d-4d41-9adf-80b50a0b6744 service nova] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:04:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-91d52f22-d547-43f2-ba63-ae79859ce96a req-45ff605c-4c6d-4d41-9adf-80b50a0b6744 service nova] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:04:59 user nova-compute[73010]: DEBUG nova.compute.manager [req-91d52f22-d547-43f2-ba63-ae79859ce96a req-45ff605c-4c6d-4d41-9adf-80b50a0b6744 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] No waiting events found dispatching network-vif-plugged-bb08a1cd-7152-4c81-b416-ac00f5bb59be {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:04:59 user nova-compute[73010]: WARNING nova.compute.manager [req-91d52f22-d547-43f2-ba63-ae79859ce96a req-45ff605c-4c6d-4d41-9adf-80b50a0b6744 service nova] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Received unexpected event network-vif-plugged-bb08a1cd-7152-4c81-b416-ac00f5bb59be for instance with vm_state active and task_state deleting.
Aug 15 01:04:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6433e927-c867-40b4-b7ad-9f847a6fa905 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:04:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6433e927-c867-40b4-b7ad-9f847a6fa905 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:05:00 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-6433e927-c867-40b4-b7ad-9f847a6fa905 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:05:00 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-6433e927-c867-40b4-b7ad-9f847a6fa905 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:05:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6433e927-c867-40b4-b7ad-9f847a6fa905 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:05:00 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-6433e927-c867-40b4-b7ad-9f847a6fa905 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Deleted allocations for instance 20d92360-d4f7-4f17-8a32-fb901dd8feb8
Aug 15 01:05:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-6433e927-c867-40b4-b7ad-9f847a6fa905 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "20d92360-d4f7-4f17-8a32-fb901dd8feb8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.270s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:05:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d68d396a-cfee-43e7-98bd-a72cf5120aa1 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "6b931225-177c-4b6c-9989-8e036ad58987" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:05:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d68d396a-cfee-43e7-98bd-a72cf5120aa1 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "6b931225-177c-4b6c-9989-8e036ad58987" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:05:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d68d396a-cfee-43e7-98bd-a72cf5120aa1 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "6b931225-177c-4b6c-9989-8e036ad58987-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:05:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d68d396a-cfee-43e7-98bd-a72cf5120aa1 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "6b931225-177c-4b6c-9989-8e036ad58987-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:05:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d68d396a-cfee-43e7-98bd-a72cf5120aa1 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "6b931225-177c-4b6c-9989-8e036ad58987-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:05:04 user nova-compute[73010]: INFO nova.compute.manager [None req-d68d396a-cfee-43e7-98bd-a72cf5120aa1 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Terminating instance
Aug 15 01:05:04 user nova-compute[73010]: DEBUG nova.compute.manager [None req-d68d396a-cfee-43e7-98bd-a72cf5120aa1 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 01:05:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:04 user nova-compute[73010]: DEBUG nova.compute.manager [req-a38d851c-a119-47a9-89ef-41e1b5f51be3 req-799227fc-bc0f-4489-866d-0bea121b6b7f service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Received event network-vif-unplugged-c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:05:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a38d851c-a119-47a9-89ef-41e1b5f51be3 req-799227fc-bc0f-4489-866d-0bea121b6b7f service nova] Acquiring lock "6b931225-177c-4b6c-9989-8e036ad58987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:05:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a38d851c-a119-47a9-89ef-41e1b5f51be3 req-799227fc-bc0f-4489-866d-0bea121b6b7f service nova] Lock "6b931225-177c-4b6c-9989-8e036ad58987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:05:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a38d851c-a119-47a9-89ef-41e1b5f51be3 req-799227fc-bc0f-4489-866d-0bea121b6b7f service nova] Lock "6b931225-177c-4b6c-9989-8e036ad58987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:05:04 user nova-compute[73010]: DEBUG nova.compute.manager [req-a38d851c-a119-47a9-89ef-41e1b5f51be3 req-799227fc-bc0f-4489-866d-0bea121b6b7f service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] No waiting events found dispatching network-vif-unplugged-c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:05:04 user nova-compute[73010]: DEBUG nova.compute.manager [req-a38d851c-a119-47a9-89ef-41e1b5f51be3 req-799227fc-bc0f-4489-866d-0bea121b6b7f service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Received event network-vif-unplugged-c94c8a3a-6c88-482c-8c90-86341f11658d for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 01:05:04 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Instance destroyed successfully.
Aug 15 01:05:04 user nova-compute[73010]: DEBUG nova.objects.instance [None req-d68d396a-cfee-43e7-98bd-a72cf5120aa1 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lazy-loading 'resources' on Instance uuid 6b931225-177c-4b6c-9989-8e036ad58987 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:05:04 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-d68d396a-cfee-43e7-98bd-a72cf5120aa1 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:00:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1796039906',display_name='tempest-TestMinimumBasicScenario-server-1796039906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1796039906',id=46,image_ref='40cc5fd5-6bd4-4612-98a3-8a25318367bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKw3jtnMWSuPt98NSH+l+ULYp8Ma5pXlJY0JJeurqUEH8Nlw2IrmaxtNfQ23YS5Ob8cURz+RHERbbh51Wx+YzyP3ifGdx/RR0LTznoTGMNFEmPMhPHSf7FT6Rhv0b6KLhg==',key_name='tempest-TestMinimumBasicScenario-969106236',keypairs=<?>,launch_index=0,launched_at=2023-08-15T01:00:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3103787ed9304a92a5224610d2e8645a',ramdisk_id='',reservation_id='r-051bace4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40cc5fd5-6bd4-4612-98a3-8a25318367bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2145836143',owner_user_name='tempest-TestMinimumBasicScenario-2145836143-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T01:02:23Z,user_data=None,user_id='58496cb5284e45788eb645d0bff01dc8',uuid=6b931225-177c-4b6c-9989-8e036ad58987,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c94c8a3a-6c88-482c-8c90-86341f11658d", "address": "fa:16:3e:b7:84:04", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c8a3a-6c", "ovs_interfaceid": "c94c8a3a-6c88-482c-8c90-86341f11658d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 01:05:04 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-d68d396a-cfee-43e7-98bd-a72cf5120aa1 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Converting VIF {"id": "c94c8a3a-6c88-482c-8c90-86341f11658d", "address": "fa:16:3e:b7:84:04", "network": {"id": "8aef7e84-aa84-4b82-beae-723c69281253", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-732483313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3103787ed9304a92a5224610d2e8645a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c8a3a-6c", "ovs_interfaceid": "c94c8a3a-6c88-482c-8c90-86341f11658d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:05:04 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-d68d396a-cfee-43e7-98bd-a72cf5120aa1 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:84:04,bridge_name='br-int',has_traffic_filtering=True,id=c94c8a3a-6c88-482c-8c90-86341f11658d,network=Network(8aef7e84-aa84-4b82-beae-723c69281253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc94c8a3a-6c') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:05:04 user nova-compute[73010]: DEBUG os_vif [None req-d68d396a-cfee-43e7-98bd-a72cf5120aa1 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:84:04,bridge_name='br-int',has_traffic_filtering=True,id=c94c8a3a-6c88-482c-8c90-86341f11658d,network=Network(8aef7e84-aa84-4b82-beae-723c69281253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc94c8a3a-6c') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 01:05:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc94c8a3a-6c, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:05:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:05:05 user nova-compute[73010]: INFO os_vif [None req-d68d396a-cfee-43e7-98bd-a72cf5120aa1 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:84:04,bridge_name='br-int',has_traffic_filtering=True,id=c94c8a3a-6c88-482c-8c90-86341f11658d,network=Network(8aef7e84-aa84-4b82-beae-723c69281253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc94c8a3a-6c')
Aug 15 01:05:05 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-d68d396a-cfee-43e7-98bd-a72cf5120aa1 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Deleting instance files /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987_del
Aug 15 01:05:05 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-d68d396a-cfee-43e7-98bd-a72cf5120aa1 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Deletion of /opt/stack/data/nova/instances/6b931225-177c-4b6c-9989-8e036ad58987_del complete
Aug 15 01:05:05 user nova-compute[73010]: INFO nova.compute.manager [None req-d68d396a-cfee-43e7-98bd-a72cf5120aa1 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 15 01:05:05 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-d68d396a-cfee-43e7-98bd-a72cf5120aa1 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 01:05:05 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 01:05:05 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 01:05:05 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:05:05 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Took 0.60 seconds to deallocate network for instance.
Aug 15 01:05:05 user nova-compute[73010]: DEBUG nova.compute.manager [req-e7039f31-e5c7-4516-90e1-0df27f14c235 req-3a4689fb-1b83-4794-8d82-0d9e034f9804 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Received event network-vif-deleted-c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:05:05 user nova-compute[73010]: INFO nova.compute.manager [req-e7039f31-e5c7-4516-90e1-0df27f14c235 req-3a4689fb-1b83-4794-8d82-0d9e034f9804 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Neutron deleted interface c94c8a3a-6c88-482c-8c90-86341f11658d; detaching it from the instance and deleting it from the info cache
Aug 15 01:05:05 user nova-compute[73010]: DEBUG nova.network.neutron [req-e7039f31-e5c7-4516-90e1-0df27f14c235 req-3a4689fb-1b83-4794-8d82-0d9e034f9804 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:05:05 user nova-compute[73010]: DEBUG nova.compute.manager [req-e7039f31-e5c7-4516-90e1-0df27f14c235 req-3a4689fb-1b83-4794-8d82-0d9e034f9804 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Detach interface failed, port_id=c94c8a3a-6c88-482c-8c90-86341f11658d, reason: Instance 6b931225-177c-4b6c-9989-8e036ad58987 could not be found. {{(pid=73010) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 01:05:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d68d396a-cfee-43e7-98bd-a72cf5120aa1 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:05:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d68d396a-cfee-43e7-98bd-a72cf5120aa1 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:05:05 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-d68d396a-cfee-43e7-98bd-a72cf5120aa1 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:05:05 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-d68d396a-cfee-43e7-98bd-a72cf5120aa1 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:05:05 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d68d396a-cfee-43e7-98bd-a72cf5120aa1 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:05:06 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-d68d396a-cfee-43e7-98bd-a72cf5120aa1 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Deleted allocations for instance 6b931225-177c-4b6c-9989-8e036ad58987
Aug 15 01:05:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d68d396a-cfee-43e7-98bd-a72cf5120aa1 tempest-TestMinimumBasicScenario-2145836143 tempest-TestMinimumBasicScenario-2145836143-project-member] Lock "6b931225-177c-4b6c-9989-8e036ad58987" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.996s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:05:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-f5dafdd9-8a43-4e31-b860-15a73c977ed7 req-297b4026-f629-4914-8c7b-7fb01407bae4 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Received event network-vif-plugged-c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:05:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f5dafdd9-8a43-4e31-b860-15a73c977ed7 req-297b4026-f629-4914-8c7b-7fb01407bae4 service nova] Acquiring lock "6b931225-177c-4b6c-9989-8e036ad58987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:05:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f5dafdd9-8a43-4e31-b860-15a73c977ed7 req-297b4026-f629-4914-8c7b-7fb01407bae4 service nova] Lock "6b931225-177c-4b6c-9989-8e036ad58987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:05:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f5dafdd9-8a43-4e31-b860-15a73c977ed7 req-297b4026-f629-4914-8c7b-7fb01407bae4 service nova] Lock "6b931225-177c-4b6c-9989-8e036ad58987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:05:06 user nova-compute[73010]: DEBUG nova.compute.manager [req-f5dafdd9-8a43-4e31-b860-15a73c977ed7 req-297b4026-f629-4914-8c7b-7fb01407bae4 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] No waiting events found dispatching network-vif-plugged-c94c8a3a-6c88-482c-8c90-86341f11658d {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:05:06 user nova-compute[73010]: WARNING nova.compute.manager [req-f5dafdd9-8a43-4e31-b860-15a73c977ed7 req-297b4026-f629-4914-8c7b-7fb01407bae4 service nova] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Received unexpected event network-vif-plugged-c94c8a3a-6c88-482c-8c90-86341f11658d for instance with vm_state deleted and task_state None.
Aug 15 01:05:09 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:05:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:05:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:05:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:05:09 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:05:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:05:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:05:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:05:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:05:09 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:05:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:10 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:05:10 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:05:10 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8606MB free_disk=25.342018127441406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:05:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:05:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:05:10 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance d79e3854-769c-430a-b980-3a551c7ee34d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:05:10 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 39a36324-d323-4169-abaa-09028eeb5598 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:05:10 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:05:10 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:05:10 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:05:10 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:05:10 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:05:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:05:11 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692061496.223327, 634979eb-b706-4bdd-bb72-c2d163d3f8c9 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:05:11 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] VM Stopped (Lifecycle Event)
Aug 15 01:05:11 user nova-compute[73010]: DEBUG nova.compute.manager [None req-22fdb1bd-38c9-4fdd-986b-562fd5455062 None None] [instance: 634979eb-b706-4bdd-bb72-c2d163d3f8c9] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:05:13 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692061498.7273378, 20d92360-d4f7-4f17-8a32-fb901dd8feb8 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:05:13 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] VM Stopped (Lifecycle Event)
Aug 15 01:05:13 user nova-compute[73010]: DEBUG nova.compute.manager [None req-330e6987-3cdc-4885-b173-cb5ea937af90 None None] [instance: 20d92360-d4f7-4f17-8a32-fb901dd8feb8] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:05:14 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:05:14 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:05:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:18 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:05:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:05:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-39a36324-d323-4169-abaa-09028eeb5598" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:05:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-39a36324-d323-4169-abaa-09028eeb5598" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:05:18 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 01:05:19 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Updating instance_info_cache with network_info: [{"id": "18919d62-63b4-4622-af68-05b0ecfb2002", "address": "fa:16:3e:d7:7a:a7", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18919d62-63", "ovs_interfaceid": "18919d62-63b4-4622-af68-05b0ecfb2002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:05:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-39a36324-d323-4169-abaa-09028eeb5598" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:05:19 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 01:05:19 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:05:19 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692061504.974595, 6b931225-177c-4b6c-9989-8e036ad58987 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:05:19 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] VM Stopped (Lifecycle Event)
Aug 15 01:05:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-dfb5df72-ff25-458a-9840-4ec313ebf27c None None] [instance: 6b931225-177c-4b6c-9989-8e036ad58987] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:05:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:05:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:05:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:05:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:05:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:21 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:05:21 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:05:22 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:05:23 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:05:24 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:05:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:05:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:05:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:05:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:05:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:05:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:05:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "2e7996e6-56fe-44b3-ad02-d17f7ddb358a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:05:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "2e7996e6-56fe-44b3-ad02-d17f7ddb358a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:05:46 user nova-compute[73010]: DEBUG nova.compute.manager [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 01:05:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:05:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:05:46 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 01:05:46 user nova-compute[73010]: INFO nova.compute.claims [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Claim successful on node user
Aug 15 01:05:47 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:05:47 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:05:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.219s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:05:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 01:05:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 01:05:47 user nova-compute[73010]: DEBUG nova.network.neutron [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 01:05:47 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 01:05:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 01:05:47 user nova-compute[73010]: DEBUG nova.policy [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e1e98c9bae145f0909011bb46c6e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6db1cb9145b49999d0f102f8cfb867a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 01:05:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 01:05:47 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 01:05:47 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Creating image(s)
Aug 15 01:05:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:05:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "/opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:05:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "/opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:05:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:05:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.179s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:05:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:05:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:05:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:05:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.174s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:05:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:05:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk 1073741824" returned: 0 in 0.055s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:05:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:05:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:05:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.179s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:05:47 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 01:05:47 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:05:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:05:48 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Cannot resize image /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 01:05:48 user nova-compute[73010]: DEBUG nova.objects.instance [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lazy-loading 'migration_context' on Instance uuid 2e7996e6-56fe-44b3-ad02-d17f7ddb358a {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:05:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 01:05:48 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Ensure instance console log exists: /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 01:05:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:05:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:05:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:05:48 user nova-compute[73010]: DEBUG nova.network.neutron [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Successfully created port: 3a41eecc-5993-483d-b86f-1d174df9d996 {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 01:05:48 user nova-compute[73010]: DEBUG nova.network.neutron [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Successfully updated port: 3a41eecc-5993-483d-b86f-1d174df9d996 {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 01:05:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "refresh_cache-2e7996e6-56fe-44b3-ad02-d17f7ddb358a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:05:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquired lock "refresh_cache-2e7996e6-56fe-44b3-ad02-d17f7ddb358a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:05:48 user nova-compute[73010]: DEBUG nova.network.neutron [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.compute.manager [req-da24f81f-f5f0-4604-8837-e08ff910cb41 req-eab06889-1597-48b7-af0a-24ed86cb0b44 service nova] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Received event network-changed-3a41eecc-5993-483d-b86f-1d174df9d996 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.compute.manager [req-da24f81f-f5f0-4604-8837-e08ff910cb41 req-eab06889-1597-48b7-af0a-24ed86cb0b44 service nova] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Refreshing instance network info cache due to event network-changed-3a41eecc-5993-483d-b86f-1d174df9d996. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-da24f81f-f5f0-4604-8837-e08ff910cb41 req-eab06889-1597-48b7-af0a-24ed86cb0b44 service nova] Acquiring lock "refresh_cache-2e7996e6-56fe-44b3-ad02-d17f7ddb358a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.network.neutron [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.network.neutron [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Updating instance_info_cache with network_info: [{"id": "3a41eecc-5993-483d-b86f-1d174df9d996", "address": "fa:16:3e:e6:d0:b5", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a41eecc-59", "ovs_interfaceid": "3a41eecc-5993-483d-b86f-1d174df9d996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Releasing lock "refresh_cache-2e7996e6-56fe-44b3-ad02-d17f7ddb358a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.compute.manager [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Instance network_info: |[{"id": "3a41eecc-5993-483d-b86f-1d174df9d996", "address": "fa:16:3e:e6:d0:b5", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a41eecc-59", "ovs_interfaceid": "3a41eecc-5993-483d-b86f-1d174df9d996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-da24f81f-f5f0-4604-8837-e08ff910cb41 req-eab06889-1597-48b7-af0a-24ed86cb0b44 service nova] Acquired lock "refresh_cache-2e7996e6-56fe-44b3-ad02-d17f7ddb358a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.network.neutron [req-da24f81f-f5f0-4604-8837-e08ff910cb41 req-eab06889-1597-48b7-af0a-24ed86cb0b44 service nova] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Refreshing network info cache for port 3a41eecc-5993-483d-b86f-1d174df9d996 {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Start _get_guest_xml network_info=[{"id": "3a41eecc-5993-483d-b86f-1d174df9d996", "address": "fa:16:3e:e6:d0:b5", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a41eecc-59", "ovs_interfaceid": "3a41eecc-5993-483d-b86f-1d174df9d996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 01:05:49 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:05:49 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:05:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1328334309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1328334309',id=49,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6db1cb9145b49999d0f102f8cfb867a',ramdisk_id='',reservation_id='r-qi571mkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T01:05:47Z,user_data=None,user_id='8e1e98c9bae145f0909011bb46c6e104',uuid=2e7996e6-56fe-44b3-ad02-d17f7ddb358a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a41eecc-5993-483d-b86f-1d174df9d996", "address": "fa:16:3e:e6:d0:b5", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a41eecc-59", "ovs_interfaceid": "3a41eecc-5993-483d-b86f-1d174df9d996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converting VIF {"id": "3a41eecc-5993-483d-b86f-1d174df9d996", "address": "fa:16:3e:e6:d0:b5", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a41eecc-59", "ovs_interfaceid": "3a41eecc-5993-483d-b86f-1d174df9d996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:d0:b5,bridge_name='br-int',has_traffic_filtering=True,id=3a41eecc-5993-483d-b86f-1d174df9d996,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a41eecc-59') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.objects.instance [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e7996e6-56fe-44b3-ad02-d17f7ddb358a {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 01:05:49 user nova-compute[73010]:   <uuid>2e7996e6-56fe-44b3-ad02-d17f7ddb358a</uuid>
Aug 15 01:05:49 user nova-compute[73010]:   <name>instance-00000031</name>
Aug 15 01:05:49 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 01:05:49 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 01:05:49 user nova-compute[73010]:   <metadata>
Aug 15 01:05:49 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 01:05:49 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 01:05:49 user nova-compute[73010]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1328334309</nova:name>
Aug 15 01:05:49 user nova-compute[73010]:       <nova:creationTime>2023-08-15 01:05:49</nova:creationTime>
Aug 15 01:05:49 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 01:05:49 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 01:05:49 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 01:05:49 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 01:05:49 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 01:05:49 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 01:05:49 user nova-compute[73010]:       </nova:flavor>
Aug 15 01:05:49 user nova-compute[73010]:       <nova:owner>
Aug 15 01:05:49 user nova-compute[73010]:         <nova:user uuid="8e1e98c9bae145f0909011bb46c6e104">tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member</nova:user>
Aug 15 01:05:49 user nova-compute[73010]:         <nova:project uuid="f6db1cb9145b49999d0f102f8cfb867a">tempest-ServerBootFromVolumeStableRescueTest-1758225981</nova:project>
Aug 15 01:05:49 user nova-compute[73010]:       </nova:owner>
Aug 15 01:05:49 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 01:05:49 user nova-compute[73010]:       <nova:ports>
Aug 15 01:05:49 user nova-compute[73010]:         <nova:port uuid="3a41eecc-5993-483d-b86f-1d174df9d996">
Aug 15 01:05:49 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 01:05:49 user nova-compute[73010]:         </nova:port>
Aug 15 01:05:49 user nova-compute[73010]:       </nova:ports>
Aug 15 01:05:49 user nova-compute[73010]:     </nova:instance>
Aug 15 01:05:49 user nova-compute[73010]:   </metadata>
Aug 15 01:05:49 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 01:05:49 user nova-compute[73010]:     <system>
Aug 15 01:05:49 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 01:05:49 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 01:05:49 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 01:05:49 user nova-compute[73010]:       <entry name="serial">2e7996e6-56fe-44b3-ad02-d17f7ddb358a</entry>
Aug 15 01:05:49 user nova-compute[73010]:       <entry name="uuid">2e7996e6-56fe-44b3-ad02-d17f7ddb358a</entry>
Aug 15 01:05:49 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 01:05:49 user nova-compute[73010]:     </system>
Aug 15 01:05:49 user nova-compute[73010]:   </sysinfo>
Aug 15 01:05:49 user nova-compute[73010]:   <os>
Aug 15 01:05:49 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 01:05:49 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 01:05:49 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 01:05:49 user nova-compute[73010]:   </os>
Aug 15 01:05:49 user nova-compute[73010]:   <features>
Aug 15 01:05:49 user nova-compute[73010]:     <acpi/>
Aug 15 01:05:49 user nova-compute[73010]:     <apic/>
Aug 15 01:05:49 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 01:05:49 user nova-compute[73010]:   </features>
Aug 15 01:05:49 user nova-compute[73010]:   <clock offset="utc">
Aug 15 01:05:49 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 01:05:49 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 01:05:49 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 01:05:49 user nova-compute[73010]:   </clock>
Aug 15 01:05:49 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 01:05:49 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 01:05:49 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 01:05:49 user nova-compute[73010]:   </cpu>
Aug 15 01:05:49 user nova-compute[73010]:   <devices>
Aug 15 01:05:49 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 01:05:49 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 01:05:49 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk"/>
Aug 15 01:05:49 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 01:05:49 user nova-compute[73010]:     </disk>
Aug 15 01:05:49 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 01:05:49 user nova-compute[73010]:       <mac address="fa:16:3e:e6:d0:b5"/>
Aug 15 01:05:49 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:05:49 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 01:05:49 user nova-compute[73010]:       <target dev="tap3a41eecc-59"/>
Aug 15 01:05:49 user nova-compute[73010]:     </interface>
Aug 15 01:05:49 user nova-compute[73010]:     <serial type="pty">
Aug 15 01:05:49 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/console.log" append="off"/>
Aug 15 01:05:49 user nova-compute[73010]:     </serial>
Aug 15 01:05:49 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 01:05:49 user nova-compute[73010]:     <video>
Aug 15 01:05:49 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:05:49 user nova-compute[73010]:     </video>
Aug 15 01:05:49 user nova-compute[73010]:     <rng model="virtio">
Aug 15 01:05:49 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 01:05:49 user nova-compute[73010]:     </rng>
Aug 15 01:05:49 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 01:05:49 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 01:05:49 user nova-compute[73010]:       <stats period="10"/>
Aug 15 01:05:49 user nova-compute[73010]:     </memballoon>
Aug 15 01:05:49 user nova-compute[73010]:   </devices>
Aug 15 01:05:49 user nova-compute[73010]: </domain>
Aug 15 01:05:49 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:05:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1328334309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1328334309',id=49,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6db1cb9145b49999d0f102f8cfb867a',ramdisk_id='',reservation_id='r-qi571mkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T01:05:47Z,user_data=None,user_id='8e1e98c9bae145f0909011bb46c6e104',uuid=2e7996e6-56fe-44b3-ad02-d17f7ddb358a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a41eecc-5993-483d-b86f-1d174df9d996", "address": "fa:16:3e:e6:d0:b5", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a41eecc-59", "ovs_interfaceid": "3a41eecc-5993-483d-b86f-1d174df9d996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converting VIF {"id": "3a41eecc-5993-483d-b86f-1d174df9d996", "address": "fa:16:3e:e6:d0:b5", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a41eecc-59", "ovs_interfaceid": "3a41eecc-5993-483d-b86f-1d174df9d996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:d0:b5,bridge_name='br-int',has_traffic_filtering=True,id=3a41eecc-5993-483d-b86f-1d174df9d996,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a41eecc-59') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG os_vif [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:d0:b5,bridge_name='br-int',has_traffic_filtering=True,id=3a41eecc-5993-483d-b86f-1d174df9d996,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a41eecc-59') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a41eecc-59, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a41eecc-59, col_values=(('external_ids', {'iface-id': '3a41eecc-5993-483d-b86f-1d174df9d996', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:d0:b5', 'vm-uuid': '2e7996e6-56fe-44b3-ad02-d17f7ddb358a'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:49 user nova-compute[73010]: INFO os_vif [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:d0:b5,bridge_name='br-int',has_traffic_filtering=True,id=3a41eecc-5993-483d-b86f-1d174df9d996,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a41eecc-59')
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] No VIF found with MAC fa:16:3e:e6:d0:b5, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.network.neutron [req-da24f81f-f5f0-4604-8837-e08ff910cb41 req-eab06889-1597-48b7-af0a-24ed86cb0b44 service nova] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Updated VIF entry in instance network info cache for port 3a41eecc-5993-483d-b86f-1d174df9d996. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG nova.network.neutron [req-da24f81f-f5f0-4604-8837-e08ff910cb41 req-eab06889-1597-48b7-af0a-24ed86cb0b44 service nova] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Updating instance_info_cache with network_info: [{"id": "3a41eecc-5993-483d-b86f-1d174df9d996", "address": "fa:16:3e:e6:d0:b5", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a41eecc-59", "ovs_interfaceid": "3a41eecc-5993-483d-b86f-1d174df9d996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:05:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-da24f81f-f5f0-4604-8837-e08ff910cb41 req-eab06889-1597-48b7-af0a-24ed86cb0b44 service nova] Releasing lock "refresh_cache-2e7996e6-56fe-44b3-ad02-d17f7ddb358a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:05:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:51 user nova-compute[73010]: DEBUG nova.compute.manager [req-d6bf1f5b-e75c-4e3b-8331-35a79292f852 req-6d8657c8-8d52-4522-8899-e136c5ab9440 service nova] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Received event network-vif-plugged-3a41eecc-5993-483d-b86f-1d174df9d996 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:05:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d6bf1f5b-e75c-4e3b-8331-35a79292f852 req-6d8657c8-8d52-4522-8899-e136c5ab9440 service nova] Acquiring lock "2e7996e6-56fe-44b3-ad02-d17f7ddb358a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:05:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d6bf1f5b-e75c-4e3b-8331-35a79292f852 req-6d8657c8-8d52-4522-8899-e136c5ab9440 service nova] Lock "2e7996e6-56fe-44b3-ad02-d17f7ddb358a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:05:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d6bf1f5b-e75c-4e3b-8331-35a79292f852 req-6d8657c8-8d52-4522-8899-e136c5ab9440 service nova] Lock "2e7996e6-56fe-44b3-ad02-d17f7ddb358a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:05:51 user nova-compute[73010]: DEBUG nova.compute.manager [req-d6bf1f5b-e75c-4e3b-8331-35a79292f852 req-6d8657c8-8d52-4522-8899-e136c5ab9440 service nova] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] No waiting events found dispatching network-vif-plugged-3a41eecc-5993-483d-b86f-1d174df9d996 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:05:51 user nova-compute[73010]: WARNING nova.compute.manager [req-d6bf1f5b-e75c-4e3b-8331-35a79292f852 req-6d8657c8-8d52-4522-8899-e136c5ab9440 service nova] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Received unexpected event network-vif-plugged-3a41eecc-5993-483d-b86f-1d174df9d996 for instance with vm_state building and task_state spawning.
Aug 15 01:05:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "a54593fa-a252-4a33-8150-5269c8ce56bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:05:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:05:51 user nova-compute[73010]: DEBUG nova.compute.manager [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 01:05:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:05:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:05:51 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 01:05:51 user nova-compute[73010]: INFO nova.compute.claims [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Claim successful on node user
Aug 15 01:05:52 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:05:52 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:05:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.245s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:05:52 user nova-compute[73010]: DEBUG nova.compute.manager [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 01:05:52 user nova-compute[73010]: DEBUG nova.compute.manager [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 01:05:52 user nova-compute[73010]: DEBUG nova.network.neutron [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 01:05:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:52 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 01:05:52 user nova-compute[73010]: DEBUG nova.compute.manager [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 01:05:52 user nova-compute[73010]: DEBUG nova.policy [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c5655da76eb4671b4db00e086232f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586bed330893488081bb21738b1a6ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 01:05:52 user nova-compute[73010]: DEBUG nova.compute.manager [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 01:05:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 01:05:52 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Creating image(s)
Aug 15 01:05:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "/opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:05:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "/opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:05:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "/opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:05:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:05:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.189s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:05:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:05:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:05:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:05:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.224s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:05:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:05:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk 1073741824" returned: 0 in 0.061s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:05:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:05:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.network.neutron [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Successfully created port: 58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.249s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.compute.manager [req-710fe5e8-ca81-47a4-b795-31f4c769c6e1 req-c0bd2357-eb65-4496-a7a8-a712ae6a1455 service nova] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Received event network-vif-plugged-3a41eecc-5993-483d-b86f-1d174df9d996 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-710fe5e8-ca81-47a4-b795-31f4c769c6e1 req-c0bd2357-eb65-4496-a7a8-a712ae6a1455 service nova] Acquiring lock "2e7996e6-56fe-44b3-ad02-d17f7ddb358a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-710fe5e8-ca81-47a4-b795-31f4c769c6e1 req-c0bd2357-eb65-4496-a7a8-a712ae6a1455 service nova] Lock "2e7996e6-56fe-44b3-ad02-d17f7ddb358a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-710fe5e8-ca81-47a4-b795-31f4c769c6e1 req-c0bd2357-eb65-4496-a7a8-a712ae6a1455 service nova] Lock "2e7996e6-56fe-44b3-ad02-d17f7ddb358a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.compute.manager [req-710fe5e8-ca81-47a4-b795-31f4c769c6e1 req-c0bd2357-eb65-4496-a7a8-a712ae6a1455 service nova] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] No waiting events found dispatching network-vif-plugged-3a41eecc-5993-483d-b86f-1d174df9d996 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:05:53 user nova-compute[73010]: WARNING nova.compute.manager [req-710fe5e8-ca81-47a4-b795-31f4c769c6e1 req-c0bd2357-eb65-4496-a7a8-a712ae6a1455 service nova] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Received unexpected event network-vif-plugged-3a41eecc-5993-483d-b86f-1d174df9d996 for instance with vm_state building and task_state spawning.
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061553.2918723, 2e7996e6-56fe-44b3-ad02-d17f7ddb358a => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:05:53 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] VM Resumed (Lifecycle Event)
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.compute.manager [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 01:05:53 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Instance spawned successfully.
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Cannot resize image /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.objects.instance [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lazy-loading 'migration_context' on Instance uuid a54593fa-a252-4a33-8150-5269c8ce56bf {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Ensure instance console log exists: /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:05:53 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061553.2924402, 2e7996e6-56fe-44b3-ad02-d17f7ddb358a => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:05:53 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] VM Started (Lifecycle Event)
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:05:53 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 01:05:53 user nova-compute[73010]: INFO nova.compute.manager [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Took 6.11 seconds to spawn the instance on the hypervisor.
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.compute.manager [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:05:53 user nova-compute[73010]: INFO nova.compute.manager [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Took 6.67 seconds to build instance.
Aug 15 01:05:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-00dc631c-f6fb-4a09-98bb-4ab906e14ea6 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "2e7996e6-56fe-44b3-ad02-d17f7ddb358a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.761s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.network.neutron [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Successfully updated port: 58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "refresh_cache-a54593fa-a252-4a33-8150-5269c8ce56bf" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquired lock "refresh_cache-a54593fa-a252-4a33-8150-5269c8ce56bf" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.network.neutron [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 01:05:53 user nova-compute[73010]: DEBUG nova.network.neutron [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.network.neutron [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Updating instance_info_cache with network_info: [{"id": "58ac448b-c375-4ef0-bae4-436351b80aec", "address": "fa:16:3e:e7:72:f7", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ac448b-c3", "ovs_interfaceid": "58ac448b-c375-4ef0-bae4-436351b80aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Releasing lock "refresh_cache-a54593fa-a252-4a33-8150-5269c8ce56bf" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.compute.manager [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Instance network_info: |[{"id": "58ac448b-c375-4ef0-bae4-436351b80aec", "address": "fa:16:3e:e7:72:f7", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ac448b-c3", "ovs_interfaceid": "58ac448b-c375-4ef0-bae4-436351b80aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Start _get_guest_xml network_info=[{"id": "58ac448b-c375-4ef0-bae4-436351b80aec", "address": "fa:16:3e:e7:72:f7", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ac448b-c3", "ovs_interfaceid": "58ac448b-c375-4ef0-bae4-436351b80aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 01:05:54 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:05:54 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:05:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1051974814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1051974814',id=50,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYTLD0SROw2+kgQJPV0u9yb76/GoiUChdaEG+JkzAoIxFCE9jTOZvMZYfdiHfNjmnIRhStAHLSNX/f/KwsFnraWOZee3aNoqh8RakueGTo5I/6c+Q3lrU800h7AOthtdg==',key_name='tempest-keypair-485982673',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='586bed330893488081bb21738b1a6ec4',ramdisk_id='',reservation_id='r-vnnzzp3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-563974852',owner_user_name='tempest-AttachVolumeShelveTestJSON-563974852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T01:05:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c5655da76eb4671b4db00e086232f05',uuid=a54593fa-a252-4a33-8150-5269c8ce56bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58ac448b-c375-4ef0-bae4-436351b80aec", "address": "fa:16:3e:e7:72:f7", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ac448b-c3", "ovs_interfaceid": "58ac448b-c375-4ef0-bae4-436351b80aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Converting VIF {"id": "58ac448b-c375-4ef0-bae4-436351b80aec", "address": "fa:16:3e:e7:72:f7", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ac448b-c3", "ovs_interfaceid": "58ac448b-c375-4ef0-bae4-436351b80aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:72:f7,bridge_name='br-int',has_traffic_filtering=True,id=58ac448b-c375-4ef0-bae4-436351b80aec,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ac448b-c3') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.objects.instance [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lazy-loading 'pci_devices' on Instance uuid a54593fa-a252-4a33-8150-5269c8ce56bf {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] End _get_guest_xml xml=<domain type="kvm">
Aug 15 01:05:54 user nova-compute[73010]:   <uuid>a54593fa-a252-4a33-8150-5269c8ce56bf</uuid>
Aug 15 01:05:54 user nova-compute[73010]:   <name>instance-00000032</name>
Aug 15 01:05:54 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 01:05:54 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 01:05:54 user nova-compute[73010]:   <metadata>
Aug 15 01:05:54 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 01:05:54 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 01:05:54 user nova-compute[73010]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1051974814</nova:name>
Aug 15 01:05:54 user nova-compute[73010]:       <nova:creationTime>2023-08-15 01:05:54</nova:creationTime>
Aug 15 01:05:54 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 01:05:54 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 01:05:54 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 01:05:54 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 01:05:54 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 01:05:54 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 01:05:54 user nova-compute[73010]:       </nova:flavor>
Aug 15 01:05:54 user nova-compute[73010]:       <nova:owner>
Aug 15 01:05:54 user nova-compute[73010]:         <nova:user uuid="0c5655da76eb4671b4db00e086232f05">tempest-AttachVolumeShelveTestJSON-563974852-project-member</nova:user>
Aug 15 01:05:54 user nova-compute[73010]:         <nova:project uuid="586bed330893488081bb21738b1a6ec4">tempest-AttachVolumeShelveTestJSON-563974852</nova:project>
Aug 15 01:05:54 user nova-compute[73010]:       </nova:owner>
Aug 15 01:05:54 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 01:05:54 user nova-compute[73010]:       <nova:ports>
Aug 15 01:05:54 user nova-compute[73010]:         <nova:port uuid="58ac448b-c375-4ef0-bae4-436351b80aec">
Aug 15 01:05:54 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 01:05:54 user nova-compute[73010]:         </nova:port>
Aug 15 01:05:54 user nova-compute[73010]:       </nova:ports>
Aug 15 01:05:54 user nova-compute[73010]:     </nova:instance>
Aug 15 01:05:54 user nova-compute[73010]:   </metadata>
Aug 15 01:05:54 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 01:05:54 user nova-compute[73010]:     <system>
Aug 15 01:05:54 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 01:05:54 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 01:05:54 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 01:05:54 user nova-compute[73010]:       <entry name="serial">a54593fa-a252-4a33-8150-5269c8ce56bf</entry>
Aug 15 01:05:54 user nova-compute[73010]:       <entry name="uuid">a54593fa-a252-4a33-8150-5269c8ce56bf</entry>
Aug 15 01:05:54 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 01:05:54 user nova-compute[73010]:     </system>
Aug 15 01:05:54 user nova-compute[73010]:   </sysinfo>
Aug 15 01:05:54 user nova-compute[73010]:   <os>
Aug 15 01:05:54 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 01:05:54 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 01:05:54 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 01:05:54 user nova-compute[73010]:   </os>
Aug 15 01:05:54 user nova-compute[73010]:   <features>
Aug 15 01:05:54 user nova-compute[73010]:     <acpi/>
Aug 15 01:05:54 user nova-compute[73010]:     <apic/>
Aug 15 01:05:54 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 01:05:54 user nova-compute[73010]:   </features>
Aug 15 01:05:54 user nova-compute[73010]:   <clock offset="utc">
Aug 15 01:05:54 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 01:05:54 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 01:05:54 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 01:05:54 user nova-compute[73010]:   </clock>
Aug 15 01:05:54 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 01:05:54 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 01:05:54 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 01:05:54 user nova-compute[73010]:   </cpu>
Aug 15 01:05:54 user nova-compute[73010]:   <devices>
Aug 15 01:05:54 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 01:05:54 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 01:05:54 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk"/>
Aug 15 01:05:54 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 01:05:54 user nova-compute[73010]:     </disk>
Aug 15 01:05:54 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 01:05:54 user nova-compute[73010]:       <mac address="fa:16:3e:e7:72:f7"/>
Aug 15 01:05:54 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:05:54 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 01:05:54 user nova-compute[73010]:       <target dev="tap58ac448b-c3"/>
Aug 15 01:05:54 user nova-compute[73010]:     </interface>
Aug 15 01:05:54 user nova-compute[73010]:     <serial type="pty">
Aug 15 01:05:54 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/console.log" append="off"/>
Aug 15 01:05:54 user nova-compute[73010]:     </serial>
Aug 15 01:05:54 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 01:05:54 user nova-compute[73010]:     <video>
Aug 15 01:05:54 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:05:54 user nova-compute[73010]:     </video>
Aug 15 01:05:54 user nova-compute[73010]:     <rng model="virtio">
Aug 15 01:05:54 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 01:05:54 user nova-compute[73010]:     </rng>
Aug 15 01:05:54 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 01:05:54 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 01:05:54 user nova-compute[73010]:       <stats period="10"/>
Aug 15 01:05:54 user nova-compute[73010]:     </memballoon>
Aug 15 01:05:54 user nova-compute[73010]:   </devices>
Aug 15 01:05:54 user nova-compute[73010]: </domain>
Aug 15 01:05:54 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:05:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1051974814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1051974814',id=50,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYTLD0SROw2+kgQJPV0u9yb76/GoiUChdaEG+JkzAoIxFCE9jTOZvMZYfdiHfNjmnIRhStAHLSNX/f/KwsFnraWOZee3aNoqh8RakueGTo5I/6c+Q3lrU800h7AOthtdg==',key_name='tempest-keypair-485982673',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='586bed330893488081bb21738b1a6ec4',ramdisk_id='',reservation_id='r-vnnzzp3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-563974852',owner_user_name='tempest-AttachVolumeShelveTestJSON-563974852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T01:05:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c5655da76eb4671b4db00e086232f05',uuid=a54593fa-a252-4a33-8150-5269c8ce56bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58ac448b-c375-4ef0-bae4-436351b80aec", "address": "fa:16:3e:e7:72:f7", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ac448b-c3", "ovs_interfaceid": "58ac448b-c375-4ef0-bae4-436351b80aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Converting VIF {"id": "58ac448b-c375-4ef0-bae4-436351b80aec", "address": "fa:16:3e:e7:72:f7", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ac448b-c3", "ovs_interfaceid": "58ac448b-c375-4ef0-bae4-436351b80aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:72:f7,bridge_name='br-int',has_traffic_filtering=True,id=58ac448b-c375-4ef0-bae4-436351b80aec,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ac448b-c3') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG os_vif [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:72:f7,bridge_name='br-int',has_traffic_filtering=True,id=58ac448b-c375-4ef0-bae4-436351b80aec,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ac448b-c3') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58ac448b-c3, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap58ac448b-c3, col_values=(('external_ids', {'iface-id': '58ac448b-c375-4ef0-bae4-436351b80aec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:72:f7', 'vm-uuid': 'a54593fa-a252-4a33-8150-5269c8ce56bf'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:54 user nova-compute[73010]: INFO os_vif [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:72:f7,bridge_name='br-int',has_traffic_filtering=True,id=58ac448b-c375-4ef0-bae4-436351b80aec,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ac448b-c3')
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:05:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] No VIF found with MAC fa:16:3e:e7:72:f7, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 01:05:55 user nova-compute[73010]: DEBUG nova.compute.manager [req-0ed6c285-5206-488a-9513-9c6bff4eb739 req-3a8578dd-8f40-460d-bf23-0faf1e302737 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Received event network-changed-58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:05:55 user nova-compute[73010]: DEBUG nova.compute.manager [req-0ed6c285-5206-488a-9513-9c6bff4eb739 req-3a8578dd-8f40-460d-bf23-0faf1e302737 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Refreshing instance network info cache due to event network-changed-58ac448b-c375-4ef0-bae4-436351b80aec. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 01:05:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0ed6c285-5206-488a-9513-9c6bff4eb739 req-3a8578dd-8f40-460d-bf23-0faf1e302737 service nova] Acquiring lock "refresh_cache-a54593fa-a252-4a33-8150-5269c8ce56bf" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:05:55 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0ed6c285-5206-488a-9513-9c6bff4eb739 req-3a8578dd-8f40-460d-bf23-0faf1e302737 service nova] Acquired lock "refresh_cache-a54593fa-a252-4a33-8150-5269c8ce56bf" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:05:55 user nova-compute[73010]: DEBUG nova.network.neutron [req-0ed6c285-5206-488a-9513-9c6bff4eb739 req-3a8578dd-8f40-460d-bf23-0faf1e302737 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Refreshing network info cache for port 58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 01:05:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:56 user nova-compute[73010]: DEBUG nova.network.neutron [req-0ed6c285-5206-488a-9513-9c6bff4eb739 req-3a8578dd-8f40-460d-bf23-0faf1e302737 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Updated VIF entry in instance network info cache for port 58ac448b-c375-4ef0-bae4-436351b80aec. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 01:05:56 user nova-compute[73010]: DEBUG nova.network.neutron [req-0ed6c285-5206-488a-9513-9c6bff4eb739 req-3a8578dd-8f40-460d-bf23-0faf1e302737 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Updating instance_info_cache with network_info: [{"id": "58ac448b-c375-4ef0-bae4-436351b80aec", "address": "fa:16:3e:e7:72:f7", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ac448b-c3", "ovs_interfaceid": "58ac448b-c375-4ef0-bae4-436351b80aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:05:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-0ed6c285-5206-488a-9513-9c6bff4eb739 req-3a8578dd-8f40-460d-bf23-0faf1e302737 service nova] Releasing lock "refresh_cache-a54593fa-a252-4a33-8150-5269c8ce56bf" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:05:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:57 user nova-compute[73010]: DEBUG nova.compute.manager [req-1cbd6376-d53e-4f33-8d8e-f9440c1fa2d8 req-7380ee3d-fca7-47ac-a014-4ab115115541 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Received event network-vif-plugged-58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:05:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1cbd6376-d53e-4f33-8d8e-f9440c1fa2d8 req-7380ee3d-fca7-47ac-a014-4ab115115541 service nova] Acquiring lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:05:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1cbd6376-d53e-4f33-8d8e-f9440c1fa2d8 req-7380ee3d-fca7-47ac-a014-4ab115115541 service nova] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:05:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1cbd6376-d53e-4f33-8d8e-f9440c1fa2d8 req-7380ee3d-fca7-47ac-a014-4ab115115541 service nova] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:05:57 user nova-compute[73010]: DEBUG nova.compute.manager [req-1cbd6376-d53e-4f33-8d8e-f9440c1fa2d8 req-7380ee3d-fca7-47ac-a014-4ab115115541 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] No waiting events found dispatching network-vif-plugged-58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:05:57 user nova-compute[73010]: WARNING nova.compute.manager [req-1cbd6376-d53e-4f33-8d8e-f9440c1fa2d8 req-7380ee3d-fca7-47ac-a014-4ab115115541 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Received unexpected event network-vif-plugged-58ac448b-c375-4ef0-bae4-436351b80aec for instance with vm_state building and task_state spawning.
Aug 15 01:05:57 user nova-compute[73010]: DEBUG nova.compute.manager [req-1cbd6376-d53e-4f33-8d8e-f9440c1fa2d8 req-7380ee3d-fca7-47ac-a014-4ab115115541 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Received event network-vif-plugged-58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:05:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1cbd6376-d53e-4f33-8d8e-f9440c1fa2d8 req-7380ee3d-fca7-47ac-a014-4ab115115541 service nova] Acquiring lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:05:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1cbd6376-d53e-4f33-8d8e-f9440c1fa2d8 req-7380ee3d-fca7-47ac-a014-4ab115115541 service nova] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:05:57 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-1cbd6376-d53e-4f33-8d8e-f9440c1fa2d8 req-7380ee3d-fca7-47ac-a014-4ab115115541 service nova] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:05:57 user nova-compute[73010]: DEBUG nova.compute.manager [req-1cbd6376-d53e-4f33-8d8e-f9440c1fa2d8 req-7380ee3d-fca7-47ac-a014-4ab115115541 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] No waiting events found dispatching network-vif-plugged-58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:05:57 user nova-compute[73010]: WARNING nova.compute.manager [req-1cbd6376-d53e-4f33-8d8e-f9440c1fa2d8 req-7380ee3d-fca7-47ac-a014-4ab115115541 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Received unexpected event network-vif-plugged-58ac448b-c375-4ef0-bae4-436351b80aec for instance with vm_state building and task_state spawning.
Aug 15 01:05:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 01:05:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 01:05:58 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061558.3742929, a54593fa-a252-4a33-8150-5269c8ce56bf => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:05:58 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] VM Resumed (Lifecycle Event)
Aug 15 01:05:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Instance spawned successfully.
Aug 15 01:05:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 01:05:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:05:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:05:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:05:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:05:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:05:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:05:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:05:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:05:58 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 01:05:58 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061558.3746378, a54593fa-a252-4a33-8150-5269c8ce56bf => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:05:58 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] VM Started (Lifecycle Event)
Aug 15 01:05:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:05:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:05:58 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 01:05:58 user nova-compute[73010]: INFO nova.compute.manager [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Took 6.20 seconds to spawn the instance on the hypervisor.
Aug 15 01:05:58 user nova-compute[73010]: DEBUG nova.compute.manager [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:05:58 user nova-compute[73010]: INFO nova.compute.manager [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Took 6.80 seconds to build instance.
Aug 15 01:05:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-898fb9f6-a3ca-4fba-a303-5cd287223de7 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.905s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:05:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:05:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:06:10 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:06:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:06:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:06:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:06:10 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:06:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:06:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:06:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:06:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:06:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:06:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:06:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:06:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:06:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:06:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:06:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:06:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:06:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:06:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:12 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:06:12 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:06:12 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8406MB free_disk=25.343524932861328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:06:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:06:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:06:12 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance d79e3854-769c-430a-b980-3a551c7ee34d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:06:12 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 39a36324-d323-4169-abaa-09028eeb5598 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:06:12 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 2e7996e6-56fe-44b3-ad02-d17f7ddb358a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:06:12 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance a54593fa-a252-4a33-8150-5269c8ce56bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:06:12 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:06:12 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:06:12 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:06:12 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:06:12 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:06:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:06:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:15 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:06:15 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:06:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:18 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:06:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:06:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Didn't find any instances for network info cache update. {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 01:06:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:19 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:06:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:23 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:06:23 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:06:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Acquiring lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:06:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:06:23 user nova-compute[73010]: DEBUG nova.compute.manager [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 01:06:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:06:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:06:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 01:06:23 user nova-compute[73010]: INFO nova.compute.claims [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Claim successful on node user
Aug 15 01:06:23 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:06:23 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:06:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:06:23 user nova-compute[73010]: DEBUG nova.compute.manager [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 01:06:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 01:06:24 user nova-compute[73010]: DEBUG nova.network.neutron [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 01:06:24 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 01:06:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 01:06:24 user nova-compute[73010]: DEBUG nova.policy [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e676d54eb0ab46e1be9c3f89e03c4d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa7253a229a49278b2c1cab2208d69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 01:06:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 01:06:24 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 01:06:24 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Creating image(s)
Aug 15 01:06:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Acquiring lock "/opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:06:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "/opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:06:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "/opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:06:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:06:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:06:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:06:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:06:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:06:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:24 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:06:24 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:06:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.197s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:06:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:06:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/disk 1073741824" returned: 0 in 0.064s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:06:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:06:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:06:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.182s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:06:24 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 01:06:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:06:24 user nova-compute[73010]: DEBUG nova.network.neutron [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Successfully created port: 2cfaaa3f-bf6c-434f-88ac-28be01359fea {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 01:06:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:06:25 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Cannot resize image /opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 01:06:25 user nova-compute[73010]: DEBUG nova.objects.instance [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lazy-loading 'migration_context' on Instance uuid 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:06:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 01:06:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Ensure instance console log exists: /opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 01:06:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:06:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:06:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:06:25 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:06:25 user nova-compute[73010]: DEBUG nova.network.neutron [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Successfully updated port: 2cfaaa3f-bf6c-434f-88ac-28be01359fea {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 01:06:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Acquiring lock "refresh_cache-45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:06:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Acquired lock "refresh_cache-45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:06:25 user nova-compute[73010]: DEBUG nova.network.neutron [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 01:06:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-e2b0945d-7649-4ebb-990b-266a1b460b00 req-56526a95-b9a2-4b9b-9a0d-920d9dde4129 service nova] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Received event network-changed-2cfaaa3f-bf6c-434f-88ac-28be01359fea {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:06:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-e2b0945d-7649-4ebb-990b-266a1b460b00 req-56526a95-b9a2-4b9b-9a0d-920d9dde4129 service nova] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Refreshing instance network info cache due to event network-changed-2cfaaa3f-bf6c-434f-88ac-28be01359fea. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 01:06:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e2b0945d-7649-4ebb-990b-266a1b460b00 req-56526a95-b9a2-4b9b-9a0d-920d9dde4129 service nova] Acquiring lock "refresh_cache-45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:06:25 user nova-compute[73010]: DEBUG nova.network.neutron [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.network.neutron [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Updating instance_info_cache with network_info: [{"id": "2cfaaa3f-bf6c-434f-88ac-28be01359fea", "address": "fa:16:3e:0d:ad:e1", "network": {"id": "211a78cc-5fce-4fa9-abfe-70c5966402cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-525994571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fa7253a229a49278b2c1cab2208d69a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfaaa3f-bf", "ovs_interfaceid": "2cfaaa3f-bf6c-434f-88ac-28be01359fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Releasing lock "refresh_cache-45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.compute.manager [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Instance network_info: |[{"id": "2cfaaa3f-bf6c-434f-88ac-28be01359fea", "address": "fa:16:3e:0d:ad:e1", "network": {"id": "211a78cc-5fce-4fa9-abfe-70c5966402cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-525994571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fa7253a229a49278b2c1cab2208d69a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfaaa3f-bf", "ovs_interfaceid": "2cfaaa3f-bf6c-434f-88ac-28be01359fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e2b0945d-7649-4ebb-990b-266a1b460b00 req-56526a95-b9a2-4b9b-9a0d-920d9dde4129 service nova] Acquired lock "refresh_cache-45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.network.neutron [req-e2b0945d-7649-4ebb-990b-266a1b460b00 req-56526a95-b9a2-4b9b-9a0d-920d9dde4129 service nova] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Refreshing network info cache for port 2cfaaa3f-bf6c-434f-88ac-28be01359fea {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Start _get_guest_xml network_info=[{"id": "2cfaaa3f-bf6c-434f-88ac-28be01359fea", "address": "fa:16:3e:0d:ad:e1", "network": {"id": "211a78cc-5fce-4fa9-abfe-70c5966402cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-525994571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fa7253a229a49278b2c1cab2208d69a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfaaa3f-bf", "ovs_interfaceid": "2cfaaa3f-bf6c-434f-88ac-28be01359fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 01:06:26 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:06:26 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:06:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-345604593',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-345604593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3456045',id=51,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlwgpEOawKsZtWr9P3wx35slqEzX+/kN2UGZyXvj9T1gGPairYgJ2h6H55FU42Dw6VnaxONNxPSK9ZCeKtmUGqfVJBwGv3tXgYLSjugDp9kUOLUDE81vzDNc0wV5lGd8A==',key_name='tempest-keypair-753850628',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fa7253a229a49278b2c1cab2208d69a',ramdisk_id='',reservation_id='r-0jtj2x3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1980358928',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T01:06:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e676d54eb0ab46e1be9c3f89e03c4d1a',uuid=45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cfaaa3f-bf6c-434f-88ac-28be01359fea", "address": "fa:16:3e:0d:ad:e1", "network": {"id": "211a78cc-5fce-4fa9-abfe-70c5966402cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-525994571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fa7253a229a49278b2c1cab2208d69a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfaaa3f-bf", "ovs_interfaceid": "2cfaaa3f-bf6c-434f-88ac-28be01359fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Converting VIF {"id": "2cfaaa3f-bf6c-434f-88ac-28be01359fea", "address": "fa:16:3e:0d:ad:e1", "network": {"id": "211a78cc-5fce-4fa9-abfe-70c5966402cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-525994571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fa7253a229a49278b2c1cab2208d69a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfaaa3f-bf", "ovs_interfaceid": "2cfaaa3f-bf6c-434f-88ac-28be01359fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:ad:e1,bridge_name='br-int',has_traffic_filtering=True,id=2cfaaa3f-bf6c-434f-88ac-28be01359fea,network=Network(211a78cc-5fce-4fa9-abfe-70c5966402cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfaaa3f-bf') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.objects.instance [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lazy-loading 'pci_devices' on Instance uuid 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] End _get_guest_xml xml=<domain type="kvm">
Aug 15 01:06:26 user nova-compute[73010]:   <uuid>45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3</uuid>
Aug 15 01:06:26 user nova-compute[73010]:   <name>instance-00000033</name>
Aug 15 01:06:26 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 01:06:26 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 01:06:26 user nova-compute[73010]:   <metadata>
Aug 15 01:06:26 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 01:06:26 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 01:06:26 user nova-compute[73010]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-345604593</nova:name>
Aug 15 01:06:26 user nova-compute[73010]:       <nova:creationTime>2023-08-15 01:06:26</nova:creationTime>
Aug 15 01:06:26 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 01:06:26 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 01:06:26 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 01:06:26 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 01:06:26 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 01:06:26 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 01:06:26 user nova-compute[73010]:       </nova:flavor>
Aug 15 01:06:26 user nova-compute[73010]:       <nova:owner>
Aug 15 01:06:26 user nova-compute[73010]:         <nova:user uuid="e676d54eb0ab46e1be9c3f89e03c4d1a">tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member</nova:user>
Aug 15 01:06:26 user nova-compute[73010]:         <nova:project uuid="3fa7253a229a49278b2c1cab2208d69a">tempest-TestServerVolumeAttachScenarioOldVersion-1980358928</nova:project>
Aug 15 01:06:26 user nova-compute[73010]:       </nova:owner>
Aug 15 01:06:26 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 01:06:26 user nova-compute[73010]:       <nova:ports>
Aug 15 01:06:26 user nova-compute[73010]:         <nova:port uuid="2cfaaa3f-bf6c-434f-88ac-28be01359fea">
Aug 15 01:06:26 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 01:06:26 user nova-compute[73010]:         </nova:port>
Aug 15 01:06:26 user nova-compute[73010]:       </nova:ports>
Aug 15 01:06:26 user nova-compute[73010]:     </nova:instance>
Aug 15 01:06:26 user nova-compute[73010]:   </metadata>
Aug 15 01:06:26 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 01:06:26 user nova-compute[73010]:     <system>
Aug 15 01:06:26 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 01:06:26 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 01:06:26 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 01:06:26 user nova-compute[73010]:       <entry name="serial">45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3</entry>
Aug 15 01:06:26 user nova-compute[73010]:       <entry name="uuid">45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3</entry>
Aug 15 01:06:26 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 01:06:26 user nova-compute[73010]:     </system>
Aug 15 01:06:26 user nova-compute[73010]:   </sysinfo>
Aug 15 01:06:26 user nova-compute[73010]:   <os>
Aug 15 01:06:26 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 01:06:26 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 01:06:26 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 01:06:26 user nova-compute[73010]:   </os>
Aug 15 01:06:26 user nova-compute[73010]:   <features>
Aug 15 01:06:26 user nova-compute[73010]:     <acpi/>
Aug 15 01:06:26 user nova-compute[73010]:     <apic/>
Aug 15 01:06:26 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 01:06:26 user nova-compute[73010]:   </features>
Aug 15 01:06:26 user nova-compute[73010]:   <clock offset="utc">
Aug 15 01:06:26 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 01:06:26 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 01:06:26 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 01:06:26 user nova-compute[73010]:   </clock>
Aug 15 01:06:26 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 01:06:26 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 01:06:26 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 01:06:26 user nova-compute[73010]:   </cpu>
Aug 15 01:06:26 user nova-compute[73010]:   <devices>
Aug 15 01:06:26 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 01:06:26 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 01:06:26 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/disk"/>
Aug 15 01:06:26 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 01:06:26 user nova-compute[73010]:     </disk>
Aug 15 01:06:26 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 01:06:26 user nova-compute[73010]:       <mac address="fa:16:3e:0d:ad:e1"/>
Aug 15 01:06:26 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:06:26 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 01:06:26 user nova-compute[73010]:       <target dev="tap2cfaaa3f-bf"/>
Aug 15 01:06:26 user nova-compute[73010]:     </interface>
Aug 15 01:06:26 user nova-compute[73010]:     <serial type="pty">
Aug 15 01:06:26 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/console.log" append="off"/>
Aug 15 01:06:26 user nova-compute[73010]:     </serial>
Aug 15 01:06:26 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 01:06:26 user nova-compute[73010]:     <video>
Aug 15 01:06:26 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:06:26 user nova-compute[73010]:     </video>
Aug 15 01:06:26 user nova-compute[73010]:     <rng model="virtio">
Aug 15 01:06:26 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 01:06:26 user nova-compute[73010]:     </rng>
Aug 15 01:06:26 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 01:06:26 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 01:06:26 user nova-compute[73010]:       <stats period="10"/>
Aug 15 01:06:26 user nova-compute[73010]:     </memballoon>
Aug 15 01:06:26 user nova-compute[73010]:   </devices>
Aug 15 01:06:26 user nova-compute[73010]: </domain>
Aug 15 01:06:26 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:06:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-345604593',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-345604593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3456045',id=51,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlwgpEOawKsZtWr9P3wx35slqEzX+/kN2UGZyXvj9T1gGPairYgJ2h6H55FU42Dw6VnaxONNxPSK9ZCeKtmUGqfVJBwGv3tXgYLSjugDp9kUOLUDE81vzDNc0wV5lGd8A==',key_name='tempest-keypair-753850628',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fa7253a229a49278b2c1cab2208d69a',ramdisk_id='',reservation_id='r-0jtj2x3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1980358928',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T01:06:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e676d54eb0ab46e1be9c3f89e03c4d1a',uuid=45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cfaaa3f-bf6c-434f-88ac-28be01359fea", "address": "fa:16:3e:0d:ad:e1", "network": {"id": "211a78cc-5fce-4fa9-abfe-70c5966402cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-525994571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fa7253a229a49278b2c1cab2208d69a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfaaa3f-bf", "ovs_interfaceid": "2cfaaa3f-bf6c-434f-88ac-28be01359fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Converting VIF {"id": "2cfaaa3f-bf6c-434f-88ac-28be01359fea", "address": "fa:16:3e:0d:ad:e1", "network": {"id": "211a78cc-5fce-4fa9-abfe-70c5966402cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-525994571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fa7253a229a49278b2c1cab2208d69a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfaaa3f-bf", "ovs_interfaceid": "2cfaaa3f-bf6c-434f-88ac-28be01359fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:ad:e1,bridge_name='br-int',has_traffic_filtering=True,id=2cfaaa3f-bf6c-434f-88ac-28be01359fea,network=Network(211a78cc-5fce-4fa9-abfe-70c5966402cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfaaa3f-bf') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG os_vif [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:ad:e1,bridge_name='br-int',has_traffic_filtering=True,id=2cfaaa3f-bf6c-434f-88ac-28be01359fea,network=Network(211a78cc-5fce-4fa9-abfe-70c5966402cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfaaa3f-bf') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cfaaa3f-bf, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2cfaaa3f-bf, col_values=(('external_ids', {'iface-id': '2cfaaa3f-bf6c-434f-88ac-28be01359fea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:ad:e1', 'vm-uuid': '45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:26 user nova-compute[73010]: INFO os_vif [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:ad:e1,bridge_name='br-int',has_traffic_filtering=True,id=2cfaaa3f-bf6c-434f-88ac-28be01359fea,network=Network(211a78cc-5fce-4fa9-abfe-70c5966402cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfaaa3f-bf')
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] No VIF found with MAC fa:16:3e:0d:ad:e1, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.network.neutron [req-e2b0945d-7649-4ebb-990b-266a1b460b00 req-56526a95-b9a2-4b9b-9a0d-920d9dde4129 service nova] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Updated VIF entry in instance network info cache for port 2cfaaa3f-bf6c-434f-88ac-28be01359fea. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG nova.network.neutron [req-e2b0945d-7649-4ebb-990b-266a1b460b00 req-56526a95-b9a2-4b9b-9a0d-920d9dde4129 service nova] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Updating instance_info_cache with network_info: [{"id": "2cfaaa3f-bf6c-434f-88ac-28be01359fea", "address": "fa:16:3e:0d:ad:e1", "network": {"id": "211a78cc-5fce-4fa9-abfe-70c5966402cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-525994571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fa7253a229a49278b2c1cab2208d69a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfaaa3f-bf", "ovs_interfaceid": "2cfaaa3f-bf6c-434f-88ac-28be01359fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:06:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e2b0945d-7649-4ebb-990b-266a1b460b00 req-56526a95-b9a2-4b9b-9a0d-920d9dde4129 service nova] Releasing lock "refresh_cache-45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:06:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:27 user nova-compute[73010]: DEBUG nova.compute.manager [req-7f7559eb-ff97-4edd-9a89-64d490b71904 req-73aff20d-01a6-468b-91b9-1b1e71758f92 service nova] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Received event network-vif-plugged-2cfaaa3f-bf6c-434f-88ac-28be01359fea {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:06:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7f7559eb-ff97-4edd-9a89-64d490b71904 req-73aff20d-01a6-468b-91b9-1b1e71758f92 service nova] Acquiring lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:06:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7f7559eb-ff97-4edd-9a89-64d490b71904 req-73aff20d-01a6-468b-91b9-1b1e71758f92 service nova] Lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:06:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7f7559eb-ff97-4edd-9a89-64d490b71904 req-73aff20d-01a6-468b-91b9-1b1e71758f92 service nova] Lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:06:27 user nova-compute[73010]: DEBUG nova.compute.manager [req-7f7559eb-ff97-4edd-9a89-64d490b71904 req-73aff20d-01a6-468b-91b9-1b1e71758f92 service nova] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] No waiting events found dispatching network-vif-plugged-2cfaaa3f-bf6c-434f-88ac-28be01359fea {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:06:27 user nova-compute[73010]: WARNING nova.compute.manager [req-7f7559eb-ff97-4edd-9a89-64d490b71904 req-73aff20d-01a6-468b-91b9-1b1e71758f92 service nova] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Received unexpected event network-vif-plugged-2cfaaa3f-bf6c-434f-88ac-28be01359fea for instance with vm_state building and task_state spawning.
Aug 15 01:06:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:29 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061589.6208353, 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:06:29 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] VM Resumed (Lifecycle Event)
Aug 15 01:06:29 user nova-compute[73010]: DEBUG nova.compute.manager [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 01:06:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 01:06:29 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Instance spawned successfully.
Aug 15 01:06:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 01:06:29 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:06:29 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:06:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:06:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:06:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:06:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:06:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:06:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:06:29 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 01:06:29 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061589.6246183, 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:06:29 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] VM Started (Lifecycle Event)
Aug 15 01:06:29 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:06:29 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:06:29 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 01:06:29 user nova-compute[73010]: INFO nova.compute.manager [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Took 5.53 seconds to spawn the instance on the hypervisor.
Aug 15 01:06:29 user nova-compute[73010]: DEBUG nova.compute.manager [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:06:29 user nova-compute[73010]: INFO nova.compute.manager [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Took 6.11 seconds to build instance.
Aug 15 01:06:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-90562e5f-86c6-4d1b-bf89-981b162f2a16 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.208s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:06:29 user nova-compute[73010]: DEBUG nova.compute.manager [req-dbd1bb20-bae3-4eb1-897e-9d956c40a4a1 req-d1ebe1c6-540c-4206-9e7e-0ef2f04423f8 service nova] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Received event network-vif-plugged-2cfaaa3f-bf6c-434f-88ac-28be01359fea {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:06:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dbd1bb20-bae3-4eb1-897e-9d956c40a4a1 req-d1ebe1c6-540c-4206-9e7e-0ef2f04423f8 service nova] Acquiring lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:06:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dbd1bb20-bae3-4eb1-897e-9d956c40a4a1 req-d1ebe1c6-540c-4206-9e7e-0ef2f04423f8 service nova] Lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:06:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-dbd1bb20-bae3-4eb1-897e-9d956c40a4a1 req-d1ebe1c6-540c-4206-9e7e-0ef2f04423f8 service nova] Lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:06:29 user nova-compute[73010]: DEBUG nova.compute.manager [req-dbd1bb20-bae3-4eb1-897e-9d956c40a4a1 req-d1ebe1c6-540c-4206-9e7e-0ef2f04423f8 service nova] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] No waiting events found dispatching network-vif-plugged-2cfaaa3f-bf6c-434f-88ac-28be01359fea {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:06:29 user nova-compute[73010]: WARNING nova.compute.manager [req-dbd1bb20-bae3-4eb1-897e-9d956c40a4a1 req-d1ebe1c6-540c-4206-9e7e-0ef2f04423f8 service nova] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Received unexpected event network-vif-plugged-2cfaaa3f-bf6c-434f-88ac-28be01359fea for instance with vm_state active and task_state None.
Aug 15 01:06:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:36 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:06:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:06:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:07:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:07:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:07:10 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:07:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:07:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:07:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:07:10 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:07:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:07:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:07:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:07:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:07:10 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:07:10 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:07:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:07:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:07:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:07:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:07:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:07:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:07:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:07:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:07:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:07:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:07:11 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:07:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:07:12 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:07:12 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:07:12 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8398MB free_disk=25.283641815185547GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:07:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:07:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:07:12 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance d79e3854-769c-430a-b980-3a551c7ee34d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:07:12 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 39a36324-d323-4169-abaa-09028eeb5598 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:07:12 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 2e7996e6-56fe-44b3-ad02-d17f7ddb358a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:07:12 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance a54593fa-a252-4a33-8150-5269c8ce56bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:07:12 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:07:12 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:07:12 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:07:12 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:07:12 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:07:12 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:07:12 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.351s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:07:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:07:16 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:07:16 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:07:18 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:07:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:07:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 01:07:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-d79e3854-769c-430a-b980-3a551c7ee34d" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:07:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-d79e3854-769c-430a-b980-3a551c7ee34d" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:07:18 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 01:07:18 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lazy-loading 'info_cache' on Instance uuid d79e3854-769c-430a-b980-3a551c7ee34d {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:07:19 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Updating instance_info_cache with network_info: [{"id": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "address": "fa:16:3e:07:08:aa", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1f2867-31", "ovs_interfaceid": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:07:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-d79e3854-769c-430a-b980-3a551c7ee34d" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:07:19 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 01:07:20 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:07:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:07:24 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:07:25 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:07:25 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:07:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:07:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:07:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:07:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:07:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:07:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:07:26 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:07:26 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:07:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:07:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:07:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:07:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:07:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:07:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:07:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:07:38 user nova-compute[73010]: DEBUG nova.compute.manager [None req-9d3800e3-2975-4eb5-8a7c-b3c24a17b3ad tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:07:38 user nova-compute[73010]: INFO nova.compute.manager [None req-9d3800e3-2975-4eb5-8a7c-b3c24a17b3ad tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] instance snapshotting
Aug 15 01:07:38 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-9d3800e3-2975-4eb5-8a7c-b3c24a17b3ad tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Beginning live snapshot process
Aug 15 01:07:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-9d3800e3-2975-4eb5-8a7c-b3c24a17b3ad tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json -f qcow2 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:07:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-9d3800e3-2975-4eb5-8a7c-b3c24a17b3ad tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:07:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-9d3800e3-2975-4eb5-8a7c-b3c24a17b3ad tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json -f qcow2 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:07:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-9d3800e3-2975-4eb5-8a7c-b3c24a17b3ad tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:07:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-9d3800e3-2975-4eb5-8a7c-b3c24a17b3ad tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:07:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-9d3800e3-2975-4eb5-8a7c-b3c24a17b3ad tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.186s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:07:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-9d3800e3-2975-4eb5-8a7c-b3c24a17b3ad tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvficdkuu/8b5d5208980a4eb8a9746f93f933936b.delta 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:07:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-9d3800e3-2975-4eb5-8a7c-b3c24a17b3ad tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvficdkuu/8b5d5208980a4eb8a9746f93f933936b.delta 1073741824" returned: 0 in 0.051s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:07:39 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-9d3800e3-2975-4eb5-8a7c-b3c24a17b3ad tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 01:07:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-9d3800e3-2975-4eb5-8a7c-b3c24a17b3ad tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 01:07:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-9d3800e3-2975-4eb5-8a7c-b3c24a17b3ad tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73010) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 01:07:40 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-9d3800e3-2975-4eb5-8a7c-b3c24a17b3ad tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 01:07:40 user nova-compute[73010]: DEBUG nova.privsep.utils [None req-9d3800e3-2975-4eb5-8a7c-b3c24a17b3ad tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73010) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 01:07:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-9d3800e3-2975-4eb5-8a7c-b3c24a17b3ad tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvficdkuu/8b5d5208980a4eb8a9746f93f933936b.delta /opt/stack/data/nova/instances/snapshots/tmpvficdkuu/8b5d5208980a4eb8a9746f93f933936b {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:07:41 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-9d3800e3-2975-4eb5-8a7c-b3c24a17b3ad tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvficdkuu/8b5d5208980a4eb8a9746f93f933936b.delta /opt/stack/data/nova/instances/snapshots/tmpvficdkuu/8b5d5208980a4eb8a9746f93f933936b" returned: 0 in 0.571s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:07:41 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-9d3800e3-2975-4eb5-8a7c-b3c24a17b3ad tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Snapshot extracted, beginning image upload
Aug 15 01:07:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Verify base images {{(pid=73010) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Image id 6c3513d3-9ca6-46bf-ad11-90f2f27f3126 yields fingerprint e62b40ec170177c2fdd910fe4a186644b1831b36 {{(pid=73010) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 15 01:07:42 user nova-compute[73010]: INFO nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] image 6c3513d3-9ca6-46bf-ad11-90f2f27f3126 at (/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36): checking
Aug 15 01:07:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] image 6c3513d3-9ca6-46bf-ad11-90f2f27f3126 at (/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36): image is in use {{(pid=73010) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73010) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3 is a valid instance name {{(pid=73010) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3 has a disk file {{(pid=73010) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3 is backed by e62b40ec170177c2fdd910fe4a186644b1831b36 {{(pid=73010) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] d79e3854-769c-430a-b980-3a551c7ee34d is a valid instance name {{(pid=73010) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] d79e3854-769c-430a-b980-3a551c7ee34d has a disk file {{(pid=73010) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG nova.compute.manager [req-91304b40-e193-4dcc-8394-b31a27cd9aa7 req-873af6cf-047c-46fd-880c-26a3387a5cc8 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Received event network-changed-58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG nova.compute.manager [req-91304b40-e193-4dcc-8394-b31a27cd9aa7 req-873af6cf-047c-46fd-880c-26a3387a5cc8 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Refreshing instance network info cache due to event network-changed-58ac448b-c375-4ef0-bae4-436351b80aec. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-91304b40-e193-4dcc-8394-b31a27cd9aa7 req-873af6cf-047c-46fd-880c-26a3387a5cc8 service nova] Acquiring lock "refresh_cache-a54593fa-a252-4a33-8150-5269c8ce56bf" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-91304b40-e193-4dcc-8394-b31a27cd9aa7 req-873af6cf-047c-46fd-880c-26a3387a5cc8 service nova] Acquired lock "refresh_cache-a54593fa-a252-4a33-8150-5269c8ce56bf" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG nova.network.neutron [req-91304b40-e193-4dcc-8394-b31a27cd9aa7 req-873af6cf-047c-46fd-880c-26a3387a5cc8 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Refreshing network info cache for port 58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance d79e3854-769c-430a-b980-3a551c7ee34d is backed by e62b40ec170177c2fdd910fe4a186644b1831b36 {{(pid=73010) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] 39a36324-d323-4169-abaa-09028eeb5598 is a valid instance name {{(pid=73010) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] 2e7996e6-56fe-44b3-ad02-d17f7ddb358a is a valid instance name {{(pid=73010) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] 2e7996e6-56fe-44b3-ad02-d17f7ddb358a has a disk file {{(pid=73010) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 15 01:07:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:07:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:07:43 user nova-compute[73010]: DEBUG nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 2e7996e6-56fe-44b3-ad02-d17f7ddb358a is backed by e62b40ec170177c2fdd910fe4a186644b1831b36 {{(pid=73010) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 15 01:07:43 user nova-compute[73010]: DEBUG nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] a54593fa-a252-4a33-8150-5269c8ce56bf is a valid instance name {{(pid=73010) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 15 01:07:43 user nova-compute[73010]: DEBUG nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] a54593fa-a252-4a33-8150-5269c8ce56bf has a disk file {{(pid=73010) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 15 01:07:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:07:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:07:43 user nova-compute[73010]: DEBUG nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance a54593fa-a252-4a33-8150-5269c8ce56bf is backed by e62b40ec170177c2fdd910fe4a186644b1831b36 {{(pid=73010) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 15 01:07:43 user nova-compute[73010]: WARNING nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Unknown base file: /opt/stack/data/nova/instances/_base/335e81ba9199bf0fda5bd9f800f921ed31f9b6fe
Aug 15 01:07:43 user nova-compute[73010]: WARNING nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Unknown base file: /opt/stack/data/nova/instances/_base/a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836
Aug 15 01:07:43 user nova-compute[73010]: WARNING nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Unknown base file: /opt/stack/data/nova/instances/_base/d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77
Aug 15 01:07:43 user nova-compute[73010]: WARNING nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Unknown base file: /opt/stack/data/nova/instances/_base/dd7217b480916a9ebbf9dc8130135994e4918e2e
Aug 15 01:07:43 user nova-compute[73010]: WARNING nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Unknown base file: /opt/stack/data/nova/instances/_base/205dce7ddd41cb9dec4259d0967eba5cc02f59b1
Aug 15 01:07:43 user nova-compute[73010]: WARNING nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Unknown base file: /opt/stack/data/nova/instances/_base/03eb72688e0bb7c3ddf53c173e3057a39bf06910
Aug 15 01:07:43 user nova-compute[73010]: WARNING nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Unknown base file: /opt/stack/data/nova/instances/_base/c8adac5dacf92c3c2d3b84c8bc78817a3a69b79b
Aug 15 01:07:43 user nova-compute[73010]: INFO nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Active base files: /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36
Aug 15 01:07:43 user nova-compute[73010]: INFO nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Removable base files: /opt/stack/data/nova/instances/_base/335e81ba9199bf0fda5bd9f800f921ed31f9b6fe /opt/stack/data/nova/instances/_base/a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836 /opt/stack/data/nova/instances/_base/d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77 /opt/stack/data/nova/instances/_base/dd7217b480916a9ebbf9dc8130135994e4918e2e /opt/stack/data/nova/instances/_base/205dce7ddd41cb9dec4259d0967eba5cc02f59b1 /opt/stack/data/nova/instances/_base/03eb72688e0bb7c3ddf53c173e3057a39bf06910 /opt/stack/data/nova/instances/_base/c8adac5dacf92c3c2d3b84c8bc78817a3a69b79b
Aug 15 01:07:43 user nova-compute[73010]: INFO nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/335e81ba9199bf0fda5bd9f800f921ed31f9b6fe
Aug 15 01:07:43 user nova-compute[73010]: INFO nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a98152a5bb2fc4dd8da75ff22bf80f9b3a51d836
Aug 15 01:07:43 user nova-compute[73010]: INFO nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d8a9ad6212b97f44f7c57c3c7b8805b7b63b1d77
Aug 15 01:07:43 user nova-compute[73010]: INFO nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dd7217b480916a9ebbf9dc8130135994e4918e2e
Aug 15 01:07:43 user nova-compute[73010]: INFO nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/205dce7ddd41cb9dec4259d0967eba5cc02f59b1
Aug 15 01:07:43 user nova-compute[73010]: INFO nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/03eb72688e0bb7c3ddf53c173e3057a39bf06910
Aug 15 01:07:43 user nova-compute[73010]: INFO nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c8adac5dacf92c3c2d3b84c8bc78817a3a69b79b
Aug 15 01:07:43 user nova-compute[73010]: DEBUG nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Verification complete {{(pid=73010) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 15 01:07:43 user nova-compute[73010]: DEBUG nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Verify swap images {{(pid=73010) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 15 01:07:43 user nova-compute[73010]: DEBUG nova.virt.libvirt.imagecache [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Verify ephemeral images {{(pid=73010) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 15 01:07:43 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-9d3800e3-2975-4eb5-8a7c-b3c24a17b3ad tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Snapshot image upload complete
Aug 15 01:07:43 user nova-compute[73010]: INFO nova.compute.manager [None req-9d3800e3-2975-4eb5-8a7c-b3c24a17b3ad tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Took 5.21 seconds to snapshot the instance on the hypervisor.
Aug 15 01:07:43 user nova-compute[73010]: DEBUG nova.network.neutron [req-91304b40-e193-4dcc-8394-b31a27cd9aa7 req-873af6cf-047c-46fd-880c-26a3387a5cc8 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Updated VIF entry in instance network info cache for port 58ac448b-c375-4ef0-bae4-436351b80aec. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 01:07:43 user nova-compute[73010]: DEBUG nova.network.neutron [req-91304b40-e193-4dcc-8394-b31a27cd9aa7 req-873af6cf-047c-46fd-880c-26a3387a5cc8 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Updating instance_info_cache with network_info: [{"id": "58ac448b-c375-4ef0-bae4-436351b80aec", "address": "fa:16:3e:e7:72:f7", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ac448b-c3", "ovs_interfaceid": "58ac448b-c375-4ef0-bae4-436351b80aec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:07:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-91304b40-e193-4dcc-8394-b31a27cd9aa7 req-873af6cf-047c-46fd-880c-26a3387a5cc8 service nova] Releasing lock "refresh_cache-a54593fa-a252-4a33-8150-5269c8ce56bf" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:07:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:07:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:07:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "a54593fa-a252-4a33-8150-5269c8ce56bf" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:07:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:07:47 user nova-compute[73010]: INFO nova.compute.manager [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Shelving
Aug 15 01:07:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:07:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:07:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:07:47 user nova-compute[73010]: DEBUG nova.compute.manager [req-71804929-f167-44c6-9a60-e08086650182 req-c7b5c101-7ea6-461a-a9de-586a56ca4411 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Received event network-vif-unplugged-58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:07:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-71804929-f167-44c6-9a60-e08086650182 req-c7b5c101-7ea6-461a-a9de-586a56ca4411 service nova] Acquiring lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:07:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-71804929-f167-44c6-9a60-e08086650182 req-c7b5c101-7ea6-461a-a9de-586a56ca4411 service nova] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:07:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-71804929-f167-44c6-9a60-e08086650182 req-c7b5c101-7ea6-461a-a9de-586a56ca4411 service nova] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:07:47 user nova-compute[73010]: DEBUG nova.compute.manager [req-71804929-f167-44c6-9a60-e08086650182 req-c7b5c101-7ea6-461a-a9de-586a56ca4411 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] No waiting events found dispatching network-vif-unplugged-58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:07:47 user nova-compute[73010]: WARNING nova.compute.manager [req-71804929-f167-44c6-9a60-e08086650182 req-c7b5c101-7ea6-461a-a9de-586a56ca4411 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Received unexpected event network-vif-unplugged-58ac448b-c375-4ef0-bae4-436351b80aec for instance with vm_state active and task_state shelving.
Aug 15 01:07:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:07:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:07:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:07:48 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Instance destroyed successfully.
Aug 15 01:07:48 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Beginning cold snapshot process
Aug 15 01:07:48 user nova-compute[73010]: DEBUG nova.privsep.utils [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73010) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 01:07:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk /opt/stack/data/nova/instances/snapshots/tmp_bmmrqat/6ab95a7866b342f0a1b5e3fedd591fb6 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:07:48 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk /opt/stack/data/nova/instances/snapshots/tmp_bmmrqat/6ab95a7866b342f0a1b5e3fedd591fb6" returned: 0 in 0.239s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:07:48 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Snapshot extracted, beginning image upload
Aug 15 01:07:49 user nova-compute[73010]: DEBUG nova.compute.manager [req-85fe8395-325e-4f98-a46f-8798d5a152e0 req-3cd8e99b-98da-40a4-b98d-ce22c66bb6bc service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Received event network-vif-plugged-58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:07:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-85fe8395-325e-4f98-a46f-8798d5a152e0 req-3cd8e99b-98da-40a4-b98d-ce22c66bb6bc service nova] Acquiring lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:07:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-85fe8395-325e-4f98-a46f-8798d5a152e0 req-3cd8e99b-98da-40a4-b98d-ce22c66bb6bc service nova] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:07:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-85fe8395-325e-4f98-a46f-8798d5a152e0 req-3cd8e99b-98da-40a4-b98d-ce22c66bb6bc service nova] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:07:49 user nova-compute[73010]: DEBUG nova.compute.manager [req-85fe8395-325e-4f98-a46f-8798d5a152e0 req-3cd8e99b-98da-40a4-b98d-ce22c66bb6bc service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] No waiting events found dispatching network-vif-plugged-58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:07:49 user nova-compute[73010]: WARNING nova.compute.manager [req-85fe8395-325e-4f98-a46f-8798d5a152e0 req-3cd8e99b-98da-40a4-b98d-ce22c66bb6bc service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Received unexpected event network-vif-plugged-58ac448b-c375-4ef0-bae4-436351b80aec for instance with vm_state active and task_state shelving_image_uploading.
Aug 15 01:07:50 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Snapshot image upload complete
Aug 15 01:07:50 user nova-compute[73010]: DEBUG nova.compute.manager [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:07:50 user nova-compute[73010]: INFO nova.compute.manager [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Shelve offloading
Aug 15 01:07:50 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Instance destroyed successfully.
Aug 15 01:07:50 user nova-compute[73010]: DEBUG nova.compute.manager [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:07:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "refresh_cache-a54593fa-a252-4a33-8150-5269c8ce56bf" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:07:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquired lock "refresh_cache-a54593fa-a252-4a33-8150-5269c8ce56bf" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:07:50 user nova-compute[73010]: DEBUG nova.network.neutron [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 01:07:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:07:51 user nova-compute[73010]: DEBUG nova.network.neutron [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Updating instance_info_cache with network_info: [{"id": "58ac448b-c375-4ef0-bae4-436351b80aec", "address": "fa:16:3e:e7:72:f7", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ac448b-c3", "ovs_interfaceid": "58ac448b-c375-4ef0-bae4-436351b80aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:07:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Releasing lock "refresh_cache-a54593fa-a252-4a33-8150-5269c8ce56bf" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:07:51 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Instance destroyed successfully.
Aug 15 01:07:51 user nova-compute[73010]: DEBUG nova.objects.instance [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lazy-loading 'resources' on Instance uuid a54593fa-a252-4a33-8150-5269c8ce56bf {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:07:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:05:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1051974814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1051974814',id=50,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYTLD0SROw2+kgQJPV0u9yb76/GoiUChdaEG+JkzAoIxFCE9jTOZvMZYfdiHfNjmnIRhStAHLSNX/f/KwsFnraWOZee3aNoqh8RakueGTo5I/6c+Q3lrU800h7AOthtdg==',key_name='tempest-keypair-485982673',keypairs=<?>,launch_index=0,launched_at=2023-08-15T01:05:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='586bed330893488081bb21738b1a6ec4',ramdisk_id='',reservation_id='r-vnnzzp3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-563974852',owner_user_name='tempest-AttachVolumeShelveTestJSON-563974852-project-member',shelved_at='2023-08-15T01:07:50.786283',shelved_host='user',shelved_image_id='669d51a3-e00a-457d-9595-bf1b04048d47'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T01:07:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c5655da76eb4671b4db00e086232f05',uuid=a54593fa-a252-4a33-8150-5269c8ce56bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "58ac448b-c375-4ef0-bae4-436351b80aec", "address": "fa:16:3e:e7:72:f7", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ac448b-c3", "ovs_interfaceid": "58ac448b-c375-4ef0-bae4-436351b80aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 01:07:51 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Converting VIF {"id": "58ac448b-c375-4ef0-bae4-436351b80aec", "address": "fa:16:3e:e7:72:f7", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ac448b-c3", "ovs_interfaceid": "58ac448b-c375-4ef0-bae4-436351b80aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:07:51 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:72:f7,bridge_name='br-int',has_traffic_filtering=True,id=58ac448b-c375-4ef0-bae4-436351b80aec,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ac448b-c3') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:07:51 user nova-compute[73010]: DEBUG os_vif [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:72:f7,bridge_name='br-int',has_traffic_filtering=True,id=58ac448b-c375-4ef0-bae4-436351b80aec,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ac448b-c3') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 01:07:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:07:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58ac448b-c3, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:07:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:07:51 user nova-compute[73010]: DEBUG nova.compute.manager [req-724ee0c8-d339-48fc-9438-adc143ab88af req-b9f09bf2-44a4-4240-8bff-4169a684f216 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Received event network-changed-58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:07:51 user nova-compute[73010]: DEBUG nova.compute.manager [req-724ee0c8-d339-48fc-9438-adc143ab88af req-b9f09bf2-44a4-4240-8bff-4169a684f216 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Refreshing instance network info cache due to event network-changed-58ac448b-c375-4ef0-bae4-436351b80aec. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 01:07:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-724ee0c8-d339-48fc-9438-adc143ab88af req-b9f09bf2-44a4-4240-8bff-4169a684f216 service nova] Acquiring lock "refresh_cache-a54593fa-a252-4a33-8150-5269c8ce56bf" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:07:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-724ee0c8-d339-48fc-9438-adc143ab88af req-b9f09bf2-44a4-4240-8bff-4169a684f216 service nova] Acquired lock "refresh_cache-a54593fa-a252-4a33-8150-5269c8ce56bf" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:07:51 user nova-compute[73010]: DEBUG nova.network.neutron [req-724ee0c8-d339-48fc-9438-adc143ab88af req-b9f09bf2-44a4-4240-8bff-4169a684f216 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Refreshing network info cache for port 58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 01:07:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:07:51 user nova-compute[73010]: INFO os_vif [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:72:f7,bridge_name='br-int',has_traffic_filtering=True,id=58ac448b-c375-4ef0-bae4-436351b80aec,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ac448b-c3')
Aug 15 01:07:51 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Deleting instance files /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf_del
Aug 15 01:07:51 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Deletion of /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf_del complete
Aug 15 01:07:52 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Deleted allocations for instance a54593fa-a252-4a33-8150-5269c8ce56bf
Aug 15 01:07:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:07:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:07:52 user nova-compute[73010]: DEBUG nova.objects.instance [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lazy-loading 'numa_topology' on Instance uuid a54593fa-a252-4a33-8150-5269c8ce56bf {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:07:52 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:07:52 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:07:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:07:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-729ad001-7b10-49a6-aa1c-e3a474161642 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 4.917s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:07:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:07:52 user nova-compute[73010]: DEBUG nova.network.neutron [req-724ee0c8-d339-48fc-9438-adc143ab88af req-b9f09bf2-44a4-4240-8bff-4169a684f216 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Updated VIF entry in instance network info cache for port 58ac448b-c375-4ef0-bae4-436351b80aec. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 01:07:52 user nova-compute[73010]: DEBUG nova.network.neutron [req-724ee0c8-d339-48fc-9438-adc143ab88af req-b9f09bf2-44a4-4240-8bff-4169a684f216 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Updating instance_info_cache with network_info: [{"id": "58ac448b-c375-4ef0-bae4-436351b80aec", "address": "fa:16:3e:e7:72:f7", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap58ac448b-c3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:07:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-724ee0c8-d339-48fc-9438-adc143ab88af req-b9f09bf2-44a4-4240-8bff-4169a684f216 service nova] Releasing lock "refresh_cache-a54593fa-a252-4a33-8150-5269c8ce56bf" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:07:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:08:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:08:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:08:03 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692061668.0076377, a54593fa-a252-4a33-8150-5269c8ce56bf => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:08:03 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] VM Stopped (Lifecycle Event)
Aug 15 01:08:03 user nova-compute[73010]: DEBUG nova.compute.manager [None req-8cffe548-bdd5-4762-9287-478ad5bb623e None None] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:08:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:08:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:08:13 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:08:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:08:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:08:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:08:13 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:08:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:13 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:08:13 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:14 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:14 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:14 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:14 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:14 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:14 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:14 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:14 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:08:14 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:08:15 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8528MB free_disk=25.21282196044922GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:08:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:08:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:08:15 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance d79e3854-769c-430a-b980-3a551c7ee34d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:08:15 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 39a36324-d323-4169-abaa-09028eeb5598 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:08:15 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 2e7996e6-56fe-44b3-ad02-d17f7ddb358a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:08:15 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:08:15 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:08:15 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:08:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-cac883bd-f832-4f2b-84e9-0721a38a4b6a req-ad7d89af-41d8-4a49-ac57-7355174f23e9 service nova] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Received event network-changed-2cfaaa3f-bf6c-434f-88ac-28be01359fea {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:08:15 user nova-compute[73010]: DEBUG nova.compute.manager [req-cac883bd-f832-4f2b-84e9-0721a38a4b6a req-ad7d89af-41d8-4a49-ac57-7355174f23e9 service nova] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Refreshing instance network info cache due to event network-changed-2cfaaa3f-bf6c-434f-88ac-28be01359fea. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 01:08:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-cac883bd-f832-4f2b-84e9-0721a38a4b6a req-ad7d89af-41d8-4a49-ac57-7355174f23e9 service nova] Acquiring lock "refresh_cache-45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:08:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-cac883bd-f832-4f2b-84e9-0721a38a4b6a req-ad7d89af-41d8-4a49-ac57-7355174f23e9 service nova] Acquired lock "refresh_cache-45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:08:15 user nova-compute[73010]: DEBUG nova.network.neutron [req-cac883bd-f832-4f2b-84e9-0721a38a4b6a req-ad7d89af-41d8-4a49-ac57-7355174f23e9 service nova] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Refreshing network info cache for port 2cfaaa3f-bf6c-434f-88ac-28be01359fea {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 01:08:15 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:08:15 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:08:15 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:08:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:08:15 user nova-compute[73010]: DEBUG nova.network.neutron [req-cac883bd-f832-4f2b-84e9-0721a38a4b6a req-ad7d89af-41d8-4a49-ac57-7355174f23e9 service nova] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Updated VIF entry in instance network info cache for port 2cfaaa3f-bf6c-434f-88ac-28be01359fea. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 01:08:15 user nova-compute[73010]: DEBUG nova.network.neutron [req-cac883bd-f832-4f2b-84e9-0721a38a4b6a req-ad7d89af-41d8-4a49-ac57-7355174f23e9 service nova] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Updating instance_info_cache with network_info: [{"id": "2cfaaa3f-bf6c-434f-88ac-28be01359fea", "address": "fa:16:3e:0d:ad:e1", "network": {"id": "211a78cc-5fce-4fa9-abfe-70c5966402cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-525994571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fa7253a229a49278b2c1cab2208d69a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfaaa3f-bf", "ovs_interfaceid": "2cfaaa3f-bf6c-434f-88ac-28be01359fea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:08:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-cac883bd-f832-4f2b-84e9-0721a38a4b6a req-ad7d89af-41d8-4a49-ac57-7355174f23e9 service nova] Releasing lock "refresh_cache-45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:08:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:08:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:08:17 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:08:17 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:08:18 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:08:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:08:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-39a36324-d323-4169-abaa-09028eeb5598" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:08:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-39a36324-d323-4169-abaa-09028eeb5598" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:08:18 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Updating instance_info_cache with network_info: [{"id": "18919d62-63b4-4622-af68-05b0ecfb2002", "address": "fa:16:3e:d7:7a:a7", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18919d62-63", "ovs_interfaceid": "18919d62-63b4-4622-af68-05b0ecfb2002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-39a36324-d323-4169-abaa-09028eeb5598" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Acquiring lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG nova.objects.instance [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lazy-loading 'flavor' on Instance uuid 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Acquiring lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:08:19 user nova-compute[73010]: INFO nova.compute.manager [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Attaching volume 1b4033fb-b1da-4a69-a96f-e615ca2e2e8d to /dev/vdb
Aug 15 01:08:19 user nova-compute[73010]: DEBUG os_brick.utils [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec773b49-a02b-4cd9-a11f-5e92f91804d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[37da1f98-96c7-4962-9e8a-d07aaffb3ade]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[589820fb-2efb-4415-b74f-c62b477bc106]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade56c82-9bdf-4e14-986a-a170c5d67b3d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 01:08:19 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 01:08:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad637bf-18d5-4014-8e6d-0f7f075e9245]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG os_brick.utils [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:08:19 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Updating existing volume attachment record: 44a9d086-9120-4e4e-a35b-a47cc294abaf {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 01:08:20 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:08:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:08:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:08:25 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:08:26 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:08:26 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:08:26 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:08:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:08:27 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DnUckNCM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:08:28 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:08:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:08:28 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:08:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:08:28 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ee2f5a-14c3-4722-89d5-2b04376bbe72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 01:08:28 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[608dd679-1ff5-4f7d-96fa-9de77dd893e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d] added
Aug 15 01:08:28 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[215f4471-0843-40a5-ba35-2c0ad0985f53]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[370b633b-c34e-4ff8-88ea-63f1f519c68e]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DnUckNCM {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DnUckNCM" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ca279c-5458-4703-af29-dfab88035159]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DnUckNCM'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4107e1ca-a0a2-494b-a197-4438cdfe767c]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[86921951-43c9-49d2-b496-aaaca8578683]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:08:28 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:08:28 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebce31c-4ea6-47e4-acf8-9119d4fb6df5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d, portal: 172.16.0.220,3260]
Aug 15 01:08:28 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d, portal: 172.16.0.220,3260] successful.
Aug 15 01:08:28 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ad1780-f22e-4c71-9ef1-c2ecb9c2b5fb]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7e8bda-81f3-47d9-880d-219c2618325e]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:08:28 user nova-compute[73010]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d (non-flash)
Aug 15 01:08:28 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:08:28 user nova-compute[73010]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d (non-flash)
Aug 15 01:08:28 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2a577f-5805-418a-b251-cd2e3f5f7056]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 01:08:28 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DnUckNCM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 01:08:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:08:29 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23463663137613031', 'path': '/dev/sdb'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:08:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463663137613031', 'path': '/dev/sdb'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 01:08:29 user nova-compute[73010]: DEBUG nova.objects.instance [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lazy-loading 'flavor' on Instance uuid 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:08:29 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 01:08:29 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:08:29 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 01:08:29 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 01:08:29 user nova-compute[73010]:   <serial>1b4033fb-b1da-4a69-a96f-e615ca2e2e8d</serial>
Aug 15 01:08:29 user nova-compute[73010]: </disk>
Aug 15 01:08:29 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 01:08:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:08:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:08:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] No VIF found with MAC fa:16:3e:0d:ad:e1, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 01:08:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-87160a4e-635e-4cae-b436-545f0b247e61 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.512s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:08:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Acquiring lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:08:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:08:31 user nova-compute[73010]: INFO nova.compute.manager [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Detaching volume 1b4033fb-b1da-4a69-a96f-e615ca2e2e8d
Aug 15 01:08:31 user nova-compute[73010]: INFO nova.virt.block_device [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Attempting to driver detach volume 1b4033fb-b1da-4a69-a96f-e615ca2e2e8d from mountpoint /dev/vdb
Aug 15 01:08:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Attempting to detach device vdb from instance 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3 from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 01:08:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 01:08:31 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:08:31 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 01:08:31 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 01:08:31 user nova-compute[73010]:   <serial>1b4033fb-b1da-4a69-a96f-e615ca2e2e8d</serial>
Aug 15 01:08:31 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 01:08:31 user nova-compute[73010]: </disk>
Aug 15 01:08:31 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 01:08:31 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Successfully detached device vdb from instance 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3 from the persistent domain config.
Aug 15 01:08:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3 from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 01:08:31 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 01:08:31 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:08:31 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 01:08:31 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 01:08:31 user nova-compute[73010]:   <serial>1b4033fb-b1da-4a69-a96f-e615ca2e2e8d</serial>
Aug 15 01:08:31 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 01:08:31 user nova-compute[73010]: </disk>
Aug 15 01:08:31 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 01:08:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:08:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:08:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:08:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:08:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:08:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692061712.149158, 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3 {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 01:08:32 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Successfully detached device vdb from instance 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3 from the live domain config.
Aug 15 01:08:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DnUckNCM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:08:32 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:08:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61c4a9e-e8da-405e-8a08-8e931844174e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5e4c8f-f2cc-429d-8e1f-1e2ab4f1be6d]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:08:32 user nova-compute[73010]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d (non-flash)
Aug 15 01:08:32 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:08:32 user nova-compute[73010]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d (non-flash)
Aug 15 01:08:32 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec302269e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d'): ({'sdb'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Removing single pathed devices sdb {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d238f060-010f-475c-a4f5-01f5ff227bf6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3699da-be8c-42d7-810f-0f96ce97c591]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Flushing IO for device /dev/sdb {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[026539eb-c8b2-4027-9d14-a6a9603974b3]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3e8536-d7e1-450e-9f21-1f3d249c4d9f]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed24ab18-dde7-4be0-af90-94b3092f483d]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ad8232-8b04-4d1a-ba75-f17c0346539a]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d, portal: 172.16.0.220,3260]
Aug 15 01:08:32 user nova-compute[73010]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d, portal: 172.16.0.220,3260] successful.
Aug 15 01:08:32 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4033fb-b1da-4a69-a96f-e615ca2e2e8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ac9b95-994b-49df-a159-4afa76b0ee96]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] <== disconnect_volume: return (283ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Cleaning up deleted instances {{(pid=73010) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 01:08:32 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] There are 0 instances to clean {{(pid=73010) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 01:08:33 user nova-compute[73010]: DEBUG nova.objects.instance [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lazy-loading 'flavor' on Instance uuid 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:08:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-29279ea3-2b01-436d-bcc2-1b9bfda13775 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.590s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:08:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:08:37 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:08:39 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_power_states {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:08:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid d79e3854-769c-430a-b980-3a551c7ee34d {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 01:08:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid 39a36324-d323-4169-abaa-09028eeb5598 {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 01:08:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid 2e7996e6-56fe-44b3-ad02-d17f7ddb358a {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 01:08:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Triggering sync for uuid 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3 {{(pid=73010) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 01:08:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "d79e3854-769c-430a-b980-3a551c7ee34d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:08:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "d79e3854-769c-430a-b980-3a551c7ee34d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:08:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "39a36324-d323-4169-abaa-09028eeb5598" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:08:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "39a36324-d323-4169-abaa-09028eeb5598" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:08:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "2e7996e6-56fe-44b3-ad02-d17f7ddb358a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:08:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "2e7996e6-56fe-44b3-ad02-d17f7ddb358a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:08:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:08:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:08:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "39a36324-d323-4169-abaa-09028eeb5598" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:08:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "2e7996e6-56fe-44b3-ad02-d17f7ddb358a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:08:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:08:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "d79e3854-769c-430a-b980-3a551c7ee34d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:08:41 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:08:41 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73010) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 01:08:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:08:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:08:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:08:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:08:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:08:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:08:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "c36e629d-8dfa-4a10-becb-680c6fcb3939" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:08:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:08:46 user nova-compute[73010]: DEBUG nova.compute.manager [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 01:08:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:08:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:08:46 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 01:08:46 user nova-compute[73010]: INFO nova.compute.claims [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Claim successful on node user
Aug 15 01:08:46 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:08:46 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:08:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:08:46 user nova-compute[73010]: DEBUG nova.compute.manager [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 01:08:46 user nova-compute[73010]: DEBUG nova.compute.manager [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 01:08:46 user nova-compute[73010]: DEBUG nova.network.neutron [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 01:08:46 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 01:08:46 user nova-compute[73010]: DEBUG nova.compute.manager [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 01:08:46 user nova-compute[73010]: INFO nova.virt.block_device [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Booting with volume-backed-image 6c3513d3-9ca6-46bf-ad11-90f2f27f3126 at /dev/vda
Aug 15 01:08:46 user nova-compute[73010]: DEBUG nova.policy [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e1e98c9bae145f0909011bb46c6e104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6db1cb9145b49999d0f102f8cfb867a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 01:08:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:08:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:08:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:08:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:08:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:08:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:08:47 user nova-compute[73010]: DEBUG nova.network.neutron [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Successfully created port: 19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 01:08:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:08:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:08:48 user nova-compute[73010]: DEBUG nova.network.neutron [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Successfully updated port: 19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 01:08:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "refresh_cache-c36e629d-8dfa-4a10-becb-680c6fcb3939" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:08:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquired lock "refresh_cache-c36e629d-8dfa-4a10-becb-680c6fcb3939" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:08:48 user nova-compute[73010]: DEBUG nova.network.neutron [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 01:08:48 user nova-compute[73010]: DEBUG nova.compute.manager [req-e7022c58-e04f-4907-ac50-1676aac723a2 req-9ae906ab-c664-4a74-b636-1324f4a49607 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received event network-changed-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:08:48 user nova-compute[73010]: DEBUG nova.compute.manager [req-e7022c58-e04f-4907-ac50-1676aac723a2 req-9ae906ab-c664-4a74-b636-1324f4a49607 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Refreshing instance network info cache due to event network-changed-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 01:08:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e7022c58-e04f-4907-ac50-1676aac723a2 req-9ae906ab-c664-4a74-b636-1324f4a49607 service nova] Acquiring lock "refresh_cache-c36e629d-8dfa-4a10-becb-680c6fcb3939" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:08:48 user nova-compute[73010]: DEBUG nova.network.neutron [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 01:08:48 user nova-compute[73010]: DEBUG nova.network.neutron [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Updating instance_info_cache with network_info: [{"id": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "address": "fa:16:3e:87:4b:88", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ae67fd-cf", "ovs_interfaceid": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:08:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Releasing lock "refresh_cache-c36e629d-8dfa-4a10-becb-680c6fcb3939" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:08:48 user nova-compute[73010]: DEBUG nova.compute.manager [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Instance network_info: |[{"id": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "address": "fa:16:3e:87:4b:88", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ae67fd-cf", "ovs_interfaceid": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 01:08:48 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e7022c58-e04f-4907-ac50-1676aac723a2 req-9ae906ab-c664-4a74-b636-1324f4a49607 service nova] Acquired lock "refresh_cache-c36e629d-8dfa-4a10-becb-680c6fcb3939" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:08:48 user nova-compute[73010]: DEBUG nova.network.neutron [req-e7022c58-e04f-4907-ac50-1676aac723a2 req-9ae906ab-c664-4a74-b636-1324f4a49607 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Refreshing network info cache for port 19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 01:08:49 user nova-compute[73010]: DEBUG nova.network.neutron [req-e7022c58-e04f-4907-ac50-1676aac723a2 req-9ae906ab-c664-4a74-b636-1324f4a49607 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Updated VIF entry in instance network info cache for port 19ae67fd-cf2b-4ff0-af2e-94bbb231d96f. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 01:08:49 user nova-compute[73010]: DEBUG nova.network.neutron [req-e7022c58-e04f-4907-ac50-1676aac723a2 req-9ae906ab-c664-4a74-b636-1324f4a49607 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Updating instance_info_cache with network_info: [{"id": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "address": "fa:16:3e:87:4b:88", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ae67fd-cf", "ovs_interfaceid": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:08:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e7022c58-e04f-4907-ac50-1676aac723a2 req-9ae906ab-c664-4a74-b636-1324f4a49607 service nova] Releasing lock "refresh_cache-c36e629d-8dfa-4a10-becb-680c6fcb3939" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:08:50 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:08:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:08:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:08:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:08:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:08:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:08:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:08:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:08:57 user nova-compute[73010]: DEBUG os_brick.utils [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:08:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4a9612-568d-4725-acca-43c1a2104f4e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91e50fd-e1d3-4cff-82d1-ebe1ea80aff5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:08:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c56f9e-fcaf-4729-93d5-c67804066a0a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5308ecec-d9ca-4fe4-a4e4-40dd03e383bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 01:08:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 01:08:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:08:57 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 01:08:57 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 01:08:57 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[9310398b-c5a7-4d9b-b56e-541b269573bd]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:08:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 01:08:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 01:08:57 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 01:08:57 user nova-compute[73010]: DEBUG os_brick.utils [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:08:57 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Updating existing volume attachment record: 71fd5762-d006-4e34-a4a1-a9931909ebc6 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 01:09:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG nova.compute.manager [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 01:09:06 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Creating image(s)
Aug 15 01:09:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Did not create local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Ensure instance console log exists: /opt/stack/data/nova/instances/c36e629d-8dfa-4a10-becb-680c6fcb3939/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Start _get_guest_xml network_info=[{"id": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "address": "fa:16:3e:87:4b:88", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ae67fd-cf", "ovs_interfaceid": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'usSfpKNt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c36e629d-8dfa-4a10-becb-680c6fcb3939', 'attached_at': '', 'detached_at': '', 'volume_id': '35087b75-844e-4ec1-9091-2433e930f07f', 'serial': '35087b75-844e-4ec1-9091-2433e930f07f'}, 'disk_bus': 'virtio', 'attachment_id': '71fd5762-d006-4e34-a4a1-a9931909ebc6', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 01:09:06 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:09:06 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:09:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'usSfpKNt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:09:06 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:09:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:09:06 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:09:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:09:06 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8c8116-1e41-4e5b-bfc8-2c52f2d4179e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 01:09:06 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[caed48db-a1c2-440f-91dc-bbd4617c8df6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f] added
Aug 15 01:09:06 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4b0a0d-1a5b-497d-b7df-974865f43ed7]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[356b911a-ea23-4f2f-a3f0-2167c904eef9]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v usSfpKNt {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v usSfpKNt" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e423a3-c883-414d-924b-a6c98b8894fc]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'usSfpKNt'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ce8937-6ead-4323-ac64-4749ee6f5c06]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba82dcc-b6dd-48c6-99ad-d7d90d469d1f]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:09:06 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:09:06 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d6ed5f-4e7e-4c14-896d-635295f61102]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f, portal: 172.16.0.220,3260]
Aug 15 01:09:06 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f, portal: 172.16.0.220,3260] successful.
Aug 15 01:09:06 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54a601b-ba0c-4f40-bbad-89b57f623967]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[635a69e7-1f30-4988-a8c1-ae07989fcea9]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:09:06 user nova-compute[73010]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f (non-flash)
Aug 15 01:09:06 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:09:06 user nova-compute[73010]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f (non-flash)
Aug 15 01:09:06 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34081d3-c9ee-4d3d-9aa2-f4adc47f3048]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'usSfpKNt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:09:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:09:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23639323330333232', 'path': '/dev/sdb'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:09:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639323330333232', 'path': '/dev/sdb'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 01:09:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:08:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1446601433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1446601433',id=52,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6db1cb9145b49999d0f102f8cfb867a',ramdisk_id='',reservation_id='r-51gycceg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T01:08:47Z,user_data=None,user_id='8e1e98c9bae145f0909011bb46c6e104',uuid=c36e629d-8dfa-4a10-becb-680c6fcb3939,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "address": "fa:16:3e:87:4b:88", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ae67fd-cf", "ovs_interfaceid": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 01:09:07 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converting VIF {"id": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "address": "fa:16:3e:87:4b:88", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ae67fd-cf", "ovs_interfaceid": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:09:07 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:4b:88,bridge_name='br-int',has_traffic_filtering=True,id=19ae67fd-cf2b-4ff0-af2e-94bbb231d96f,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ae67fd-cf') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:09:07 user nova-compute[73010]: DEBUG nova.objects.instance [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lazy-loading 'pci_devices' on Instance uuid c36e629d-8dfa-4a10-becb-680c6fcb3939 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:09:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] End _get_guest_xml xml=<domain type="kvm">
Aug 15 01:09:07 user nova-compute[73010]:   <uuid>c36e629d-8dfa-4a10-becb-680c6fcb3939</uuid>
Aug 15 01:09:07 user nova-compute[73010]:   <name>instance-00000034</name>
Aug 15 01:09:07 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 01:09:07 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 01:09:07 user nova-compute[73010]:   <metadata>
Aug 15 01:09:07 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 01:09:07 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 01:09:07 user nova-compute[73010]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1446601433</nova:name>
Aug 15 01:09:07 user nova-compute[73010]:       <nova:creationTime>2023-08-15 01:09:06</nova:creationTime>
Aug 15 01:09:07 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 01:09:07 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 01:09:07 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 01:09:07 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 01:09:07 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 01:09:07 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 01:09:07 user nova-compute[73010]:       </nova:flavor>
Aug 15 01:09:07 user nova-compute[73010]:       <nova:owner>
Aug 15 01:09:07 user nova-compute[73010]:         <nova:user uuid="8e1e98c9bae145f0909011bb46c6e104">tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member</nova:user>
Aug 15 01:09:07 user nova-compute[73010]:         <nova:project uuid="f6db1cb9145b49999d0f102f8cfb867a">tempest-ServerBootFromVolumeStableRescueTest-1758225981</nova:project>
Aug 15 01:09:07 user nova-compute[73010]:       </nova:owner>
Aug 15 01:09:07 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 01:09:07 user nova-compute[73010]:       <nova:ports>
Aug 15 01:09:07 user nova-compute[73010]:         <nova:port uuid="19ae67fd-cf2b-4ff0-af2e-94bbb231d96f">
Aug 15 01:09:07 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 01:09:07 user nova-compute[73010]:         </nova:port>
Aug 15 01:09:07 user nova-compute[73010]:       </nova:ports>
Aug 15 01:09:07 user nova-compute[73010]:     </nova:instance>
Aug 15 01:09:07 user nova-compute[73010]:   </metadata>
Aug 15 01:09:07 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 01:09:07 user nova-compute[73010]:     <system>
Aug 15 01:09:07 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 01:09:07 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 01:09:07 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 01:09:07 user nova-compute[73010]:       <entry name="serial">c36e629d-8dfa-4a10-becb-680c6fcb3939</entry>
Aug 15 01:09:07 user nova-compute[73010]:       <entry name="uuid">c36e629d-8dfa-4a10-becb-680c6fcb3939</entry>
Aug 15 01:09:07 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 01:09:07 user nova-compute[73010]:     </system>
Aug 15 01:09:07 user nova-compute[73010]:   </sysinfo>
Aug 15 01:09:07 user nova-compute[73010]:   <os>
Aug 15 01:09:07 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 01:09:07 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 01:09:07 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 01:09:07 user nova-compute[73010]:   </os>
Aug 15 01:09:07 user nova-compute[73010]:   <features>
Aug 15 01:09:07 user nova-compute[73010]:     <acpi/>
Aug 15 01:09:07 user nova-compute[73010]:     <apic/>
Aug 15 01:09:07 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 01:09:07 user nova-compute[73010]:   </features>
Aug 15 01:09:07 user nova-compute[73010]:   <clock offset="utc">
Aug 15 01:09:07 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 01:09:07 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 01:09:07 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 01:09:07 user nova-compute[73010]:   </clock>
Aug 15 01:09:07 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 01:09:07 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 01:09:07 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 01:09:07 user nova-compute[73010]:   </cpu>
Aug 15 01:09:07 user nova-compute[73010]:   <devices>
Aug 15 01:09:07 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 01:09:07 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:09:07 user nova-compute[73010]:       <source dev="/dev/sdb"/>
Aug 15 01:09:07 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 01:09:07 user nova-compute[73010]:       <serial>35087b75-844e-4ec1-9091-2433e930f07f</serial>
Aug 15 01:09:07 user nova-compute[73010]:     </disk>
Aug 15 01:09:07 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 01:09:07 user nova-compute[73010]:       <mac address="fa:16:3e:87:4b:88"/>
Aug 15 01:09:07 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:09:07 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 01:09:07 user nova-compute[73010]:       <target dev="tap19ae67fd-cf"/>
Aug 15 01:09:07 user nova-compute[73010]:     </interface>
Aug 15 01:09:07 user nova-compute[73010]:     <serial type="pty">
Aug 15 01:09:07 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/c36e629d-8dfa-4a10-becb-680c6fcb3939/console.log" append="off"/>
Aug 15 01:09:07 user nova-compute[73010]:     </serial>
Aug 15 01:09:07 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 01:09:07 user nova-compute[73010]:     <video>
Aug 15 01:09:07 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:09:07 user nova-compute[73010]:     </video>
Aug 15 01:09:07 user nova-compute[73010]:     <rng model="virtio">
Aug 15 01:09:07 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 01:09:07 user nova-compute[73010]:     </rng>
Aug 15 01:09:07 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 01:09:07 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 01:09:07 user nova-compute[73010]:       <stats period="10"/>
Aug 15 01:09:07 user nova-compute[73010]:     </memballoon>
Aug 15 01:09:07 user nova-compute[73010]:   </devices>
Aug 15 01:09:07 user nova-compute[73010]: </domain>
Aug 15 01:09:07 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 01:09:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:08:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1446601433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1446601433',id=52,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6db1cb9145b49999d0f102f8cfb867a',ramdisk_id='',reservation_id='r-51gycceg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T01:08:47Z,user_data=None,user_id='8e1e98c9bae145f0909011bb46c6e104',uuid=c36e629d-8dfa-4a10-becb-680c6fcb3939,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "address": "fa:16:3e:87:4b:88", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ae67fd-cf", "ovs_interfaceid": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 01:09:07 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converting VIF {"id": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "address": "fa:16:3e:87:4b:88", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ae67fd-cf", "ovs_interfaceid": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:09:07 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:4b:88,bridge_name='br-int',has_traffic_filtering=True,id=19ae67fd-cf2b-4ff0-af2e-94bbb231d96f,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ae67fd-cf') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:09:07 user nova-compute[73010]: DEBUG os_vif [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:4b:88,bridge_name='br-int',has_traffic_filtering=True,id=19ae67fd-cf2b-4ff0-af2e-94bbb231d96f,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ae67fd-cf') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 01:09:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:09:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 01:09:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19ae67fd-cf, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:09:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap19ae67fd-cf, col_values=(('external_ids', {'iface-id': '19ae67fd-cf2b-4ff0-af2e-94bbb231d96f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:4b:88', 'vm-uuid': 'c36e629d-8dfa-4a10-becb-680c6fcb3939'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:09:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:09:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:07 user nova-compute[73010]: INFO os_vif [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:4b:88,bridge_name='br-int',has_traffic_filtering=True,id=19ae67fd-cf2b-4ff0-af2e-94bbb231d96f,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ae67fd-cf')
Aug 15 01:09:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:09:08 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] No VIF found with MAC fa:16:3e:87:4b:88, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 01:09:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:09 user nova-compute[73010]: DEBUG nova.compute.manager [req-eb5632ec-1407-4994-a615-ecc38d5904bc req-28a10b3a-0243-4995-bea3-4e7272a44321 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received event network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:09:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-eb5632ec-1407-4994-a615-ecc38d5904bc req-28a10b3a-0243-4995-bea3-4e7272a44321 service nova] Acquiring lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:09:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-eb5632ec-1407-4994-a615-ecc38d5904bc req-28a10b3a-0243-4995-bea3-4e7272a44321 service nova] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:09:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-eb5632ec-1407-4994-a615-ecc38d5904bc req-28a10b3a-0243-4995-bea3-4e7272a44321 service nova] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:09:09 user nova-compute[73010]: DEBUG nova.compute.manager [req-eb5632ec-1407-4994-a615-ecc38d5904bc req-28a10b3a-0243-4995-bea3-4e7272a44321 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] No waiting events found dispatching network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:09:09 user nova-compute[73010]: WARNING nova.compute.manager [req-eb5632ec-1407-4994-a615-ecc38d5904bc req-28a10b3a-0243-4995-bea3-4e7272a44321 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received unexpected event network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f for instance with vm_state building and task_state spawning.
Aug 15 01:09:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:11 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061751.349795, c36e629d-8dfa-4a10-becb-680c6fcb3939 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:09:11 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] VM Resumed (Lifecycle Event)
Aug 15 01:09:11 user nova-compute[73010]: DEBUG nova.compute.manager [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 01:09:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 01:09:11 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Instance spawned successfully.
Aug 15 01:09:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 01:09:11 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:09:11 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:09:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:09:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:09:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:09:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:09:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:09:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:09:11 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 01:09:11 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061751.3506389, c36e629d-8dfa-4a10-becb-680c6fcb3939 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:09:11 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] VM Started (Lifecycle Event)
Aug 15 01:09:11 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:09:11 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:09:11 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 01:09:11 user nova-compute[73010]: INFO nova.compute.manager [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Took 5.00 seconds to spawn the instance on the hypervisor.
Aug 15 01:09:11 user nova-compute[73010]: DEBUG nova.compute.manager [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:09:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-e6993d63-4cdf-49f1-824f-827579b4c3e2 req-442900c7-8d32-4332-a9c8-39cc8aa0f5ba service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received event network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:09:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e6993d63-4cdf-49f1-824f-827579b4c3e2 req-442900c7-8d32-4332-a9c8-39cc8aa0f5ba service nova] Acquiring lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:09:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e6993d63-4cdf-49f1-824f-827579b4c3e2 req-442900c7-8d32-4332-a9c8-39cc8aa0f5ba service nova] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:09:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e6993d63-4cdf-49f1-824f-827579b4c3e2 req-442900c7-8d32-4332-a9c8-39cc8aa0f5ba service nova] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:09:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-e6993d63-4cdf-49f1-824f-827579b4c3e2 req-442900c7-8d32-4332-a9c8-39cc8aa0f5ba service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] No waiting events found dispatching network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:09:11 user nova-compute[73010]: WARNING nova.compute.manager [req-e6993d63-4cdf-49f1-824f-827579b4c3e2 req-442900c7-8d32-4332-a9c8-39cc8aa0f5ba service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received unexpected event network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f for instance with vm_state building and task_state spawning.
Aug 15 01:09:11 user nova-compute[73010]: INFO nova.compute.manager [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Took 25.47 seconds to build instance.
Aug 15 01:09:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-245031f0-2e24-4766-ad57-b3c4fec822b5 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.564s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:09:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:14 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:09:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:09:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:09:14 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:09:14 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:09:14 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:14 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:14 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:09:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:15 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:09:16 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:09:16 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:09:16 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8445MB free_disk=25.210514068603516GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:09:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:09:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:09:16 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance d79e3854-769c-430a-b980-3a551c7ee34d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:09:16 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 39a36324-d323-4169-abaa-09028eeb5598 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:09:16 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 2e7996e6-56fe-44b3-ad02-d17f7ddb358a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:09:16 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:09:16 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance c36e629d-8dfa-4a10-becb-680c6fcb3939 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:09:16 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:09:16 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:09:16 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Refreshing inventories for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 01:09:16 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Updating ProviderTree inventory for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 01:09:16 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Updating inventory in ProviderTree for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 01:09:16 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Refreshing aggregate associations for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e, aggregates: None {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 01:09:16 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Refreshing trait associations for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 01:09:16 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:09:16 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:09:16 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:09:16 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.642s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:09:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:19 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:09:19 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:09:20 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:09:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:09:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-2e7996e6-56fe-44b3-ad02-d17f7ddb358a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:09:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-2e7996e6-56fe-44b3-ad02-d17f7ddb358a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:09:20 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 01:09:21 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Updating instance_info_cache with network_info: [{"id": "3a41eecc-5993-483d-b86f-1d174df9d996", "address": "fa:16:3e:e6:d0:b5", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a41eecc-59", "ovs_interfaceid": "3a41eecc-5993-483d-b86f-1d174df9d996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:09:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-2e7996e6-56fe-44b3-ad02-d17f7ddb358a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:09:21 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 01:09:21 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:09:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:25 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:09:26 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:09:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:27 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:09:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fdcf9cf6-3b1b-47ce-8fb2-ab24d6cd6af8 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Acquiring lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:09:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fdcf9cf6-3b1b-47ce-8fb2-ab24d6cd6af8 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:09:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fdcf9cf6-3b1b-47ce-8fb2-ab24d6cd6af8 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Acquiring lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:09:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fdcf9cf6-3b1b-47ce-8fb2-ab24d6cd6af8 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:09:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fdcf9cf6-3b1b-47ce-8fb2-ab24d6cd6af8 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:09:27 user nova-compute[73010]: INFO nova.compute.manager [None req-fdcf9cf6-3b1b-47ce-8fb2-ab24d6cd6af8 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Terminating instance
Aug 15 01:09:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-fdcf9cf6-3b1b-47ce-8fb2-ab24d6cd6af8 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 01:09:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-c524e3d4-d0d9-46cd-92aa-a109f9e87b26 req-4e80e601-8d9e-408b-93ad-0af13a96b50a service nova] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Received event network-vif-unplugged-2cfaaa3f-bf6c-434f-88ac-28be01359fea {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:09:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c524e3d4-d0d9-46cd-92aa-a109f9e87b26 req-4e80e601-8d9e-408b-93ad-0af13a96b50a service nova] Acquiring lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:09:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c524e3d4-d0d9-46cd-92aa-a109f9e87b26 req-4e80e601-8d9e-408b-93ad-0af13a96b50a service nova] Lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:09:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c524e3d4-d0d9-46cd-92aa-a109f9e87b26 req-4e80e601-8d9e-408b-93ad-0af13a96b50a service nova] Lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:09:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-c524e3d4-d0d9-46cd-92aa-a109f9e87b26 req-4e80e601-8d9e-408b-93ad-0af13a96b50a service nova] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] No waiting events found dispatching network-vif-unplugged-2cfaaa3f-bf6c-434f-88ac-28be01359fea {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:09:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-c524e3d4-d0d9-46cd-92aa-a109f9e87b26 req-4e80e601-8d9e-408b-93ad-0af13a96b50a service nova] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Received event network-vif-unplugged-2cfaaa3f-bf6c-434f-88ac-28be01359fea for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 01:09:28 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:09:28 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:09:28 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Instance destroyed successfully.
Aug 15 01:09:28 user nova-compute[73010]: DEBUG nova.objects.instance [None req-fdcf9cf6-3b1b-47ce-8fb2-ab24d6cd6af8 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lazy-loading 'resources' on Instance uuid 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:09:28 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-fdcf9cf6-3b1b-47ce-8fb2-ab24d6cd6af8 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:06:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-345604593',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-345604593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3456045',id=51,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlwgpEOawKsZtWr9P3wx35slqEzX+/kN2UGZyXvj9T1gGPairYgJ2h6H55FU42Dw6VnaxONNxPSK9ZCeKtmUGqfVJBwGv3tXgYLSjugDp9kUOLUDE81vzDNc0wV5lGd8A==',key_name='tempest-keypair-753850628',keypairs=<?>,launch_index=0,launched_at=2023-08-15T01:06:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fa7253a229a49278b2c1cab2208d69a',ramdisk_id='',reservation_id='r-0jtj2x3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1980358928',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T01:06:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e676d54eb0ab46e1be9c3f89e03c4d1a',uuid=45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cfaaa3f-bf6c-434f-88ac-28be01359fea", "address": "fa:16:3e:0d:ad:e1", "network": {"id": "211a78cc-5fce-4fa9-abfe-70c5966402cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-525994571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fa7253a229a49278b2c1cab2208d69a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfaaa3f-bf", "ovs_interfaceid": "2cfaaa3f-bf6c-434f-88ac-28be01359fea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 01:09:28 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-fdcf9cf6-3b1b-47ce-8fb2-ab24d6cd6af8 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Converting VIF {"id": "2cfaaa3f-bf6c-434f-88ac-28be01359fea", "address": "fa:16:3e:0d:ad:e1", "network": {"id": "211a78cc-5fce-4fa9-abfe-70c5966402cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-525994571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fa7253a229a49278b2c1cab2208d69a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfaaa3f-bf", "ovs_interfaceid": "2cfaaa3f-bf6c-434f-88ac-28be01359fea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:09:28 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-fdcf9cf6-3b1b-47ce-8fb2-ab24d6cd6af8 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:ad:e1,bridge_name='br-int',has_traffic_filtering=True,id=2cfaaa3f-bf6c-434f-88ac-28be01359fea,network=Network(211a78cc-5fce-4fa9-abfe-70c5966402cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfaaa3f-bf') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:09:28 user nova-compute[73010]: DEBUG os_vif [None req-fdcf9cf6-3b1b-47ce-8fb2-ab24d6cd6af8 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:ad:e1,bridge_name='br-int',has_traffic_filtering=True,id=2cfaaa3f-bf6c-434f-88ac-28be01359fea,network=Network(211a78cc-5fce-4fa9-abfe-70c5966402cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfaaa3f-bf') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 01:09:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cfaaa3f-bf, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:09:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:09:28 user nova-compute[73010]: INFO os_vif [None req-fdcf9cf6-3b1b-47ce-8fb2-ab24d6cd6af8 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:ad:e1,bridge_name='br-int',has_traffic_filtering=True,id=2cfaaa3f-bf6c-434f-88ac-28be01359fea,network=Network(211a78cc-5fce-4fa9-abfe-70c5966402cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfaaa3f-bf')
Aug 15 01:09:28 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-fdcf9cf6-3b1b-47ce-8fb2-ab24d6cd6af8 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Deleting instance files /opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3_del
Aug 15 01:09:28 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-fdcf9cf6-3b1b-47ce-8fb2-ab24d6cd6af8 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Deletion of /opt/stack/data/nova/instances/45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3_del complete
Aug 15 01:09:28 user nova-compute[73010]: INFO nova.compute.manager [None req-fdcf9cf6-3b1b-47ce-8fb2-ab24d6cd6af8 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 15 01:09:28 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-fdcf9cf6-3b1b-47ce-8fb2-ab24d6cd6af8 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 01:09:28 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 01:09:28 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 01:09:29 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:09:29 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Took 0.98 seconds to deallocate network for instance.
Aug 15 01:09:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fdcf9cf6-3b1b-47ce-8fb2-ab24d6cd6af8 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:09:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fdcf9cf6-3b1b-47ce-8fb2-ab24d6cd6af8 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:09:29 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-fdcf9cf6-3b1b-47ce-8fb2-ab24d6cd6af8 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:09:29 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-fdcf9cf6-3b1b-47ce-8fb2-ab24d6cd6af8 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:09:29 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fdcf9cf6-3b1b-47ce-8fb2-ab24d6cd6af8 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:09:30 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-fdcf9cf6-3b1b-47ce-8fb2-ab24d6cd6af8 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Deleted allocations for instance 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3
Aug 15 01:09:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-fdcf9cf6-3b1b-47ce-8fb2-ab24d6cd6af8 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928 tempest-TestServerVolumeAttachScenarioOldVersion-1980358928-project-member] Lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.239s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:09:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-2f0bf5a7-e44c-4893-a8c9-15e30f6398a7 req-297a78e3-8bb7-4070-a5ea-35f7dbb20441 service nova] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Received event network-vif-plugged-2cfaaa3f-bf6c-434f-88ac-28be01359fea {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:09:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2f0bf5a7-e44c-4893-a8c9-15e30f6398a7 req-297a78e3-8bb7-4070-a5ea-35f7dbb20441 service nova] Acquiring lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:09:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2f0bf5a7-e44c-4893-a8c9-15e30f6398a7 req-297a78e3-8bb7-4070-a5ea-35f7dbb20441 service nova] Lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:09:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-2f0bf5a7-e44c-4893-a8c9-15e30f6398a7 req-297a78e3-8bb7-4070-a5ea-35f7dbb20441 service nova] Lock "45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:09:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-2f0bf5a7-e44c-4893-a8c9-15e30f6398a7 req-297a78e3-8bb7-4070-a5ea-35f7dbb20441 service nova] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] No waiting events found dispatching network-vif-plugged-2cfaaa3f-bf6c-434f-88ac-28be01359fea {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:09:30 user nova-compute[73010]: WARNING nova.compute.manager [req-2f0bf5a7-e44c-4893-a8c9-15e30f6398a7 req-297a78e3-8bb7-4070-a5ea-35f7dbb20441 service nova] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Received unexpected event network-vif-plugged-2cfaaa3f-bf6c-434f-88ac-28be01359fea for instance with vm_state deleted and task_state None.
Aug 15 01:09:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-2f0bf5a7-e44c-4893-a8c9-15e30f6398a7 req-297a78e3-8bb7-4070-a5ea-35f7dbb20441 service nova] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Received event network-vif-deleted-2cfaaa3f-bf6c-434f-88ac-28be01359fea {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:09:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "a54593fa-a252-4a33-8150-5269c8ce56bf" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:09:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:09:39 user nova-compute[73010]: INFO nova.compute.manager [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Unshelving
Aug 15 01:09:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:09:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:09:39 user nova-compute[73010]: DEBUG nova.objects.instance [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lazy-loading 'pci_requests' on Instance uuid a54593fa-a252-4a33-8150-5269c8ce56bf {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:09:39 user nova-compute[73010]: DEBUG nova.objects.instance [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lazy-loading 'numa_topology' on Instance uuid a54593fa-a252-4a33-8150-5269c8ce56bf {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:09:39 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 01:09:39 user nova-compute[73010]: INFO nova.compute.claims [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Claim successful on node user
Aug 15 01:09:40 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:09:40 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:09:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.286s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:09:40 user nova-compute[73010]: INFO nova.network.neutron [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Updating port 58ac448b-c375-4ef0-bae4-436351b80aec with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 01:09:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "refresh_cache-a54593fa-a252-4a33-8150-5269c8ce56bf" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:09:40 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquired lock "refresh_cache-a54593fa-a252-4a33-8150-5269c8ce56bf" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:09:40 user nova-compute[73010]: DEBUG nova.network.neutron [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 01:09:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-7e70d1f5-dfb2-478b-9a6a-cbd1c36ec3ca req-8c51a58d-c7cc-45c8-9e39-b6225729bad7 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Received event network-changed-58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:09:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-7e70d1f5-dfb2-478b-9a6a-cbd1c36ec3ca req-8c51a58d-c7cc-45c8-9e39-b6225729bad7 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Refreshing instance network info cache due to event network-changed-58ac448b-c375-4ef0-bae4-436351b80aec. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 01:09:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7e70d1f5-dfb2-478b-9a6a-cbd1c36ec3ca req-8c51a58d-c7cc-45c8-9e39-b6225729bad7 service nova] Acquiring lock "refresh_cache-a54593fa-a252-4a33-8150-5269c8ce56bf" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:09:41 user nova-compute[73010]: DEBUG nova.network.neutron [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Updating instance_info_cache with network_info: [{"id": "58ac448b-c375-4ef0-bae4-436351b80aec", "address": "fa:16:3e:e7:72:f7", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ac448b-c3", "ovs_interfaceid": "58ac448b-c375-4ef0-bae4-436351b80aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:09:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Releasing lock "refresh_cache-a54593fa-a252-4a33-8150-5269c8ce56bf" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:09:41 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 01:09:41 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Creating image(s)
Aug 15 01:09:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "/opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:09:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "/opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:09:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "/opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:09:41 user nova-compute[73010]: DEBUG nova.objects.instance [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lazy-loading 'trusted_certs' on Instance uuid a54593fa-a252-4a33-8150-5269c8ce56bf {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:09:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7e70d1f5-dfb2-478b-9a6a-cbd1c36ec3ca req-8c51a58d-c7cc-45c8-9e39-b6225729bad7 service nova] Acquired lock "refresh_cache-a54593fa-a252-4a33-8150-5269c8ce56bf" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:09:41 user nova-compute[73010]: DEBUG nova.network.neutron [req-7e70d1f5-dfb2-478b-9a6a-cbd1c36ec3ca req-8c51a58d-c7cc-45c8-9e39-b6225729bad7 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Refreshing network info cache for port 58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 01:09:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "592b50fc2e5f29ab658f491a388d8d07e64feb10" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:09:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "592b50fc2e5f29ab658f491a388d8d07e64feb10" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:09:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/592b50fc2e5f29ab658f491a388d8d07e64feb10.part --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/592b50fc2e5f29ab658f491a388d8d07e64feb10.part --force-share --output=json" returned: 0 in 0.186s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:42 user nova-compute[73010]: DEBUG nova.virt.images [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] 669d51a3-e00a-457d-9595-bf1b04048d47 was qcow2, converting to raw {{(pid=73010) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 01:09:42 user nova-compute[73010]: DEBUG nova.privsep.utils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73010) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 01:09:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/592b50fc2e5f29ab658f491a388d8d07e64feb10.part /opt/stack/data/nova/instances/_base/592b50fc2e5f29ab658f491a388d8d07e64feb10.converted {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:42 user nova-compute[73010]: DEBUG nova.network.neutron [req-7e70d1f5-dfb2-478b-9a6a-cbd1c36ec3ca req-8c51a58d-c7cc-45c8-9e39-b6225729bad7 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Updated VIF entry in instance network info cache for port 58ac448b-c375-4ef0-bae4-436351b80aec. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 01:09:42 user nova-compute[73010]: DEBUG nova.network.neutron [req-7e70d1f5-dfb2-478b-9a6a-cbd1c36ec3ca req-8c51a58d-c7cc-45c8-9e39-b6225729bad7 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Updating instance_info_cache with network_info: [{"id": "58ac448b-c375-4ef0-bae4-436351b80aec", "address": "fa:16:3e:e7:72:f7", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ac448b-c3", "ovs_interfaceid": "58ac448b-c375-4ef0-bae4-436351b80aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:09:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7e70d1f5-dfb2-478b-9a6a-cbd1c36ec3ca req-8c51a58d-c7cc-45c8-9e39-b6225729bad7 service nova] Releasing lock "refresh_cache-a54593fa-a252-4a33-8150-5269c8ce56bf" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:09:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/592b50fc2e5f29ab658f491a388d8d07e64feb10.part /opt/stack/data/nova/instances/_base/592b50fc2e5f29ab658f491a388d8d07e64feb10.converted" returned: 0 in 0.233s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/592b50fc2e5f29ab658f491a388d8d07e64feb10.converted --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/592b50fc2e5f29ab658f491a388d8d07e64feb10.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "592b50fc2e5f29ab658f491a388d8d07e64feb10" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.409s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:09:42 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/592b50fc2e5f29ab658f491a388d8d07e64feb10 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/592b50fc2e5f29ab658f491a388d8d07e64feb10 --force-share --output=json" returned: 0 in 0.178s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "592b50fc2e5f29ab658f491a388d8d07e64feb10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:09:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "592b50fc2e5f29ab658f491a388d8d07e64feb10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:09:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/592b50fc2e5f29ab658f491a388d8d07e64feb10 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/592b50fc2e5f29ab658f491a388d8d07e64feb10 --force-share --output=json" returned: 0 in 0.189s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/592b50fc2e5f29ab658f491a388d8d07e64feb10,backing_fmt=raw /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/592b50fc2e5f29ab658f491a388d8d07e64feb10,backing_fmt=raw /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk 1073741824" returned: 0 in 0.053s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "592b50fc2e5f29ab658f491a388d8d07e64feb10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:09:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/592b50fc2e5f29ab658f491a388d8d07e64feb10 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/592b50fc2e5f29ab658f491a388d8d07e64feb10 --force-share --output=json" returned: 0 in 0.179s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:43 user nova-compute[73010]: DEBUG nova.objects.instance [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lazy-loading 'migration_context' on Instance uuid a54593fa-a252-4a33-8150-5269c8ce56bf {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:09:43 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Rebasing disk image.
Aug 15 01:09:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:43 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692061768.6150308, 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:09:43 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] VM Stopped (Lifecycle Event)
Aug 15 01:09:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:43 user nova-compute[73010]: DEBUG nova.compute.manager [None req-521b1866-fa19-4b2a-8796-6ba2ee36b6c7 None None] [instance: 45bd2e7c-a56a-434f-b32a-ba2e1b7f51c3] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:09:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.181s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:43 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 -F raw /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 -F raw /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk" returned: 0 in 2.048s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Ensure instance console log exists: /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Start _get_guest_xml network_info=[{"id": "58ac448b-c375-4ef0-bae4-436351b80aec", "address": "fa:16:3e:e7:72:f7", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ac448b-c3", "ovs_interfaceid": "58ac448b-c375-4ef0-bae4-436351b80aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='879821227f0ed92acd444bc57fed19d7',container_format='bare',created_at=2023-08-15T01:07:47Z,direct_url=<?>,disk_format='qcow2',id=669d51a3-e00a-457d-9595-bf1b04048d47,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1051974814-shelved',owner='586bed330893488081bb21738b1a6ec4',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-15T01:07:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 01:09:45 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:09:45 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='879821227f0ed92acd444bc57fed19d7',container_format='bare',created_at=2023-08-15T01:07:47Z,direct_url=<?>,disk_format='qcow2',id=669d51a3-e00a-457d-9595-bf1b04048d47,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1051974814-shelved',owner='586bed330893488081bb21738b1a6ec4',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-15T01:07:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.objects.instance [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lazy-loading 'vcpu_model' on Instance uuid a54593fa-a252-4a33-8150-5269c8ce56bf {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T01:05:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1051974814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1051974814',id=50,image_ref='669d51a3-e00a-457d-9595-bf1b04048d47',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-485982673',keypairs=<?>,launch_index=0,launched_at=2023-08-15T01:05:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='586bed330893488081bb21738b1a6ec4',ramdisk_id='',reservation_id='r-vnnzzp3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-563974852',owner_user_name='tempest-AttachVolumeShelveTestJSON-563974852-project-member',shelved_at='2023-08-15T01:07:50.786283',shelved_host='user',shelved_image_id='669d51a3-e00a-457d-9595-bf1b04048d47'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T01:09:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c5655da76eb4671b4db00e086232f05',uuid=a54593fa-a252-4a33-8150-5269c8ce56bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "58ac448b-c375-4ef0-bae4-436351b80aec", "address": "fa:16:3e:e7:72:f7", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ac448b-c3", "ovs_interfaceid": "58ac448b-c375-4ef0-bae4-436351b80aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Converting VIF {"id": "58ac448b-c375-4ef0-bae4-436351b80aec", "address": "fa:16:3e:e7:72:f7", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ac448b-c3", "ovs_interfaceid": "58ac448b-c375-4ef0-bae4-436351b80aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:72:f7,bridge_name='br-int',has_traffic_filtering=True,id=58ac448b-c375-4ef0-bae4-436351b80aec,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ac448b-c3') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.objects.instance [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lazy-loading 'pci_devices' on Instance uuid a54593fa-a252-4a33-8150-5269c8ce56bf {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] End _get_guest_xml xml=<domain type="kvm">
Aug 15 01:09:45 user nova-compute[73010]:   <uuid>a54593fa-a252-4a33-8150-5269c8ce56bf</uuid>
Aug 15 01:09:45 user nova-compute[73010]:   <name>instance-00000032</name>
Aug 15 01:09:45 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 01:09:45 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 01:09:45 user nova-compute[73010]:   <metadata>
Aug 15 01:09:45 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 01:09:45 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 01:09:45 user nova-compute[73010]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1051974814</nova:name>
Aug 15 01:09:45 user nova-compute[73010]:       <nova:creationTime>2023-08-15 01:09:45</nova:creationTime>
Aug 15 01:09:45 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 01:09:45 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 01:09:45 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 01:09:45 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 01:09:45 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 01:09:45 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 01:09:45 user nova-compute[73010]:       </nova:flavor>
Aug 15 01:09:45 user nova-compute[73010]:       <nova:owner>
Aug 15 01:09:45 user nova-compute[73010]:         <nova:user uuid="0c5655da76eb4671b4db00e086232f05">tempest-AttachVolumeShelveTestJSON-563974852-project-member</nova:user>
Aug 15 01:09:45 user nova-compute[73010]:         <nova:project uuid="586bed330893488081bb21738b1a6ec4">tempest-AttachVolumeShelveTestJSON-563974852</nova:project>
Aug 15 01:09:45 user nova-compute[73010]:       </nova:owner>
Aug 15 01:09:45 user nova-compute[73010]:       <nova:root type="image" uuid="669d51a3-e00a-457d-9595-bf1b04048d47"/>
Aug 15 01:09:45 user nova-compute[73010]:       <nova:ports>
Aug 15 01:09:45 user nova-compute[73010]:         <nova:port uuid="58ac448b-c375-4ef0-bae4-436351b80aec">
Aug 15 01:09:45 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 01:09:45 user nova-compute[73010]:         </nova:port>
Aug 15 01:09:45 user nova-compute[73010]:       </nova:ports>
Aug 15 01:09:45 user nova-compute[73010]:     </nova:instance>
Aug 15 01:09:45 user nova-compute[73010]:   </metadata>
Aug 15 01:09:45 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 01:09:45 user nova-compute[73010]:     <system>
Aug 15 01:09:45 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 01:09:45 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 01:09:45 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 01:09:45 user nova-compute[73010]:       <entry name="serial">a54593fa-a252-4a33-8150-5269c8ce56bf</entry>
Aug 15 01:09:45 user nova-compute[73010]:       <entry name="uuid">a54593fa-a252-4a33-8150-5269c8ce56bf</entry>
Aug 15 01:09:45 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 01:09:45 user nova-compute[73010]:     </system>
Aug 15 01:09:45 user nova-compute[73010]:   </sysinfo>
Aug 15 01:09:45 user nova-compute[73010]:   <os>
Aug 15 01:09:45 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 01:09:45 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 01:09:45 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 01:09:45 user nova-compute[73010]:   </os>
Aug 15 01:09:45 user nova-compute[73010]:   <features>
Aug 15 01:09:45 user nova-compute[73010]:     <acpi/>
Aug 15 01:09:45 user nova-compute[73010]:     <apic/>
Aug 15 01:09:45 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 01:09:45 user nova-compute[73010]:   </features>
Aug 15 01:09:45 user nova-compute[73010]:   <clock offset="utc">
Aug 15 01:09:45 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 01:09:45 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 01:09:45 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 01:09:45 user nova-compute[73010]:   </clock>
Aug 15 01:09:45 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 01:09:45 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 01:09:45 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 01:09:45 user nova-compute[73010]:   </cpu>
Aug 15 01:09:45 user nova-compute[73010]:   <devices>
Aug 15 01:09:45 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 01:09:45 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 01:09:45 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk"/>
Aug 15 01:09:45 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 01:09:45 user nova-compute[73010]:     </disk>
Aug 15 01:09:45 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 01:09:45 user nova-compute[73010]:       <mac address="fa:16:3e:e7:72:f7"/>
Aug 15 01:09:45 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:09:45 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 01:09:45 user nova-compute[73010]:       <target dev="tap58ac448b-c3"/>
Aug 15 01:09:45 user nova-compute[73010]:     </interface>
Aug 15 01:09:45 user nova-compute[73010]:     <serial type="pty">
Aug 15 01:09:45 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/console.log" append="off"/>
Aug 15 01:09:45 user nova-compute[73010]:     </serial>
Aug 15 01:09:45 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 01:09:45 user nova-compute[73010]:     <video>
Aug 15 01:09:45 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:09:45 user nova-compute[73010]:     </video>
Aug 15 01:09:45 user nova-compute[73010]:     <rng model="virtio">
Aug 15 01:09:45 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 01:09:45 user nova-compute[73010]:     </rng>
Aug 15 01:09:45 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 01:09:45 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 01:09:45 user nova-compute[73010]:       <stats period="10"/>
Aug 15 01:09:45 user nova-compute[73010]:     </memballoon>
Aug 15 01:09:45 user nova-compute[73010]:   </devices>
Aug 15 01:09:45 user nova-compute[73010]: </domain>
Aug 15 01:09:45 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T01:05:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1051974814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1051974814',id=50,image_ref='669d51a3-e00a-457d-9595-bf1b04048d47',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-485982673',keypairs=<?>,launch_index=0,launched_at=2023-08-15T01:05:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='586bed330893488081bb21738b1a6ec4',ramdisk_id='',reservation_id='r-vnnzzp3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-563974852',owner_user_name='tempest-AttachVolumeShelveTestJSON-563974852-project-member',shelved_at='2023-08-15T01:07:50.786283',shelved_host='user',shelved_image_id='669d51a3-e00a-457d-9595-bf1b04048d47'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T01:09:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c5655da76eb4671b4db00e086232f05',uuid=a54593fa-a252-4a33-8150-5269c8ce56bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "58ac448b-c375-4ef0-bae4-436351b80aec", "address": "fa:16:3e:e7:72:f7", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ac448b-c3", "ovs_interfaceid": "58ac448b-c375-4ef0-bae4-436351b80aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Converting VIF {"id": "58ac448b-c375-4ef0-bae4-436351b80aec", "address": "fa:16:3e:e7:72:f7", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ac448b-c3", "ovs_interfaceid": "58ac448b-c375-4ef0-bae4-436351b80aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:72:f7,bridge_name='br-int',has_traffic_filtering=True,id=58ac448b-c375-4ef0-bae4-436351b80aec,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ac448b-c3') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG os_vif [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:72:f7,bridge_name='br-int',has_traffic_filtering=True,id=58ac448b-c375-4ef0-bae4-436351b80aec,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ac448b-c3') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58ac448b-c3, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap58ac448b-c3, col_values=(('external_ids', {'iface-id': '58ac448b-c375-4ef0-bae4-436351b80aec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:72:f7', 'vm-uuid': 'a54593fa-a252-4a33-8150-5269c8ce56bf'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:09:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:45 user nova-compute[73010]: INFO os_vif [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:72:f7,bridge_name='br-int',has_traffic_filtering=True,id=58ac448b-c375-4ef0-bae4-436351b80aec,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ac448b-c3')
Aug 15 01:09:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:09:46 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] No VIF found with MAC fa:16:3e:e7:72:f7, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 01:09:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:47 user nova-compute[73010]: DEBUG nova.compute.manager [req-925f2e0c-0a6e-400d-a33e-54b10b47e988 req-bc367ff5-4e1e-46e7-8bc6-34a243068107 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Received event network-vif-plugged-58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:09:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-925f2e0c-0a6e-400d-a33e-54b10b47e988 req-bc367ff5-4e1e-46e7-8bc6-34a243068107 service nova] Acquiring lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:09:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-925f2e0c-0a6e-400d-a33e-54b10b47e988 req-bc367ff5-4e1e-46e7-8bc6-34a243068107 service nova] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:09:47 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-925f2e0c-0a6e-400d-a33e-54b10b47e988 req-bc367ff5-4e1e-46e7-8bc6-34a243068107 service nova] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:09:47 user nova-compute[73010]: DEBUG nova.compute.manager [req-925f2e0c-0a6e-400d-a33e-54b10b47e988 req-bc367ff5-4e1e-46e7-8bc6-34a243068107 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] No waiting events found dispatching network-vif-plugged-58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:09:47 user nova-compute[73010]: WARNING nova.compute.manager [req-925f2e0c-0a6e-400d-a33e-54b10b47e988 req-bc367ff5-4e1e-46e7-8bc6-34a243068107 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Received unexpected event network-vif-plugged-58ac448b-c375-4ef0-bae4-436351b80aec for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 01:09:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:49 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061789.3605907, a54593fa-a252-4a33-8150-5269c8ce56bf => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:09:49 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] VM Resumed (Lifecycle Event)
Aug 15 01:09:49 user nova-compute[73010]: DEBUG nova.compute.manager [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 01:09:49 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 01:09:49 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Instance spawned successfully.
Aug 15 01:09:49 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:09:49 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:09:49 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 01:09:49 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061789.3620374, a54593fa-a252-4a33-8150-5269c8ce56bf => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:09:49 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] VM Started (Lifecycle Event)
Aug 15 01:09:49 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:09:49 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:09:49 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 01:09:49 user nova-compute[73010]: DEBUG nova.compute.manager [req-8cdb352a-cbc3-496f-9d19-4a29d6800acc req-943864f1-547e-4ad0-9394-8a8a92923ce7 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Received event network-vif-plugged-58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:09:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-8cdb352a-cbc3-496f-9d19-4a29d6800acc req-943864f1-547e-4ad0-9394-8a8a92923ce7 service nova] Acquiring lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:09:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-8cdb352a-cbc3-496f-9d19-4a29d6800acc req-943864f1-547e-4ad0-9394-8a8a92923ce7 service nova] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:09:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-8cdb352a-cbc3-496f-9d19-4a29d6800acc req-943864f1-547e-4ad0-9394-8a8a92923ce7 service nova] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:09:49 user nova-compute[73010]: DEBUG nova.compute.manager [req-8cdb352a-cbc3-496f-9d19-4a29d6800acc req-943864f1-547e-4ad0-9394-8a8a92923ce7 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] No waiting events found dispatching network-vif-plugged-58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:09:49 user nova-compute[73010]: WARNING nova.compute.manager [req-8cdb352a-cbc3-496f-9d19-4a29d6800acc req-943864f1-547e-4ad0-9394-8a8a92923ce7 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Received unexpected event network-vif-plugged-58ac448b-c375-4ef0-bae4-436351b80aec for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 01:09:49 user nova-compute[73010]: DEBUG nova.compute.manager [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:09:49 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-e4796e32-bd45-45dc-a349-2acdd4bf0933 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 9.936s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:09:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:09:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:10:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:10:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:10:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:10:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:10:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:15 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:10:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:10:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:10:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:10:15 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:10:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:10:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:10:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:10:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:10:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:10:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:10:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:10:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:10:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:10:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:10:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:10:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:10:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:10:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:10:17 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:10:17 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:10:17 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8314MB free_disk=25.211776733398438GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:10:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:10:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:10:17 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance d79e3854-769c-430a-b980-3a551c7ee34d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:10:17 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 39a36324-d323-4169-abaa-09028eeb5598 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:10:17 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 2e7996e6-56fe-44b3-ad02-d17f7ddb358a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:10:17 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance c36e629d-8dfa-4a10-becb-680c6fcb3939 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:10:17 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance a54593fa-a252-4a33-8150-5269c8ce56bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:10:17 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:10:17 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:10:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:17 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:10:17 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:10:17 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:10:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:10:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:19 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:10:19 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:10:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:21 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:10:21 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:10:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-a54593fa-a252-4a33-8150-5269c8ce56bf" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:10:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-a54593fa-a252-4a33-8150-5269c8ce56bf" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:10:21 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 01:10:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:22 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Updating instance_info_cache with network_info: [{"id": "58ac448b-c375-4ef0-bae4-436351b80aec", "address": "fa:16:3e:e7:72:f7", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ac448b-c3", "ovs_interfaceid": "58ac448b-c375-4ef0-bae4-436351b80aec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:10:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-a54593fa-a252-4a33-8150-5269c8ce56bf" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:10:22 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 01:10:23 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:10:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:26 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:10:27 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:10:28 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:10:29 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:10:29 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:10:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:10:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:10:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:10:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:10:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:10:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:10:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:10:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:10:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:36 user nova-compute[73010]: INFO nova.compute.manager [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Rescuing
Aug 15 01:10:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "refresh_cache-c36e629d-8dfa-4a10-becb-680c6fcb3939" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:10:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquired lock "refresh_cache-c36e629d-8dfa-4a10-becb-680c6fcb3939" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:10:36 user nova-compute[73010]: DEBUG nova.network.neutron [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 01:10:37 user nova-compute[73010]: DEBUG nova.network.neutron [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Updating instance_info_cache with network_info: [{"id": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "address": "fa:16:3e:87:4b:88", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ae67fd-cf", "ovs_interfaceid": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:10:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Releasing lock "refresh_cache-c36e629d-8dfa-4a10-becb-680c6fcb3939" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:10:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:37 user nova-compute[73010]: DEBUG nova.compute.manager [req-7ebbdebe-e4ce-49fb-b02c-4a6c0d7abba9 req-8b771360-f87c-40f3-a4dd-bd432424958a service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received event network-vif-unplugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:10:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7ebbdebe-e4ce-49fb-b02c-4a6c0d7abba9 req-8b771360-f87c-40f3-a4dd-bd432424958a service nova] Acquiring lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:10:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7ebbdebe-e4ce-49fb-b02c-4a6c0d7abba9 req-8b771360-f87c-40f3-a4dd-bd432424958a service nova] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:10:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-7ebbdebe-e4ce-49fb-b02c-4a6c0d7abba9 req-8b771360-f87c-40f3-a4dd-bd432424958a service nova] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:10:37 user nova-compute[73010]: DEBUG nova.compute.manager [req-7ebbdebe-e4ce-49fb-b02c-4a6c0d7abba9 req-8b771360-f87c-40f3-a4dd-bd432424958a service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] No waiting events found dispatching network-vif-unplugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:10:37 user nova-compute[73010]: WARNING nova.compute.manager [req-7ebbdebe-e4ce-49fb-b02c-4a6c0d7abba9 req-8b771360-f87c-40f3-a4dd-bd432424958a service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received unexpected event network-vif-unplugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f for instance with vm_state active and task_state rescuing.
Aug 15 01:10:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:37 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Instance destroyed successfully.
Aug 15 01:10:37 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Attempting a stable device rescue
Aug 15 01:10:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73010) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 01:10:38 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Instance directory exists: not creating {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 01:10:38 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Creating image(s)
Aug 15 01:10:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "/opt/stack/data/nova/instances/c36e629d-8dfa-4a10-becb-680c6fcb3939/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:10:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "/opt/stack/data/nova/instances/c36e629d-8dfa-4a10-becb-680c6fcb3939/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:10:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "/opt/stack/data/nova/instances/c36e629d-8dfa-4a10-becb-680c6fcb3939/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:10:38 user nova-compute[73010]: DEBUG nova.objects.instance [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lazy-loading 'trusted_certs' on Instance uuid c36e629d-8dfa-4a10-becb-680c6fcb3939 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:10:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "64b61921c005b49cddebebd03dfb3bb53850cac0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:10:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "64b61921c005b49cddebebd03dfb3bb53850cac0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:10:38 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64b61921c005b49cddebebd03dfb3bb53850cac0.part --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64b61921c005b49cddebebd03dfb3bb53850cac0.part --force-share --output=json" returned: 0 in 0.202s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.virt.images [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] 5d8b806b-f9c5-4029-ac0e-15f37e38fcb4 was qcow2, converting to raw {{(pid=73010) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.privsep.utils [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73010) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/64b61921c005b49cddebebd03dfb3bb53850cac0.part /opt/stack/data/nova/instances/_base/64b61921c005b49cddebebd03dfb3bb53850cac0.converted {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/64b61921c005b49cddebebd03dfb3bb53850cac0.part /opt/stack/data/nova/instances/_base/64b61921c005b49cddebebd03dfb3bb53850cac0.converted" returned: 0 in 0.230s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64b61921c005b49cddebebd03dfb3bb53850cac0.converted --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.compute.manager [req-efa50962-4f7c-4e38-9c37-d95bba7f7990 req-dfbcd590-2a0b-4df8-8f1d-d04b32c391c9 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received event network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-efa50962-4f7c-4e38-9c37-d95bba7f7990 req-dfbcd590-2a0b-4df8-8f1d-d04b32c391c9 service nova] Acquiring lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-efa50962-4f7c-4e38-9c37-d95bba7f7990 req-dfbcd590-2a0b-4df8-8f1d-d04b32c391c9 service nova] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-efa50962-4f7c-4e38-9c37-d95bba7f7990 req-dfbcd590-2a0b-4df8-8f1d-d04b32c391c9 service nova] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.compute.manager [req-efa50962-4f7c-4e38-9c37-d95bba7f7990 req-dfbcd590-2a0b-4df8-8f1d-d04b32c391c9 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] No waiting events found dispatching network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:10:39 user nova-compute[73010]: WARNING nova.compute.manager [req-efa50962-4f7c-4e38-9c37-d95bba7f7990 req-dfbcd590-2a0b-4df8-8f1d-d04b32c391c9 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received unexpected event network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f for instance with vm_state active and task_state rescuing.
Aug 15 01:10:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64b61921c005b49cddebebd03dfb3bb53850cac0.converted --force-share --output=json" returned: 0 in 0.229s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "64b61921c005b49cddebebd03dfb3bb53850cac0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.575s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "64b61921c005b49cddebebd03dfb3bb53850cac0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "64b61921c005b49cddebebd03dfb3bb53850cac0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64b61921c005b49cddebebd03dfb3bb53850cac0 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64b61921c005b49cddebebd03dfb3bb53850cac0 --force-share --output=json" returned: 0 in 0.188s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/64b61921c005b49cddebebd03dfb3bb53850cac0,backing_fmt=raw /opt/stack/data/nova/instances/c36e629d-8dfa-4a10-becb-680c6fcb3939/disk.rescue {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/64b61921c005b49cddebebd03dfb3bb53850cac0,backing_fmt=raw /opt/stack/data/nova/instances/c36e629d-8dfa-4a10-becb-680c6fcb3939/disk.rescue" returned: 0 in 0.073s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "64b61921c005b49cddebebd03dfb3bb53850cac0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.objects.instance [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lazy-loading 'migration_context' on Instance uuid c36e629d-8dfa-4a10-becb-680c6fcb3939 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Start _get_guest_xml network_info=[{"id": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "address": "fa:16:3e:87:4b:88", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "vif_mac": "fa:16:3e:87:4b:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ae67fd-cf", "ovs_interfaceid": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5d8b806b-f9c5-4029-ac0e-15f37e38fcb4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'usSfpKNt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'c36e629d-8dfa-4a10-becb-680c6fcb3939', 'attached_at': '', 'detached_at': '', 'volume_id': '35087b75-844e-4ec1-9091-2433e930f07f', 'serial': '35087b75-844e-4ec1-9091-2433e930f07f'}, 'disk_bus': 'virtio', 'attachment_id': '71fd5762-d006-4e34-a4a1-a9931909ebc6', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.objects.instance [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lazy-loading 'resources' on Instance uuid c36e629d-8dfa-4a10-becb-680c6fcb3939 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.objects.instance [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lazy-loading 'numa_topology' on Instance uuid c36e629d-8dfa-4a10-becb-680c6fcb3939 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:10:39 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:10:39 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 01:10:39 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG nova.objects.instance [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lazy-loading 'vcpu_model' on Instance uuid c36e629d-8dfa-4a10-becb-680c6fcb3939 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'usSfpKNt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:10:40 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:10:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:10:40 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:10:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:10:40 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 01:10:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5371873-1653-4d4c-9d1b-f664cf1f7ef0]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = usSfpKNt\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 01:10:40 user nova-compute[73010]: node.name = iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f
Aug 15 01:10:40 user nova-compute[73010]: node.tpgt = -1
Aug 15 01:10:40 user nova-compute[73010]: node.startup = automatic
Aug 15 01:10:40 user nova-compute[73010]: node.leading_login = No
Aug 15 01:10:40 user nova-compute[73010]: iface.iscsi_ifacename = default
Aug 15 01:10:40 user nova-compute[73010]: iface.net_ifacename = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.ipaddress = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.prefix_len = 0
Aug 15 01:10:40 user nova-compute[73010]: iface.hwaddress = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.transport_name = tcp
Aug 15 01:10:40 user nova-compute[73010]: iface.initiatorname = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.state = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.vlan_id = 0
Aug 15 01:10:40 user nova-compute[73010]: iface.vlan_priority = 0
Aug 15 01:10:40 user nova-compute[73010]: iface.vlan_state = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.iface_num = 0
Aug 15 01:10:40 user nova-compute[73010]: iface.mtu = 0
Aug 15 01:10:40 user nova-compute[73010]: iface.port = 0
Aug 15 01:10:40 user nova-compute[73010]: iface.bootproto = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.subnet_mask = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.gateway = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.dhcp_alt_client_id = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.dhcp_dns = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.dhcp_learn_iqn = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.dhcp_vendor_id_state = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.dhcp_vendor_id = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.dhcp_slp_da = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.fragmentation = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.gratuitous_arp = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.incoming_forwarding = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.tos_state = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.tos = 0
Aug 15 01:10:40 user nova-compute[73010]: iface.ttl = 0
Aug 15 01:10:40 user nova-compute[73010]: iface.delayed_ack = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.tcp_nagle = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.tcp_wsf_state = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.tcp_wsf = 0
Aug 15 01:10:40 user nova-compute[73010]: iface.tcp_timer_scale = 0
Aug 15 01:10:40 user nova-compute[73010]: iface.tcp_timestamp = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.redirect = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.def_task_mgmt_timeout = 0
Aug 15 01:10:40 user nova-compute[73010]: iface.header_digest = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.data_digest = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.immediate_data = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.initial_r2t = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.data_seq_inorder = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.data_pdu_inorder = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.erl = 0
Aug 15 01:10:40 user nova-compute[73010]: iface.max_receive_data_len = 0
Aug 15 01:10:40 user nova-compute[73010]: iface.first_burst_len = 0
Aug 15 01:10:40 user nova-compute[73010]: iface.max_outstanding_r2t = 0
Aug 15 01:10:40 user nova-compute[73010]: iface.max_burst_len = 0
Aug 15 01:10:40 user nova-compute[73010]: iface.chap_auth = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.bidi_chap = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.strict_login_compliance = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.discovery_auth = <empty>
Aug 15 01:10:40 user nova-compute[73010]: iface.discovery_logout = <empty>
Aug 15 01:10:40 user nova-compute[73010]: node.discovery_address = <empty>
Aug 15 01:10:40 user nova-compute[73010]: node.discovery_port = 0
Aug 15 01:10:40 user nova-compute[73010]: node.discovery_type = static
Aug 15 01:10:40 user nova-compute[73010]: node.session.initial_cmdsn = 0
Aug 15 01:10:40 user nova-compute[73010]: node.session.initial_login_retry_max = 8
Aug 15 01:10:40 user nova-compute[73010]: node.session.xmit_thread_priority = -20
Aug 15 01:10:40 user nova-compute[73010]: node.session.cmds_max = 128
Aug 15 01:10:40 user nova-compute[73010]: node.session.queue_depth = 32
Aug 15 01:10:40 user nova-compute[73010]: node.session.nr_sessions = 1
Aug 15 01:10:40 user nova-compute[73010]: node.session.auth.authmethod = CHAP
Aug 15 01:10:40 user nova-compute[73010]: node.session.auth.username = usSfpKNt
Aug 15 01:10:40 user nova-compute[73010]: node.session.auth.password = ***
Aug 15 01:10:40 user nova-compute[73010]: node.session.auth.username_in = <empty>
Aug 15 01:10:40 user nova-compute[73010]: node.session.auth.password_in = <empty>
Aug 15 01:10:40 user nova-compute[73010]: node.session.auth.chap_algs = MD5
Aug 15 01:10:40 user nova-compute[73010]: node.session.timeo.replacement_timeout = 120
Aug 15 01:10:40 user nova-compute[73010]: node.session.err_timeo.abort_timeout = 15
Aug 15 01:10:40 user nova-compute[73010]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 01:10:40 user nova-compute[73010]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 01:10:40 user nova-compute[73010]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 01:10:40 user nova-compute[73010]: node.session.iscsi.FastAbort = Yes
Aug 15 01:10:40 user nova-compute[73010]: node.session.iscsi.InitialR2T = No
Aug 15 01:10:40 user nova-compute[73010]: node.session.iscsi.ImmediateData = Yes
Aug 15 01:10:40 user nova-compute[73010]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 01:10:40 user nova-compute[73010]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 01:10:40 user nova-compute[73010]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 01:10:40 user nova-compute[73010]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 01:10:40 user nova-compute[73010]: node.session.iscsi.MaxConnections = 1
Aug 15 01:10:40 user nova-compute[73010]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 01:10:40 user nova-compute[73010]: node.session.iscsi.ERL = 0
Aug 15 01:10:40 user nova-compute[73010]: node.session.scan = manual
Aug 15 01:10:40 user nova-compute[73010]: node.session.reopen_max = 0
Aug 15 01:10:40 user nova-compute[73010]: node.conn[0].address = 172.16.0.220
Aug 15 01:10:40 user nova-compute[73010]: node.conn[0].port = 3260
Aug 15 01:10:40 user nova-compute[73010]: node.conn[0].startup = manual
Aug 15 01:10:40 user nova-compute[73010]: node.conn[0].tcp.window_size = 524288
Aug 15 01:10:40 user nova-compute[73010]: node.conn[0].tcp.type_of_service = 0
Aug 15 01:10:40 user nova-compute[73010]: node.conn[0].timeo.logout_timeout = 15
Aug 15 01:10:40 user nova-compute[73010]: node.conn[0].timeo.login_timeout = 15
Aug 15 01:10:40 user nova-compute[73010]: node.conn[0].timeo.auth_timeout = 45
Aug 15 01:10:40 user nova-compute[73010]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 01:10:40 user nova-compute[73010]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 01:10:40 user nova-compute[73010]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 01:10:40 user nova-compute[73010]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 01:10:40 user nova-compute[73010]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 01:10:40 user nova-compute[73010]: node.conn[0].iscsi.DataDigest = None
Aug 15 01:10:40 user nova-compute[73010]: node.conn[0].iscsi.IFMarker = No
Aug 15 01:10:40 user nova-compute[73010]: node.conn[0].iscsi.OFMarker = No
Aug 15 01:10:40 user nova-compute[73010]: # END RECORD
Aug 15 01:10:40 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1bd82e-e9de-4ccf-9afd-9b752d34fcf3]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e034d3f8-ecbb-445c-8292-5a0620bcee97]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v usSfpKNt {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v usSfpKNt" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df449de-d7ab-4648-b8a0-d9452d5c2006]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'usSfpKNt'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b011e3-c9be-4409-b221-15a6f5400203]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dace6e50-67e9-4571-90d5-5bb1fb492cbd]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:10:40 user nova-compute[73010]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f (non-flash)
Aug 15 01:10:40 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:10:40 user nova-compute[73010]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f (non-flash)
Aug 15 01:10:40 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.140s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] HCTL ('33', '0', '0', 0) found on session 62 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[337de845-fcad-495a-9f62-bc9283b59ae3]: (4, ('0 0 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Searching for a device in session 62 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'usSfpKNt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.166s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] <== connect_volume: return (167ms) {'type': 'block', 'scsi_wwn': '23639323330333232', 'path': '/dev/sdb'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639323330333232', 'path': '/dev/sdb'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:08:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1446601433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1446601433',id=52,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T01:09:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6db1cb9145b49999d0f102f8cfb867a',ramdisk_id='',reservation_id='r-51gycceg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T01:09:12Z,user_data=None,user_id='8e1e98c9bae145f0909011bb46c6e104',uuid=c36e629d-8dfa-4a10-becb-680c6fcb3939,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "address": "fa:16:3e:87:4b:88", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "vif_mac": "fa:16:3e:87:4b:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ae67fd-cf", "ovs_interfaceid": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converting VIF {"id": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "address": "fa:16:3e:87:4b:88", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "vif_mac": "fa:16:3e:87:4b:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ae67fd-cf", "ovs_interfaceid": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:4b:88,bridge_name='br-int',has_traffic_filtering=True,id=19ae67fd-cf2b-4ff0-af2e-94bbb231d96f,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ae67fd-cf') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG nova.objects.instance [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lazy-loading 'pci_devices' on Instance uuid c36e629d-8dfa-4a10-becb-680c6fcb3939 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] End _get_guest_xml xml=<domain type="kvm">
Aug 15 01:10:40 user nova-compute[73010]:   <uuid>c36e629d-8dfa-4a10-becb-680c6fcb3939</uuid>
Aug 15 01:10:40 user nova-compute[73010]:   <name>instance-00000034</name>
Aug 15 01:10:40 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 01:10:40 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 01:10:40 user nova-compute[73010]:   <metadata>
Aug 15 01:10:40 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 01:10:40 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 01:10:40 user nova-compute[73010]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1446601433</nova:name>
Aug 15 01:10:40 user nova-compute[73010]:       <nova:creationTime>2023-08-15 01:10:39</nova:creationTime>
Aug 15 01:10:40 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 01:10:40 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 01:10:40 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 01:10:40 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 01:10:40 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 01:10:40 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 01:10:40 user nova-compute[73010]:       </nova:flavor>
Aug 15 01:10:40 user nova-compute[73010]:       <nova:owner>
Aug 15 01:10:40 user nova-compute[73010]:         <nova:user uuid="8e1e98c9bae145f0909011bb46c6e104">tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member</nova:user>
Aug 15 01:10:40 user nova-compute[73010]:         <nova:project uuid="f6db1cb9145b49999d0f102f8cfb867a">tempest-ServerBootFromVolumeStableRescueTest-1758225981</nova:project>
Aug 15 01:10:40 user nova-compute[73010]:       </nova:owner>
Aug 15 01:10:40 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 01:10:40 user nova-compute[73010]:       <nova:ports>
Aug 15 01:10:40 user nova-compute[73010]:         <nova:port uuid="19ae67fd-cf2b-4ff0-af2e-94bbb231d96f">
Aug 15 01:10:40 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 01:10:40 user nova-compute[73010]:         </nova:port>
Aug 15 01:10:40 user nova-compute[73010]:       </nova:ports>
Aug 15 01:10:40 user nova-compute[73010]:     </nova:instance>
Aug 15 01:10:40 user nova-compute[73010]:   </metadata>
Aug 15 01:10:40 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 01:10:40 user nova-compute[73010]:     <system>
Aug 15 01:10:40 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 01:10:40 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 01:10:40 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 01:10:40 user nova-compute[73010]:       <entry name="serial">c36e629d-8dfa-4a10-becb-680c6fcb3939</entry>
Aug 15 01:10:40 user nova-compute[73010]:       <entry name="uuid">c36e629d-8dfa-4a10-becb-680c6fcb3939</entry>
Aug 15 01:10:40 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 01:10:40 user nova-compute[73010]:     </system>
Aug 15 01:10:40 user nova-compute[73010]:   </sysinfo>
Aug 15 01:10:40 user nova-compute[73010]:   <os>
Aug 15 01:10:40 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 01:10:40 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 01:10:40 user nova-compute[73010]:   </os>
Aug 15 01:10:40 user nova-compute[73010]:   <features>
Aug 15 01:10:40 user nova-compute[73010]:     <acpi/>
Aug 15 01:10:40 user nova-compute[73010]:     <apic/>
Aug 15 01:10:40 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 01:10:40 user nova-compute[73010]:   </features>
Aug 15 01:10:40 user nova-compute[73010]:   <clock offset="utc">
Aug 15 01:10:40 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 01:10:40 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 01:10:40 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 01:10:40 user nova-compute[73010]:   </clock>
Aug 15 01:10:40 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 01:10:40 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 01:10:40 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 01:10:40 user nova-compute[73010]:   </cpu>
Aug 15 01:10:40 user nova-compute[73010]:   <devices>
Aug 15 01:10:40 user nova-compute[73010]:     <disk type="block" device="disk">
Aug 15 01:10:40 user nova-compute[73010]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:10:40 user nova-compute[73010]:       <source dev="/dev/sdb"/>
Aug 15 01:10:40 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 01:10:40 user nova-compute[73010]:       <serial>35087b75-844e-4ec1-9091-2433e930f07f</serial>
Aug 15 01:10:40 user nova-compute[73010]:     </disk>
Aug 15 01:10:40 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 01:10:40 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 01:10:40 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/c36e629d-8dfa-4a10-becb-680c6fcb3939/disk.rescue"/>
Aug 15 01:10:40 user nova-compute[73010]:       <target dev="vdb" bus="virtio"/>
Aug 15 01:10:40 user nova-compute[73010]:       <boot order="1"/>
Aug 15 01:10:40 user nova-compute[73010]:     </disk>
Aug 15 01:10:40 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 01:10:40 user nova-compute[73010]:       <mac address="fa:16:3e:87:4b:88"/>
Aug 15 01:10:40 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:10:40 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 01:10:40 user nova-compute[73010]:       <target dev="tap19ae67fd-cf"/>
Aug 15 01:10:40 user nova-compute[73010]:     </interface>
Aug 15 01:10:40 user nova-compute[73010]:     <serial type="pty">
Aug 15 01:10:40 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/c36e629d-8dfa-4a10-becb-680c6fcb3939/console.log" append="off"/>
Aug 15 01:10:40 user nova-compute[73010]:     </serial>
Aug 15 01:10:40 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 01:10:40 user nova-compute[73010]:     <video>
Aug 15 01:10:40 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:10:40 user nova-compute[73010]:     </video>
Aug 15 01:10:40 user nova-compute[73010]:     <rng model="virtio">
Aug 15 01:10:40 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 01:10:40 user nova-compute[73010]:     </rng>
Aug 15 01:10:40 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 01:10:40 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 01:10:40 user nova-compute[73010]:       <stats period="10"/>
Aug 15 01:10:40 user nova-compute[73010]:     </memballoon>
Aug 15 01:10:40 user nova-compute[73010]:   </devices>
Aug 15 01:10:40 user nova-compute[73010]: </domain>
Aug 15 01:10:40 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 01:10:40 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Instance destroyed successfully.
Aug 15 01:10:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] No VIF found with MAC fa:16:3e:87:4b:88, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 01:10:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-e007d523-ea95-4347-bfb1-db4b72af4834 req-a5dfe1de-e693-490d-8527-ec1bbc0f1758 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received event network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:10:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e007d523-ea95-4347-bfb1-db4b72af4834 req-a5dfe1de-e693-490d-8527-ec1bbc0f1758 service nova] Acquiring lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:10:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e007d523-ea95-4347-bfb1-db4b72af4834 req-a5dfe1de-e693-490d-8527-ec1bbc0f1758 service nova] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:10:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-e007d523-ea95-4347-bfb1-db4b72af4834 req-a5dfe1de-e693-490d-8527-ec1bbc0f1758 service nova] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:10:41 user nova-compute[73010]: DEBUG nova.compute.manager [req-e007d523-ea95-4347-bfb1-db4b72af4834 req-a5dfe1de-e693-490d-8527-ec1bbc0f1758 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] No waiting events found dispatching network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:10:41 user nova-compute[73010]: WARNING nova.compute.manager [req-e007d523-ea95-4347-bfb1-db4b72af4834 req-a5dfe1de-e693-490d-8527-ec1bbc0f1758 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received unexpected event network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f for instance with vm_state active and task_state rescuing.
Aug 15 01:10:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:10:43 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Removed pending event for c36e629d-8dfa-4a10-becb-680c6fcb3939 due to event {{(pid=73010) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 01:10:43 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061843.6874535, c36e629d-8dfa-4a10-becb-680c6fcb3939 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:10:43 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] VM Resumed (Lifecycle Event)
Aug 15 01:10:43 user nova-compute[73010]: DEBUG nova.compute.manager [None req-846614e7-019d-4893-b1c7-cd77f58d6279 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:10:43 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:10:43 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:10:43 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 01:10:43 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061843.6891847, c36e629d-8dfa-4a10-becb-680c6fcb3939 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:10:43 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] VM Started (Lifecycle Event)
Aug 15 01:10:43 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:10:43 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:10:44 user nova-compute[73010]: DEBUG nova.compute.manager [req-d0bbc30c-a614-4f3d-a93e-324524ec25c2 req-1900b3e8-ac4c-4da2-a89a-940ab4b23f11 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received event network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:10:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d0bbc30c-a614-4f3d-a93e-324524ec25c2 req-1900b3e8-ac4c-4da2-a89a-940ab4b23f11 service nova] Acquiring lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:10:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d0bbc30c-a614-4f3d-a93e-324524ec25c2 req-1900b3e8-ac4c-4da2-a89a-940ab4b23f11 service nova] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:10:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d0bbc30c-a614-4f3d-a93e-324524ec25c2 req-1900b3e8-ac4c-4da2-a89a-940ab4b23f11 service nova] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:10:44 user nova-compute[73010]: DEBUG nova.compute.manager [req-d0bbc30c-a614-4f3d-a93e-324524ec25c2 req-1900b3e8-ac4c-4da2-a89a-940ab4b23f11 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] No waiting events found dispatching network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:10:44 user nova-compute[73010]: WARNING nova.compute.manager [req-d0bbc30c-a614-4f3d-a93e-324524ec25c2 req-1900b3e8-ac4c-4da2-a89a-940ab4b23f11 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received unexpected event network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f for instance with vm_state rescued and task_state None.
Aug 15 01:10:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:10:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:10:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:15 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:11:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:11:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:11:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:11:15 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:11:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:11:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:11:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:11:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:11:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:11:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:11:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:11:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:11:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:11:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:11:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:11:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:11:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:11:16 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:11:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c36e629d-8dfa-4a10-becb-680c6fcb3939/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:11:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c36e629d-8dfa-4a10-becb-680c6fcb3939/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:11:16 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c36e629d-8dfa-4a10-becb-680c6fcb3939/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:11:17 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c36e629d-8dfa-4a10-becb-680c6fcb3939/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:11:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:17 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:11:17 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:11:17 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8432MB free_disk=25.105850219726562GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:11:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:11:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:11:17 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance d79e3854-769c-430a-b980-3a551c7ee34d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:11:17 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 39a36324-d323-4169-abaa-09028eeb5598 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:11:17 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 2e7996e6-56fe-44b3-ad02-d17f7ddb358a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:11:17 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance c36e629d-8dfa-4a10-becb-680c6fcb3939 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:11:17 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance a54593fa-a252-4a33-8150-5269c8ce56bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:11:17 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:11:17 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:11:17 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:11:17 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:11:17 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:11:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:11:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:21 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:11:21 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:11:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:22 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:11:22 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:11:22 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Didn't find any instances for network info cache update. {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 01:11:25 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:11:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:26 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:11:27 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:11:28 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3c751a78-1c35-4c79-b942-c48f78479229 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "a54593fa-a252-4a33-8150-5269c8ce56bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3c751a78-1c35-4c79-b942-c48f78479229 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3c751a78-1c35-4c79-b942-c48f78479229 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3c751a78-1c35-4c79-b942-c48f78479229 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3c751a78-1c35-4c79-b942-c48f78479229 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:11:30 user nova-compute[73010]: INFO nova.compute.manager [None req-3c751a78-1c35-4c79-b942-c48f78479229 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Terminating instance
Aug 15 01:11:30 user nova-compute[73010]: DEBUG nova.compute.manager [None req-3c751a78-1c35-4c79-b942-c48f78479229 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-c8d082d6-26b3-4653-acd8-7f1236c47b17 req-9158e87f-375c-46e8-9549-4204c89aa7aa service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Received event network-vif-unplugged-58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c8d082d6-26b3-4653-acd8-7f1236c47b17 req-9158e87f-375c-46e8-9549-4204c89aa7aa service nova] Acquiring lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c8d082d6-26b3-4653-acd8-7f1236c47b17 req-9158e87f-375c-46e8-9549-4204c89aa7aa service nova] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c8d082d6-26b3-4653-acd8-7f1236c47b17 req-9158e87f-375c-46e8-9549-4204c89aa7aa service nova] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-c8d082d6-26b3-4653-acd8-7f1236c47b17 req-9158e87f-375c-46e8-9549-4204c89aa7aa service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] No waiting events found dispatching network-vif-unplugged-58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-c8d082d6-26b3-4653-acd8-7f1236c47b17 req-9158e87f-375c-46e8-9549-4204c89aa7aa service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Received event network-vif-unplugged-58ac448b-c375-4ef0-bae4-436351b80aec for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:30 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Instance destroyed successfully.
Aug 15 01:11:30 user nova-compute[73010]: DEBUG nova.objects.instance [None req-3c751a78-1c35-4c79-b942-c48f78479229 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lazy-loading 'resources' on Instance uuid a54593fa-a252-4a33-8150-5269c8ce56bf {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-3c751a78-1c35-4c79-b942-c48f78479229 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T01:05:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1051974814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1051974814',id=50,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYTLD0SROw2+kgQJPV0u9yb76/GoiUChdaEG+JkzAoIxFCE9jTOZvMZYfdiHfNjmnIRhStAHLSNX/f/KwsFnraWOZee3aNoqh8RakueGTo5I/6c+Q3lrU800h7AOthtdg==',key_name='tempest-keypair-485982673',keypairs=<?>,launch_index=0,launched_at=2023-08-15T01:09:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='586bed330893488081bb21738b1a6ec4',ramdisk_id='',reservation_id='r-vnnzzp3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-563974852',owner_user_name='tempest-AttachVolumeShelveTestJSON-563974852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T01:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c5655da76eb4671b4db00e086232f05',uuid=a54593fa-a252-4a33-8150-5269c8ce56bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58ac448b-c375-4ef0-bae4-436351b80aec", "address": "fa:16:3e:e7:72:f7", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ac448b-c3", "ovs_interfaceid": "58ac448b-c375-4ef0-bae4-436351b80aec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-3c751a78-1c35-4c79-b942-c48f78479229 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Converting VIF {"id": "58ac448b-c375-4ef0-bae4-436351b80aec", "address": "fa:16:3e:e7:72:f7", "network": {"id": "9f82e2d3-1e58-41b6-a5f6-9369c34ee769", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1050448776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586bed330893488081bb21738b1a6ec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ac448b-c3", "ovs_interfaceid": "58ac448b-c375-4ef0-bae4-436351b80aec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-3c751a78-1c35-4c79-b942-c48f78479229 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:72:f7,bridge_name='br-int',has_traffic_filtering=True,id=58ac448b-c375-4ef0-bae4-436351b80aec,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ac448b-c3') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG os_vif [None req-3c751a78-1c35-4c79-b942-c48f78479229 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:72:f7,bridge_name='br-int',has_traffic_filtering=True,id=58ac448b-c375-4ef0-bae4-436351b80aec,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ac448b-c3') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58ac448b-c3, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:11:30 user nova-compute[73010]: INFO os_vif [None req-3c751a78-1c35-4c79-b942-c48f78479229 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:72:f7,bridge_name='br-int',has_traffic_filtering=True,id=58ac448b-c375-4ef0-bae4-436351b80aec,network=Network(9f82e2d3-1e58-41b6-a5f6-9369c34ee769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ac448b-c3')
Aug 15 01:11:30 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-3c751a78-1c35-4c79-b942-c48f78479229 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Deleting instance files /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf_del
Aug 15 01:11:30 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-3c751a78-1c35-4c79-b942-c48f78479229 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Deletion of /opt/stack/data/nova/instances/a54593fa-a252-4a33-8150-5269c8ce56bf_del complete
Aug 15 01:11:30 user nova-compute[73010]: INFO nova.compute.manager [None req-3c751a78-1c35-4c79-b942-c48f78479229 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 15 01:11:30 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-3c751a78-1c35-4c79-b942-c48f78479229 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 01:11:30 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 01:11:31 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:11:31 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:11:31 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:11:31 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Took 0.76 seconds to deallocate network for instance.
Aug 15 01:11:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3c751a78-1c35-4c79-b942-c48f78479229 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:11:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3c751a78-1c35-4c79-b942-c48f78479229 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:11:31 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-3c751a78-1c35-4c79-b942-c48f78479229 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:11:31 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-3c751a78-1c35-4c79-b942-c48f78479229 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:11:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3c751a78-1c35-4c79-b942-c48f78479229 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:11:31 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-3c751a78-1c35-4c79-b942-c48f78479229 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Deleted allocations for instance a54593fa-a252-4a33-8150-5269c8ce56bf
Aug 15 01:11:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3c751a78-1c35-4c79-b942-c48f78479229 tempest-AttachVolumeShelveTestJSON-563974852 tempest-AttachVolumeShelveTestJSON-563974852-project-member] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.805s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:11:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:32 user nova-compute[73010]: DEBUG nova.compute.manager [req-a82cbfe5-ff96-4549-af98-9517a1daf915 req-31113aa9-7d1e-4ce1-aa63-7101b0e556e0 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Received event network-vif-plugged-58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:11:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a82cbfe5-ff96-4549-af98-9517a1daf915 req-31113aa9-7d1e-4ce1-aa63-7101b0e556e0 service nova] Acquiring lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:11:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a82cbfe5-ff96-4549-af98-9517a1daf915 req-31113aa9-7d1e-4ce1-aa63-7101b0e556e0 service nova] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:11:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-a82cbfe5-ff96-4549-af98-9517a1daf915 req-31113aa9-7d1e-4ce1-aa63-7101b0e556e0 service nova] Lock "a54593fa-a252-4a33-8150-5269c8ce56bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:11:32 user nova-compute[73010]: DEBUG nova.compute.manager [req-a82cbfe5-ff96-4549-af98-9517a1daf915 req-31113aa9-7d1e-4ce1-aa63-7101b0e556e0 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] No waiting events found dispatching network-vif-plugged-58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:11:32 user nova-compute[73010]: WARNING nova.compute.manager [req-a82cbfe5-ff96-4549-af98-9517a1daf915 req-31113aa9-7d1e-4ce1-aa63-7101b0e556e0 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Received unexpected event network-vif-plugged-58ac448b-c375-4ef0-bae4-436351b80aec for instance with vm_state deleted and task_state None.
Aug 15 01:11:32 user nova-compute[73010]: DEBUG nova.compute.manager [req-a82cbfe5-ff96-4549-af98-9517a1daf915 req-31113aa9-7d1e-4ce1-aa63-7101b0e556e0 service nova] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Received event network-vif-deleted-58ac448b-c375-4ef0-bae4-436351b80aec {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:11:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:11:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:11:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:11:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:11:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:45 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692061890.7639158, a54593fa-a252-4a33-8150-5269c8ce56bf => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:11:45 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] VM Stopped (Lifecycle Event)
Aug 15 01:11:45 user nova-compute[73010]: DEBUG nova.compute.manager [None req-32741668-6eba-4f6c-a1b1-78aa00843ac6 None None] [instance: a54593fa-a252-4a33-8150-5269c8ce56bf] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:11:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:11:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:11:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:11:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:11:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:11:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:12:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:12:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:12:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:12:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:12:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:12:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:12:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:12:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:12:17 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:12:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:12:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:12:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:12:17 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:12:17 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:12:17 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:12:17 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:12:17 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:12:17 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:12:17 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:12:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:12:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:12:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:12:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:12:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c36e629d-8dfa-4a10-becb-680c6fcb3939/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:12:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c36e629d-8dfa-4a10-becb-680c6fcb3939/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:12:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c36e629d-8dfa-4a10-becb-680c6fcb3939/disk.rescue --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:12:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c36e629d-8dfa-4a10-becb-680c6fcb3939/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:12:19 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:12:19 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:12:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8582MB free_disk=25.13266372680664GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:12:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:12:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:12:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance d79e3854-769c-430a-b980-3a551c7ee34d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:12:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 39a36324-d323-4169-abaa-09028eeb5598 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:12:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 2e7996e6-56fe-44b3-ad02-d17f7ddb358a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:12:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance c36e629d-8dfa-4a10-becb-680c6fcb3939 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:12:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:12:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:12:19 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:12:19 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:12:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:12:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:12:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:12:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:23 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:12:23 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:12:23 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:12:23 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:12:23 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 01:12:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-d79e3854-769c-430a-b980-3a551c7ee34d" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:12:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-d79e3854-769c-430a-b980-3a551c7ee34d" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:12:23 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 01:12:23 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lazy-loading 'info_cache' on Instance uuid d79e3854-769c-430a-b980-3a551c7ee34d {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:12:24 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Updating instance_info_cache with network_info: [{"id": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "address": "fa:16:3e:07:08:aa", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1f2867-31", "ovs_interfaceid": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:12:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-d79e3854-769c-430a-b980-3a551c7ee34d" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:12:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 01:12:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:26 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:12:27 user nova-compute[73010]: INFO nova.compute.manager [None req-597f2362-8a4f-4a9c-99bc-c3c7ade0ff7a tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Unrescuing
Aug 15 01:12:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-597f2362-8a4f-4a9c-99bc-c3c7ade0ff7a tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "refresh_cache-c36e629d-8dfa-4a10-becb-680c6fcb3939" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:12:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-597f2362-8a4f-4a9c-99bc-c3c7ade0ff7a tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquired lock "refresh_cache-c36e629d-8dfa-4a10-becb-680c6fcb3939" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:12:27 user nova-compute[73010]: DEBUG nova.network.neutron [None req-597f2362-8a4f-4a9c-99bc-c3c7ade0ff7a tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 01:12:27 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:12:27 user nova-compute[73010]: DEBUG nova.network.neutron [None req-597f2362-8a4f-4a9c-99bc-c3c7ade0ff7a tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Updating instance_info_cache with network_info: [{"id": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "address": "fa:16:3e:87:4b:88", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ae67fd-cf", "ovs_interfaceid": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:12:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-597f2362-8a4f-4a9c-99bc-c3c7ade0ff7a tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Releasing lock "refresh_cache-c36e629d-8dfa-4a10-becb-680c6fcb3939" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:12:27 user nova-compute[73010]: DEBUG nova.objects.instance [None req-597f2362-8a4f-4a9c-99bc-c3c7ade0ff7a tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lazy-loading 'flavor' on Instance uuid c36e629d-8dfa-4a10-becb-680c6fcb3939 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:12:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-819409f7-037d-4955-9dfe-0afbda5e9532 req-62b698ab-0114-4271-a753-55a07229c63e service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received event network-vif-unplugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:12:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-819409f7-037d-4955-9dfe-0afbda5e9532 req-62b698ab-0114-4271-a753-55a07229c63e service nova] Acquiring lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:12:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-819409f7-037d-4955-9dfe-0afbda5e9532 req-62b698ab-0114-4271-a753-55a07229c63e service nova] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:12:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-819409f7-037d-4955-9dfe-0afbda5e9532 req-62b698ab-0114-4271-a753-55a07229c63e service nova] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:12:28 user nova-compute[73010]: DEBUG nova.compute.manager [req-819409f7-037d-4955-9dfe-0afbda5e9532 req-62b698ab-0114-4271-a753-55a07229c63e service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] No waiting events found dispatching network-vif-unplugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:12:28 user nova-compute[73010]: WARNING nova.compute.manager [req-819409f7-037d-4955-9dfe-0afbda5e9532 req-62b698ab-0114-4271-a753-55a07229c63e service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received unexpected event network-vif-unplugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f for instance with vm_state rescued and task_state unrescuing.
Aug 15 01:12:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:28 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:12:28 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Instance destroyed successfully.
Aug 15 01:12:29 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:12:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-5e4c45f6-745e-4109-a36b-03be02d78035 req-51e4071e-b90d-422f-972c-d1ba1979a762 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received event network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:12:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5e4c45f6-745e-4109-a36b-03be02d78035 req-51e4071e-b90d-422f-972c-d1ba1979a762 service nova] Acquiring lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:12:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5e4c45f6-745e-4109-a36b-03be02d78035 req-51e4071e-b90d-422f-972c-d1ba1979a762 service nova] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:12:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5e4c45f6-745e-4109-a36b-03be02d78035 req-51e4071e-b90d-422f-972c-d1ba1979a762 service nova] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:12:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-5e4c45f6-745e-4109-a36b-03be02d78035 req-51e4071e-b90d-422f-972c-d1ba1979a762 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] No waiting events found dispatching network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:12:30 user nova-compute[73010]: WARNING nova.compute.manager [req-5e4c45f6-745e-4109-a36b-03be02d78035 req-51e4071e-b90d-422f-972c-d1ba1979a762 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received unexpected event network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f for instance with vm_state rescued and task_state unrescuing.
Aug 15 01:12:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-5e4c45f6-745e-4109-a36b-03be02d78035 req-51e4071e-b90d-422f-972c-d1ba1979a762 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received event network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:12:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5e4c45f6-745e-4109-a36b-03be02d78035 req-51e4071e-b90d-422f-972c-d1ba1979a762 service nova] Acquiring lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:12:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5e4c45f6-745e-4109-a36b-03be02d78035 req-51e4071e-b90d-422f-972c-d1ba1979a762 service nova] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:12:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5e4c45f6-745e-4109-a36b-03be02d78035 req-51e4071e-b90d-422f-972c-d1ba1979a762 service nova] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:12:30 user nova-compute[73010]: DEBUG nova.compute.manager [req-5e4c45f6-745e-4109-a36b-03be02d78035 req-51e4071e-b90d-422f-972c-d1ba1979a762 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] No waiting events found dispatching network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:12:30 user nova-compute[73010]: WARNING nova.compute.manager [req-5e4c45f6-745e-4109-a36b-03be02d78035 req-51e4071e-b90d-422f-972c-d1ba1979a762 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received unexpected event network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f for instance with vm_state rescued and task_state unrescuing.
Aug 15 01:12:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:32 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Removed pending event for c36e629d-8dfa-4a10-becb-680c6fcb3939 due to event {{(pid=73010) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 01:12:32 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061952.0556295, c36e629d-8dfa-4a10-becb-680c6fcb3939 => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:12:32 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] VM Resumed (Lifecycle Event)
Aug 15 01:12:32 user nova-compute[73010]: DEBUG nova.compute.manager [None req-597f2362-8a4f-4a9c-99bc-c3c7ade0ff7a tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:12:32 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:12:32 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:12:32 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692061952.060349, c36e629d-8dfa-4a10-becb-680c6fcb3939 => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:12:32 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] VM Started (Lifecycle Event)
Aug 15 01:12:32 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:12:32 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:12:32 user nova-compute[73010]: DEBUG nova.compute.manager [req-19a273bb-b5c6-47e9-92ea-a512f6ab32a5 req-c510330f-9a2c-4891-b03a-c774d7bbc7d0 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received event network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:12:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-19a273bb-b5c6-47e9-92ea-a512f6ab32a5 req-c510330f-9a2c-4891-b03a-c774d7bbc7d0 service nova] Acquiring lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:12:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-19a273bb-b5c6-47e9-92ea-a512f6ab32a5 req-c510330f-9a2c-4891-b03a-c774d7bbc7d0 service nova] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:12:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-19a273bb-b5c6-47e9-92ea-a512f6ab32a5 req-c510330f-9a2c-4891-b03a-c774d7bbc7d0 service nova] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:12:32 user nova-compute[73010]: DEBUG nova.compute.manager [req-19a273bb-b5c6-47e9-92ea-a512f6ab32a5 req-c510330f-9a2c-4891-b03a-c774d7bbc7d0 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] No waiting events found dispatching network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:12:32 user nova-compute[73010]: WARNING nova.compute.manager [req-19a273bb-b5c6-47e9-92ea-a512f6ab32a5 req-c510330f-9a2c-4891-b03a-c774d7bbc7d0 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received unexpected event network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f for instance with vm_state active and task_state None.
Aug 15 01:12:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:33 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:12:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:12:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:12:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:47 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:12:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:12:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:13:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:13:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:13:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:13:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:13:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:13:17 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:13:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:13:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:13:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:13:17 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:13:17 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:13:17 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:13:17 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:13:17 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:13:17 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:13:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:13:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:13:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:13:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:13:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:13:18 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:13:18 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:13:18 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8636MB free_disk=25.131526947021484GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:13:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:13:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:13:18 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance d79e3854-769c-430a-b980-3a551c7ee34d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:13:18 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 39a36324-d323-4169-abaa-09028eeb5598 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:13:18 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 2e7996e6-56fe-44b3-ad02-d17f7ddb358a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:13:18 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance c36e629d-8dfa-4a10-becb-680c6fcb3939 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:13:18 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:13:18 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:13:19 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:13:19 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:13:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:13:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:13:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:13:25 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:13:25 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:13:25 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:13:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-39a36324-d323-4169-abaa-09028eeb5598" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:13:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-39a36324-d323-4169-abaa-09028eeb5598" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:13:25 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 01:13:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:13:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:13:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:13:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:13:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:13:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:13:25 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Updating instance_info_cache with network_info: [{"id": "18919d62-63b4-4622-af68-05b0ecfb2002", "address": "fa:16:3e:d7:7a:a7", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18919d62-63", "ovs_interfaceid": "18919d62-63b4-4622-af68-05b0ecfb2002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:13:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-39a36324-d323-4169-abaa-09028eeb5598" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:13:25 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 01:13:25 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:13:27 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:13:28 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:13:28 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:13:30 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:13:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4995-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:13:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:13:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:13:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:13:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:13:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:13:34 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:13:34 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:13:35 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:13:35 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Cleaning up deleted instances {{(pid=73010) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 01:13:35 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] There are 0 instances to clean {{(pid=73010) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 01:13:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:13:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:13:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:13:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:13:55 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:13:55 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73010) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 01:13:55 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:13:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:13:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:13:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:13:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:13:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:13:55 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:14:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:14:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:14:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:14:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:14:17 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:14:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:14:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:14:17 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:14:17 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:14:17 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:14:17 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:14:17 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:14:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:14:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:14:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:14:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:14:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:14:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:14:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:14:18 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:14:18 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:14:18 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8665MB free_disk=25.130939483642578GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:14:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:14:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:14:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "c36e629d-8dfa-4a10-becb-680c6fcb3939" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:14:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:14:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:14:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:14:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:14:18 user nova-compute[73010]: INFO nova.compute.manager [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Terminating instance
Aug 15 01:14:18 user nova-compute[73010]: DEBUG nova.compute.manager [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 01:14:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:14:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance d79e3854-769c-430a-b980-3a551c7ee34d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 39a36324-d323-4169-abaa-09028eeb5598 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 2e7996e6-56fe-44b3-ad02-d17f7ddb358a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance c36e629d-8dfa-4a10-becb-680c6fcb3939 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Refreshing inventories for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Updating ProviderTree inventory for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Updating inventory in ProviderTree for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Refreshing aggregate associations for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e, aggregates: None {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG nova.compute.manager [req-5915660d-23ea-4416-9191-d1076bde7baa req-78e63ef2-3592-4698-8178-57278195bacb service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received event network-vif-unplugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5915660d-23ea-4416-9191-d1076bde7baa req-78e63ef2-3592-4698-8178-57278195bacb service nova] Acquiring lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5915660d-23ea-4416-9191-d1076bde7baa req-78e63ef2-3592-4698-8178-57278195bacb service nova] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-5915660d-23ea-4416-9191-d1076bde7baa req-78e63ef2-3592-4698-8178-57278195bacb service nova] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG nova.compute.manager [req-5915660d-23ea-4416-9191-d1076bde7baa req-78e63ef2-3592-4698-8178-57278195bacb service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] No waiting events found dispatching network-vif-unplugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG nova.compute.manager [req-5915660d-23ea-4416-9191-d1076bde7baa req-78e63ef2-3592-4698-8178-57278195bacb service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received event network-vif-unplugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Refreshing trait associations for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.574s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:14:19 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Instance destroyed successfully.
Aug 15 01:14:19 user nova-compute[73010]: DEBUG nova.objects.instance [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lazy-loading 'resources' on Instance uuid c36e629d-8dfa-4a10-becb-680c6fcb3939 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:08:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1446601433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1446601433',id=52,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T01:10:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6db1cb9145b49999d0f102f8cfb867a',ramdisk_id='',reservation_id='r-51gycceg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T01:12:32Z,user_data=None,user_id='8e1e98c9bae145f0909011bb46c6e104',uuid=c36e629d-8dfa-4a10-becb-680c6fcb3939,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "address": "fa:16:3e:87:4b:88", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ae67fd-cf", "ovs_interfaceid": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converting VIF {"id": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "address": "fa:16:3e:87:4b:88", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ae67fd-cf", "ovs_interfaceid": "19ae67fd-cf2b-4ff0-af2e-94bbb231d96f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:4b:88,bridge_name='br-int',has_traffic_filtering=True,id=19ae67fd-cf2b-4ff0-af2e-94bbb231d96f,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ae67fd-cf') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG os_vif [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:4b:88,bridge_name='br-int',has_traffic_filtering=True,id=19ae67fd-cf2b-4ff0-af2e-94bbb231d96f,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ae67fd-cf') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19ae67fd-cf, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:14:19 user nova-compute[73010]: INFO os_vif [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:4b:88,bridge_name='br-int',has_traffic_filtering=True,id=19ae67fd-cf2b-4ff0-af2e-94bbb231d96f,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ae67fd-cf')
Aug 15 01:14:19 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'usSfpKNt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:14:19 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:14:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f192aa78-199b-4c27-a2c5-f3911852d38d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2ad20c-0cfc-4eee-b625-0a539f917c65]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:14:19 user nova-compute[73010]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f (non-flash)
Aug 15 01:14:19 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:14:19 user nova-compute[73010]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f (non-flash)
Aug 15 01:14:19 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec302a7eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f'): ({'sdb'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Removing single pathed devices sdb {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd12a3a-961e-4512-a223-7584eeaa4e7b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae91a595-5882-4eaa-8ec3-61ef69efd0e7]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Flushing IO for device /dev/sdb {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72f4044-b21c-4d08-8205-19b7abd26e87]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38c45c8-dd38-4459-a579-9a8b9342b439]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd4eff4-fcb7-447b-9dc5-1aa76e2219d0]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70567b2-53ba-4e27-a5e6-b19b7fdb8aca]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f, portal: 172.16.0.220,3260]
Aug 15 01:14:19 user nova-compute[73010]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f, portal: 172.16.0.220,3260] successful.
Aug 15 01:14:19 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:14:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:14:20 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35087b75-844e-4ec1-9091-2433e930f07f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:14:20 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5a7b08-0f7f-4a5a-82c1-fb11a1f970cc]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:14:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:14:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:14:20 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] <== disconnect_volume: return (297ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:14:20 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 01:14:20 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Deleting instance files /opt/stack/data/nova/instances/c36e629d-8dfa-4a10-becb-680c6fcb3939_del
Aug 15 01:14:20 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Deletion of /opt/stack/data/nova/instances/c36e629d-8dfa-4a10-becb-680c6fcb3939_del complete
Aug 15 01:14:20 user nova-compute[73010]: INFO nova.compute.manager [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 15 01:14:20 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 01:14:20 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 01:14:20 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 01:14:20 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:14:20 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Took 0.65 seconds to deallocate network for instance.
Aug 15 01:14:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-165e948c-a55f-4f3c-9e13-a9bbbded1a58 req-ce9d27e7-1be3-4137-afd2-d14741f179e4 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received event network-vif-deleted-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:14:20 user nova-compute[73010]: INFO nova.compute.manager [req-165e948c-a55f-4f3c-9e13-a9bbbded1a58 req-ce9d27e7-1be3-4137-afd2-d14741f179e4 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Neutron deleted interface 19ae67fd-cf2b-4ff0-af2e-94bbb231d96f; detaching it from the instance and deleting it from the info cache
Aug 15 01:14:20 user nova-compute[73010]: DEBUG nova.network.neutron [req-165e948c-a55f-4f3c-9e13-a9bbbded1a58 req-ce9d27e7-1be3-4137-afd2-d14741f179e4 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:14:20 user nova-compute[73010]: DEBUG nova.compute.manager [req-165e948c-a55f-4f3c-9e13-a9bbbded1a58 req-ce9d27e7-1be3-4137-afd2-d14741f179e4 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Detach interface failed, port_id=19ae67fd-cf2b-4ff0-af2e-94bbb231d96f, reason: Instance c36e629d-8dfa-4a10-becb-680c6fcb3939 could not be found. {{(pid=73010) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 01:14:21 user nova-compute[73010]: DEBUG nova.compute.manager [req-c07295aa-17a2-4927-a5ef-57c95df2b4c9 req-76203376-65b3-4ecf-81b9-3a60e3655760 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received event network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:14:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c07295aa-17a2-4927-a5ef-57c95df2b4c9 req-76203376-65b3-4ecf-81b9-3a60e3655760 service nova] Acquiring lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:14:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c07295aa-17a2-4927-a5ef-57c95df2b4c9 req-76203376-65b3-4ecf-81b9-3a60e3655760 service nova] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:14:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-c07295aa-17a2-4927-a5ef-57c95df2b4c9 req-76203376-65b3-4ecf-81b9-3a60e3655760 service nova] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:14:21 user nova-compute[73010]: DEBUG nova.compute.manager [req-c07295aa-17a2-4927-a5ef-57c95df2b4c9 req-76203376-65b3-4ecf-81b9-3a60e3655760 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] No waiting events found dispatching network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:14:21 user nova-compute[73010]: WARNING nova.compute.manager [req-c07295aa-17a2-4927-a5ef-57c95df2b4c9 req-76203376-65b3-4ecf-81b9-3a60e3655760 service nova] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Received unexpected event network-vif-plugged-19ae67fd-cf2b-4ff0-af2e-94bbb231d96f for instance with vm_state active and task_state deleting.
Aug 15 01:14:21 user nova-compute[73010]: INFO nova.compute.manager [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Took 0.87 seconds to detach 1 volumes for instance.
Aug 15 01:14:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:14:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:14:21 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:14:21 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:14:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:14:21 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Deleted allocations for instance c36e629d-8dfa-4a10-becb-680c6fcb3939
Aug 15 01:14:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-5c0ab3cf-b2fc-4dd0-9c5e-14177c789ad8 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "c36e629d-8dfa-4a10-becb-680c6fcb3939" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.061s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:14:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:14:25 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:14:25 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:14:25 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:14:25 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:14:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-2e7996e6-56fe-44b3-ad02-d17f7ddb358a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:14:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-2e7996e6-56fe-44b3-ad02-d17f7ddb358a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:14:25 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 01:14:26 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Updating instance_info_cache with network_info: [{"id": "3a41eecc-5993-483d-b86f-1d174df9d996", "address": "fa:16:3e:e6:d0:b5", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a41eecc-59", "ovs_interfaceid": "3a41eecc-5993-483d-b86f-1d174df9d996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:14:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-2e7996e6-56fe-44b3-ad02-d17f7ddb358a" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:14:26 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 01:14:27 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:14:29 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:14:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:14:30 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:14:32 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:14:34 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692062059.6499546, c36e629d-8dfa-4a10-becb-680c6fcb3939 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:14:34 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] VM Stopped (Lifecycle Event)
Aug 15 01:14:34 user nova-compute[73010]: DEBUG nova.compute.manager [None req-024edf08-6be2-4ff7-b1ef-d0d69ff3fd16 None None] [instance: c36e629d-8dfa-4a10-becb-680c6fcb3939] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:14:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:14:36 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:14:36 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:14:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:14:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:14:48 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:14:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:14:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:14:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:15:04 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:15:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-12082c6d-26c0-4d52-927e-e578cc97f5b2 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "2e7996e6-56fe-44b3-ad02-d17f7ddb358a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:15:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-12082c6d-26c0-4d52-927e-e578cc97f5b2 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "2e7996e6-56fe-44b3-ad02-d17f7ddb358a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:15:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-12082c6d-26c0-4d52-927e-e578cc97f5b2 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "2e7996e6-56fe-44b3-ad02-d17f7ddb358a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:15:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-12082c6d-26c0-4d52-927e-e578cc97f5b2 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "2e7996e6-56fe-44b3-ad02-d17f7ddb358a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:15:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-12082c6d-26c0-4d52-927e-e578cc97f5b2 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "2e7996e6-56fe-44b3-ad02-d17f7ddb358a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:15:09 user nova-compute[73010]: INFO nova.compute.manager [None req-12082c6d-26c0-4d52-927e-e578cc97f5b2 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Terminating instance
Aug 15 01:15:09 user nova-compute[73010]: DEBUG nova.compute.manager [None req-12082c6d-26c0-4d52-927e-e578cc97f5b2 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 01:15:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:15:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:15:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:15:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:15:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:15:09 user nova-compute[73010]: DEBUG nova.compute.manager [req-036b366a-eabb-4e4c-80bc-38c0123b50be req-5dfa6e39-786a-46f4-b877-4dec78dff0bf service nova] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Received event network-vif-unplugged-3a41eecc-5993-483d-b86f-1d174df9d996 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:15:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-036b366a-eabb-4e4c-80bc-38c0123b50be req-5dfa6e39-786a-46f4-b877-4dec78dff0bf service nova] Acquiring lock "2e7996e6-56fe-44b3-ad02-d17f7ddb358a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:15:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-036b366a-eabb-4e4c-80bc-38c0123b50be req-5dfa6e39-786a-46f4-b877-4dec78dff0bf service nova] Lock "2e7996e6-56fe-44b3-ad02-d17f7ddb358a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:15:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-036b366a-eabb-4e4c-80bc-38c0123b50be req-5dfa6e39-786a-46f4-b877-4dec78dff0bf service nova] Lock "2e7996e6-56fe-44b3-ad02-d17f7ddb358a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:15:09 user nova-compute[73010]: DEBUG nova.compute.manager [req-036b366a-eabb-4e4c-80bc-38c0123b50be req-5dfa6e39-786a-46f4-b877-4dec78dff0bf service nova] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] No waiting events found dispatching network-vif-unplugged-3a41eecc-5993-483d-b86f-1d174df9d996 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:15:09 user nova-compute[73010]: DEBUG nova.compute.manager [req-036b366a-eabb-4e4c-80bc-38c0123b50be req-5dfa6e39-786a-46f4-b877-4dec78dff0bf service nova] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Received event network-vif-unplugged-3a41eecc-5993-483d-b86f-1d174df9d996 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 01:15:09 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Instance destroyed successfully.
Aug 15 01:15:09 user nova-compute[73010]: DEBUG nova.objects.instance [None req-12082c6d-26c0-4d52-927e-e578cc97f5b2 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lazy-loading 'resources' on Instance uuid 2e7996e6-56fe-44b3-ad02-d17f7ddb358a {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:15:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-12082c6d-26c0-4d52-927e-e578cc97f5b2 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:05:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1328334309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1328334309',id=49,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T01:05:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6db1cb9145b49999d0f102f8cfb867a',ramdisk_id='',reservation_id='r-qi571mkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T01:07:44Z,user_data=None,user_id='8e1e98c9bae145f0909011bb46c6e104',uuid=2e7996e6-56fe-44b3-ad02-d17f7ddb358a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a41eecc-5993-483d-b86f-1d174df9d996", "address": "fa:16:3e:e6:d0:b5", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a41eecc-59", "ovs_interfaceid": "3a41eecc-5993-483d-b86f-1d174df9d996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 01:15:09 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-12082c6d-26c0-4d52-927e-e578cc97f5b2 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converting VIF {"id": "3a41eecc-5993-483d-b86f-1d174df9d996", "address": "fa:16:3e:e6:d0:b5", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a41eecc-59", "ovs_interfaceid": "3a41eecc-5993-483d-b86f-1d174df9d996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:15:09 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-12082c6d-26c0-4d52-927e-e578cc97f5b2 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:d0:b5,bridge_name='br-int',has_traffic_filtering=True,id=3a41eecc-5993-483d-b86f-1d174df9d996,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a41eecc-59') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:15:09 user nova-compute[73010]: DEBUG os_vif [None req-12082c6d-26c0-4d52-927e-e578cc97f5b2 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:d0:b5,bridge_name='br-int',has_traffic_filtering=True,id=3a41eecc-5993-483d-b86f-1d174df9d996,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a41eecc-59') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 01:15:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:15:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a41eecc-59, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:15:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:15:09 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:15:09 user nova-compute[73010]: INFO os_vif [None req-12082c6d-26c0-4d52-927e-e578cc97f5b2 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:d0:b5,bridge_name='br-int',has_traffic_filtering=True,id=3a41eecc-5993-483d-b86f-1d174df9d996,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a41eecc-59')
Aug 15 01:15:09 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-12082c6d-26c0-4d52-927e-e578cc97f5b2 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Deleting instance files /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a_del
Aug 15 01:15:09 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-12082c6d-26c0-4d52-927e-e578cc97f5b2 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Deletion of /opt/stack/data/nova/instances/2e7996e6-56fe-44b3-ad02-d17f7ddb358a_del complete
Aug 15 01:15:10 user nova-compute[73010]: INFO nova.compute.manager [None req-12082c6d-26c0-4d52-927e-e578cc97f5b2 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 15 01:15:10 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-12082c6d-26c0-4d52-927e-e578cc97f5b2 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 01:15:10 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 01:15:10 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 01:15:10 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:15:10 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Took 0.50 seconds to deallocate network for instance.
Aug 15 01:15:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-12082c6d-26c0-4d52-927e-e578cc97f5b2 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:15:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-12082c6d-26c0-4d52-927e-e578cc97f5b2 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:15:10 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-12082c6d-26c0-4d52-927e-e578cc97f5b2 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:15:10 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-12082c6d-26c0-4d52-927e-e578cc97f5b2 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:15:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-12082c6d-26c0-4d52-927e-e578cc97f5b2 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:15:10 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-12082c6d-26c0-4d52-927e-e578cc97f5b2 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Deleted allocations for instance 2e7996e6-56fe-44b3-ad02-d17f7ddb358a
Aug 15 01:15:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-12082c6d-26c0-4d52-927e-e578cc97f5b2 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "2e7996e6-56fe-44b3-ad02-d17f7ddb358a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.565s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:15:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-d760f5b4-e451-485c-a613-3e260aae6ceb req-a6152f99-32d1-4dda-968b-640017388e4b service nova] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Received event network-vif-plugged-3a41eecc-5993-483d-b86f-1d174df9d996 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:15:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d760f5b4-e451-485c-a613-3e260aae6ceb req-a6152f99-32d1-4dda-968b-640017388e4b service nova] Acquiring lock "2e7996e6-56fe-44b3-ad02-d17f7ddb358a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:15:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d760f5b4-e451-485c-a613-3e260aae6ceb req-a6152f99-32d1-4dda-968b-640017388e4b service nova] Lock "2e7996e6-56fe-44b3-ad02-d17f7ddb358a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:15:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d760f5b4-e451-485c-a613-3e260aae6ceb req-a6152f99-32d1-4dda-968b-640017388e4b service nova] Lock "2e7996e6-56fe-44b3-ad02-d17f7ddb358a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:15:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-d760f5b4-e451-485c-a613-3e260aae6ceb req-a6152f99-32d1-4dda-968b-640017388e4b service nova] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] No waiting events found dispatching network-vif-plugged-3a41eecc-5993-483d-b86f-1d174df9d996 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:15:11 user nova-compute[73010]: WARNING nova.compute.manager [req-d760f5b4-e451-485c-a613-3e260aae6ceb req-a6152f99-32d1-4dda-968b-640017388e4b service nova] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Received unexpected event network-vif-plugged-3a41eecc-5993-483d-b86f-1d174df9d996 for instance with vm_state deleted and task_state None.
Aug 15 01:15:11 user nova-compute[73010]: DEBUG nova.compute.manager [req-d760f5b4-e451-485c-a613-3e260aae6ceb req-a6152f99-32d1-4dda-968b-640017388e4b service nova] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Received event network-vif-deleted-3a41eecc-5993-483d-b86f-1d174df9d996 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:15:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:15:18 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:15:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:15:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:15:18 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:15:18 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:15:18 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73010) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 01:15:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:15:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:15:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:15:18 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:15:19 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:15:19 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:15:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8803MB free_disk=25.255279541015625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:15:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:15:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:15:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance d79e3854-769c-430a-b980-3a551c7ee34d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:15:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 39a36324-d323-4169-abaa-09028eeb5598 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:15:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:15:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:15:19 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:15:19 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:15:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:15:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:15:19 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:15:24 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692062109.9137173, 2e7996e6-56fe-44b3-ad02-d17f7ddb358a => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:15:24 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] VM Stopped (Lifecycle Event)
Aug 15 01:15:24 user nova-compute[73010]: DEBUG nova.compute.manager [None req-03d1b965-024d-4635-ab82-fb6146b65402 None None] [instance: 2e7996e6-56fe-44b3-ad02-d17f7ddb358a] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:15:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:15:26 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:15:26 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:15:26 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:15:26 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Didn't find any instances for network info cache update. {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 01:15:26 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:15:28 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:15:29 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:15:30 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:15:31 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:15:34 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:15:34 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:15:38 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:15:38 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:15:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:15:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:15:49 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:15:54 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:15:59 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "39a36324-d323-4169-abaa-09028eeb5598" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "39a36324-d323-4169-abaa-09028eeb5598" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "39a36324-d323-4169-abaa-09028eeb5598-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:16:00 user nova-compute[73010]: INFO nova.compute.manager [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Terminating instance
Aug 15 01:16:00 user nova-compute[73010]: DEBUG nova.compute.manager [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG nova.compute.manager [req-3fdc2ad2-0480-45d6-8fe2-9907188afffa req-5e188b45-25cf-4e40-9bbd-2662d5597036 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received event network-vif-unplugged-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3fdc2ad2-0480-45d6-8fe2-9907188afffa req-5e188b45-25cf-4e40-9bbd-2662d5597036 service nova] Acquiring lock "39a36324-d323-4169-abaa-09028eeb5598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3fdc2ad2-0480-45d6-8fe2-9907188afffa req-5e188b45-25cf-4e40-9bbd-2662d5597036 service nova] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-3fdc2ad2-0480-45d6-8fe2-9907188afffa req-5e188b45-25cf-4e40-9bbd-2662d5597036 service nova] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG nova.compute.manager [req-3fdc2ad2-0480-45d6-8fe2-9907188afffa req-5e188b45-25cf-4e40-9bbd-2662d5597036 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] No waiting events found dispatching network-vif-unplugged-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG nova.compute.manager [req-3fdc2ad2-0480-45d6-8fe2-9907188afffa req-5e188b45-25cf-4e40-9bbd-2662d5597036 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received event network-vif-unplugged-18919d62-63b4-4622-af68-05b0ecfb2002 for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:16:00 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Instance destroyed successfully.
Aug 15 01:16:00 user nova-compute[73010]: DEBUG nova.objects.instance [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lazy-loading 'resources' on Instance uuid 39a36324-d323-4169-abaa-09028eeb5598 {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1935653473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1935653473',id=47,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T01:02:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6db1cb9145b49999d0f102f8cfb867a',ramdisk_id='',reservation_id='r-6x067bjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T01:04:00Z,user_data=None,user_id='8e1e98c9bae145f0909011bb46c6e104',uuid=39a36324-d323-4169-abaa-09028eeb5598,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18919d62-63b4-4622-af68-05b0ecfb2002", "address": "fa:16:3e:d7:7a:a7", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18919d62-63", "ovs_interfaceid": "18919d62-63b4-4622-af68-05b0ecfb2002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converting VIF {"id": "18919d62-63b4-4622-af68-05b0ecfb2002", "address": "fa:16:3e:d7:7a:a7", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18919d62-63", "ovs_interfaceid": "18919d62-63b4-4622-af68-05b0ecfb2002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:7a:a7,bridge_name='br-int',has_traffic_filtering=True,id=18919d62-63b4-4622-af68-05b0ecfb2002,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18919d62-63') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG os_vif [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:7a:a7,bridge_name='br-int',has_traffic_filtering=True,id=18919d62-63b4-4622-af68-05b0ecfb2002,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18919d62-63') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18919d62-63, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:16:00 user nova-compute[73010]: INFO os_vif [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:7a:a7,bridge_name='br-int',has_traffic_filtering=True,id=18919d62-63b4-4622-af68-05b0ecfb2002,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18919d62-63')
Aug 15 01:16:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IYBDknor', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:16:00 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:16:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[419c5e5f-3a53-421a-a7ab-904c88f4a3ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c556fd-5427-41e5-875c-92608912cb01]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:16:00 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d (non-flash)
Aug 15 01:16:00 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec302a72e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d'): ({'sdc'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Removing single pathed devices sdc {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d760f260-faa9-433f-a2e2-60d236d39be1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.033s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05ee5a8-de4e-48bb-8903-943c206dfe66]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Flushing IO for device /dev/sdc {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a6cdb6-da42-4298-9449-ad0769a9e13c]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 01:16:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:16:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:16:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ef486c-6d61-4636-9e4f-160e8e724a67]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:16:01 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 01:16:01 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] SCSI volumes sdc have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 01:16:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 01:16:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:16:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:16:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccb5d11-dd24-4642-8a18-6b20500d34e3]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:16:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:16:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:16:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:16:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[129dda09-c7d1-4757-ab7f-667183418093]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:16:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d, portal: 172.16.0.220,3260]
Aug 15 01:16:01 user nova-compute[73010]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d, portal: 172.16.0.220,3260] successful.
Aug 15 01:16:01 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:16:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:16:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7096a68e-26fc-49bc-bc01-438af11bb87d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:16:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96d8b0a-0606-49e0-bb55-adc27ddc0a24]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:16:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:16:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:16:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] <== disconnect_volume: return (269ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:16:01 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 01:16:01 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Deleting instance files /opt/stack/data/nova/instances/39a36324-d323-4169-abaa-09028eeb5598_del
Aug 15 01:16:01 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Deletion of /opt/stack/data/nova/instances/39a36324-d323-4169-abaa-09028eeb5598_del complete
Aug 15 01:16:01 user nova-compute[73010]: INFO nova.compute.manager [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 15 01:16:01 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 01:16:01 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 01:16:01 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 39a36324-d323-4169-abaa-09028eeb5598] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 01:16:01 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:16:01 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Took 0.58 seconds to deallocate network for instance.
Aug 15 01:16:01 user nova-compute[73010]: DEBUG nova.compute.manager [req-5c91254b-c45f-4242-9f9c-960c182a9f18 req-eb577a44-17c2-47ea-9c27-07dfcf506993 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received event network-vif-deleted-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:16:01 user nova-compute[73010]: INFO nova.compute.manager [req-5c91254b-c45f-4242-9f9c-960c182a9f18 req-eb577a44-17c2-47ea-9c27-07dfcf506993 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Neutron deleted interface 18919d62-63b4-4622-af68-05b0ecfb2002; detaching it from the instance and deleting it from the info cache
Aug 15 01:16:01 user nova-compute[73010]: DEBUG nova.network.neutron [req-5c91254b-c45f-4242-9f9c-960c182a9f18 req-eb577a44-17c2-47ea-9c27-07dfcf506993 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:16:01 user nova-compute[73010]: DEBUG nova.compute.manager [req-5c91254b-c45f-4242-9f9c-960c182a9f18 req-eb577a44-17c2-47ea-9c27-07dfcf506993 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Detach interface failed, port_id=18919d62-63b4-4622-af68-05b0ecfb2002, reason: Instance 39a36324-d323-4169-abaa-09028eeb5598 could not be found. {{(pid=73010) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 01:16:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-fc4624ca-90a4-436c-bc3e-0271b376bd1e req-a05bf5ab-43fd-4717-b0a0-3e8a79ddd301 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received event network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:16:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-fc4624ca-90a4-436c-bc3e-0271b376bd1e req-a05bf5ab-43fd-4717-b0a0-3e8a79ddd301 service nova] Acquiring lock "39a36324-d323-4169-abaa-09028eeb5598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:16:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-fc4624ca-90a4-436c-bc3e-0271b376bd1e req-a05bf5ab-43fd-4717-b0a0-3e8a79ddd301 service nova] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:16:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-fc4624ca-90a4-436c-bc3e-0271b376bd1e req-a05bf5ab-43fd-4717-b0a0-3e8a79ddd301 service nova] Lock "39a36324-d323-4169-abaa-09028eeb5598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:16:02 user nova-compute[73010]: DEBUG nova.compute.manager [req-fc4624ca-90a4-436c-bc3e-0271b376bd1e req-a05bf5ab-43fd-4717-b0a0-3e8a79ddd301 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] No waiting events found dispatching network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:16:02 user nova-compute[73010]: WARNING nova.compute.manager [req-fc4624ca-90a4-436c-bc3e-0271b376bd1e req-a05bf5ab-43fd-4717-b0a0-3e8a79ddd301 service nova] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Received unexpected event network-vif-plugged-18919d62-63b4-4622-af68-05b0ecfb2002 for instance with vm_state active and task_state deleting.
Aug 15 01:16:02 user nova-compute[73010]: INFO nova.compute.manager [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Took 0.74 seconds to detach 1 volumes for instance.
Aug 15 01:16:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:16:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:16:02 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:16:02 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:16:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:16:02 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Deleted allocations for instance 39a36324-d323-4169-abaa-09028eeb5598
Aug 15 01:16:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-82a3d92a-693d-4b38-a35a-f095172acc34 tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "39a36324-d323-4169-abaa-09028eeb5598" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.818s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:16:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:16:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:16:15 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692062160.785103, 39a36324-d323-4169-abaa-09028eeb5598 => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:16:15 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 39a36324-d323-4169-abaa-09028eeb5598] VM Stopped (Lifecycle Event)
Aug 15 01:16:15 user nova-compute[73010]: DEBUG nova.compute.manager [None req-4c7def00-5e60-4d6f-83ac-94630623d525 None None] [instance: 39a36324-d323-4169-abaa-09028eeb5598] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:16:15 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:16:19 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:16:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:16:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:16:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:16:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:16:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:16:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:16:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:16:19 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:16:20 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:16:20 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:16:20 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8821MB free_disk=25.254486083984375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:16:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:16:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:16:20 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance d79e3854-769c-430a-b980-3a551c7ee34d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:16:20 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:16:20 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:16:20 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:16:20 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:16:20 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:16:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:16:20 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:16:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:16:26 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:16:26 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:16:27 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:16:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:16:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 01:16:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-d79e3854-769c-430a-b980-3a551c7ee34d" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:16:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-d79e3854-769c-430a-b980-3a551c7ee34d" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:16:27 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 01:16:27 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lazy-loading 'info_cache' on Instance uuid d79e3854-769c-430a-b980-3a551c7ee34d {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:16:28 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Updating instance_info_cache with network_info: [{"id": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "address": "fa:16:3e:07:08:aa", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1f2867-31", "ovs_interfaceid": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:16:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-d79e3854-769c-430a-b980-3a551c7ee34d" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:16:28 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 01:16:30 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:16:30 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:16:30 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:16:33 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:16:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:16:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:16:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:16:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:16:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:16:35 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:16:36 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:16:38 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:16:38 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:16:40 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:16:45 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:16:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:16:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7a387236-7a6b-4a3f-8b7d-4d49ae4da17e tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "d79e3854-769c-430a-b980-3a551c7ee34d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:16:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7a387236-7a6b-4a3f-8b7d-4d49ae4da17e tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "d79e3854-769c-430a-b980-3a551c7ee34d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:16:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7a387236-7a6b-4a3f-8b7d-4d49ae4da17e tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "d79e3854-769c-430a-b980-3a551c7ee34d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:16:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7a387236-7a6b-4a3f-8b7d-4d49ae4da17e tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "d79e3854-769c-430a-b980-3a551c7ee34d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:16:50 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7a387236-7a6b-4a3f-8b7d-4d49ae4da17e tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "d79e3854-769c-430a-b980-3a551c7ee34d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:16:50 user nova-compute[73010]: INFO nova.compute.manager [None req-7a387236-7a6b-4a3f-8b7d-4d49ae4da17e tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Terminating instance
Aug 15 01:16:50 user nova-compute[73010]: DEBUG nova.compute.manager [None req-7a387236-7a6b-4a3f-8b7d-4d49ae4da17e tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 01:16:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:16:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:16:50 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:16:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:16:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:16:51 user nova-compute[73010]: DEBUG nova.compute.manager [req-24962b86-159b-4d21-8293-ee7b1dbc7d60 req-1313d600-e3c8-44d8-a478-f25977af30a7 service nova] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Received event network-vif-unplugged-fb1f2867-31f1-4c71-94a6-f4682f62d16c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:16:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-24962b86-159b-4d21-8293-ee7b1dbc7d60 req-1313d600-e3c8-44d8-a478-f25977af30a7 service nova] Acquiring lock "d79e3854-769c-430a-b980-3a551c7ee34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:16:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-24962b86-159b-4d21-8293-ee7b1dbc7d60 req-1313d600-e3c8-44d8-a478-f25977af30a7 service nova] Lock "d79e3854-769c-430a-b980-3a551c7ee34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:16:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-24962b86-159b-4d21-8293-ee7b1dbc7d60 req-1313d600-e3c8-44d8-a478-f25977af30a7 service nova] Lock "d79e3854-769c-430a-b980-3a551c7ee34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:16:51 user nova-compute[73010]: DEBUG nova.compute.manager [req-24962b86-159b-4d21-8293-ee7b1dbc7d60 req-1313d600-e3c8-44d8-a478-f25977af30a7 service nova] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] No waiting events found dispatching network-vif-unplugged-fb1f2867-31f1-4c71-94a6-f4682f62d16c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:16:51 user nova-compute[73010]: DEBUG nova.compute.manager [req-24962b86-159b-4d21-8293-ee7b1dbc7d60 req-1313d600-e3c8-44d8-a478-f25977af30a7 service nova] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Received event network-vif-unplugged-fb1f2867-31f1-4c71-94a6-f4682f62d16c for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 01:16:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:16:51 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Instance destroyed successfully.
Aug 15 01:16:51 user nova-compute[73010]: DEBUG nova.objects.instance [None req-7a387236-7a6b-4a3f-8b7d-4d49ae4da17e tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lazy-loading 'resources' on Instance uuid d79e3854-769c-430a-b980-3a551c7ee34d {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:16:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-7a387236-7a6b-4a3f-8b7d-4d49ae4da17e tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T00:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1542157265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1542157265',id=43,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T00:57:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6db1cb9145b49999d0f102f8cfb867a',ramdisk_id='',reservation_id='r-7y51m5mf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T00:59:11Z,user_data=None,user_id='8e1e98c9bae145f0909011bb46c6e104',uuid=d79e3854-769c-430a-b980-3a551c7ee34d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "address": "fa:16:3e:07:08:aa", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1f2867-31", "ovs_interfaceid": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 01:16:51 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-7a387236-7a6b-4a3f-8b7d-4d49ae4da17e tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converting VIF {"id": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "address": "fa:16:3e:07:08:aa", "network": {"id": "a433f071-fdbd-4245-b2d8-9108ea74979d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2144579947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6db1cb9145b49999d0f102f8cfb867a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1f2867-31", "ovs_interfaceid": "fb1f2867-31f1-4c71-94a6-f4682f62d16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:16:51 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-7a387236-7a6b-4a3f-8b7d-4d49ae4da17e tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:08:aa,bridge_name='br-int',has_traffic_filtering=True,id=fb1f2867-31f1-4c71-94a6-f4682f62d16c,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1f2867-31') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:16:51 user nova-compute[73010]: DEBUG os_vif [None req-7a387236-7a6b-4a3f-8b7d-4d49ae4da17e tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:08:aa,bridge_name='br-int',has_traffic_filtering=True,id=fb1f2867-31f1-4c71-94a6-f4682f62d16c,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1f2867-31') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 01:16:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:16:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb1f2867-31, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:16:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:16:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:16:51 user nova-compute[73010]: INFO os_vif [None req-7a387236-7a6b-4a3f-8b7d-4d49ae4da17e tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:08:aa,bridge_name='br-int',has_traffic_filtering=True,id=fb1f2867-31f1-4c71-94a6-f4682f62d16c,network=Network(a433f071-fdbd-4245-b2d8-9108ea74979d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1f2867-31')
Aug 15 01:16:51 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-7a387236-7a6b-4a3f-8b7d-4d49ae4da17e tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Deleting instance files /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d_del
Aug 15 01:16:51 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-7a387236-7a6b-4a3f-8b7d-4d49ae4da17e tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Deletion of /opt/stack/data/nova/instances/d79e3854-769c-430a-b980-3a551c7ee34d_del complete
Aug 15 01:16:51 user nova-compute[73010]: INFO nova.compute.manager [None req-7a387236-7a6b-4a3f-8b7d-4d49ae4da17e tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 15 01:16:51 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-7a387236-7a6b-4a3f-8b7d-4d49ae4da17e tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 01:16:51 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 01:16:51 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 01:16:52 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:16:52 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Took 0.60 seconds to deallocate network for instance.
Aug 15 01:16:52 user nova-compute[73010]: DEBUG nova.compute.manager [req-37a730fb-4058-4cb3-8908-331e268b5598 req-dc59436a-3998-408f-9348-c2602eddbb12 service nova] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Received event network-vif-deleted-fb1f2867-31f1-4c71-94a6-f4682f62d16c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:16:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7a387236-7a6b-4a3f-8b7d-4d49ae4da17e tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:16:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7a387236-7a6b-4a3f-8b7d-4d49ae4da17e tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:16:52 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-7a387236-7a6b-4a3f-8b7d-4d49ae4da17e tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:16:52 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-7a387236-7a6b-4a3f-8b7d-4d49ae4da17e tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:16:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7a387236-7a6b-4a3f-8b7d-4d49ae4da17e tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:16:52 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-7a387236-7a6b-4a3f-8b7d-4d49ae4da17e tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Deleted allocations for instance d79e3854-769c-430a-b980-3a551c7ee34d
Aug 15 01:16:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-7a387236-7a6b-4a3f-8b7d-4d49ae4da17e tempest-ServerBootFromVolumeStableRescueTest-1758225981 tempest-ServerBootFromVolumeStableRescueTest-1758225981-project-member] Lock "d79e3854-769c-430a-b980-3a551c7ee34d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.838s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:16:53 user nova-compute[73010]: DEBUG nova.compute.manager [req-9f9c1b35-d9ec-4e1b-b68e-a05a293f4a95 req-b7965a55-c69d-4288-bd1e-ad5cba473bb0 service nova] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Received event network-vif-plugged-fb1f2867-31f1-4c71-94a6-f4682f62d16c {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:16:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9f9c1b35-d9ec-4e1b-b68e-a05a293f4a95 req-b7965a55-c69d-4288-bd1e-ad5cba473bb0 service nova] Acquiring lock "d79e3854-769c-430a-b980-3a551c7ee34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:16:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9f9c1b35-d9ec-4e1b-b68e-a05a293f4a95 req-b7965a55-c69d-4288-bd1e-ad5cba473bb0 service nova] Lock "d79e3854-769c-430a-b980-3a551c7ee34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:16:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-9f9c1b35-d9ec-4e1b-b68e-a05a293f4a95 req-b7965a55-c69d-4288-bd1e-ad5cba473bb0 service nova] Lock "d79e3854-769c-430a-b980-3a551c7ee34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:16:53 user nova-compute[73010]: DEBUG nova.compute.manager [req-9f9c1b35-d9ec-4e1b-b68e-a05a293f4a95 req-b7965a55-c69d-4288-bd1e-ad5cba473bb0 service nova] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] No waiting events found dispatching network-vif-plugged-fb1f2867-31f1-4c71-94a6-f4682f62d16c {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:16:53 user nova-compute[73010]: WARNING nova.compute.manager [req-9f9c1b35-d9ec-4e1b-b68e-a05a293f4a95 req-b7965a55-c69d-4288-bd1e-ad5cba473bb0 service nova] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Received unexpected event network-vif-plugged-fb1f2867-31f1-4c71-94a6-f4682f62d16c for instance with vm_state deleted and task_state None.
Aug 15 01:16:53 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:16:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:17:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:17:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:17:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:17:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:17:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:17:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:17:06 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692062211.719088, d79e3854-769c-430a-b980-3a551c7ee34d => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:17:06 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] VM Stopped (Lifecycle Event)
Aug 15 01:17:06 user nova-compute[73010]: DEBUG nova.compute.manager [None req-0d66f776-6e98-4d4f-bfb6-890e381dca48 None None] [instance: d79e3854-769c-430a-b980-3a551c7ee34d] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:17:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:17:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:17:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:17:19 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:17:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:17:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:17:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:17:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:17:19 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:17:19 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:17:19 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8973MB free_disk=25.379135131835938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:17:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:17:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:17:20 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:17:20 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:17:20 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:17:20 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:17:20 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:17:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:17:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:17:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:17:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:17:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:17:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:17:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:17:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:17:27 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:17:28 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:17:28 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:17:28 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:17:28 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 01:17:28 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Didn't find any instances for network info cache update. {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 01:17:31 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:17:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:17:32 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:17:34 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:17:36 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:17:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:17:38 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:17:38 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:17:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:17:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:17:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:17:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:17:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:17:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:17:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:17:44 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:17:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:17:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:17:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:17:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:17:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:17:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:17:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:17:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:18:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:18:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:18:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:18:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:18:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:18:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:18:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:18:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:18:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:18:20 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:18:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:18:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:18:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:18:20 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:18:20 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:18:20 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:18:20 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8945MB free_disk=25.368999481201172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:18:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:18:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:18:20 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:18:20 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:18:20 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:18:20 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:18:20 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:18:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.111s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:18:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:18:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:18:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:18:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:18:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:18:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:18:26 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:18:27 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:18:29 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:18:29 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:18:29 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:18:29 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 01:18:29 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Didn't find any instances for network info cache update. {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 01:18:31 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:18:33 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:18:33 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:18:35 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:18:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:18:38 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:18:38 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:18:38 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:18:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:18:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:18:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:18:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:18:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:18:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:18:46 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:18:47 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:18:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Cleaning up deleted instances {{(pid=73010) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 01:18:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] There are 0 instances to clean {{(pid=73010) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 01:18:51 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:18:54 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:18:56 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:18:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:18:59 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:19:01 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:04 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_power_states {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:19:05 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:19:05 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73010) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 01:19:05 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:06 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:10 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:11 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:14 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:16 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:19:19 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:19:19 user nova-compute[73010]: DEBUG nova.compute.manager [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Starting instance... {{(pid=73010) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 01:19:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:19:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:19:20 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73010) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 01:19:20 user nova-compute[73010]: INFO nova.compute.claims [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Claim successful on node user
Aug 15 01:19:20 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Refreshing inventories for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 01:19:20 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Updating ProviderTree inventory for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 01:19:20 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Updating inventory in ProviderTree for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 01:19:20 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Refreshing aggregate associations for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e, aggregates: None {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 01:19:20 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Refreshing trait associations for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 01:19:20 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:19:20 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:19:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:19:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Start building networks asynchronously for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 01:19:20 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:19:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Allocating IP information in the background. {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 01:19:20 user nova-compute[73010]: DEBUG nova.network.neutron [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] allocate_for_instance() {{(pid=73010) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 01:19:20 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 01:19:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:19:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:19:20 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:19:20 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:19:20 user nova-compute[73010]: DEBUG nova.compute.manager [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Start building block device mappings for instance. {{(pid=73010) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG nova.policy [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '162929b0b52e46799090ba3ae2b8f152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57d44db7923408f93b1a8eabe918d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73010) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 01:19:21 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:19:21 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:19:21 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8658MB free_disk=25.363143920898438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG nova.compute.manager [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Start spawning the instance on the hypervisor. {{(pid=73010) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Creating instance directory {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 01:19:21 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Creating image(s)
Aug 15 01:19:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "/opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "/opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "/opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.214s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "e62b40ec170177c2fdd910fe4a186644b1831b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.325s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.201s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk 1073741824 {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36,backing_fmt=raw /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk 1073741824" returned: 0 in 0.063s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "e62b40ec170177c2fdd910fe4a186644b1831b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e62b40ec170177c2fdd910fe4a186644b1831b36 --force-share --output=json" returned: 0 in 0.203s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Checking if we can resize image /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk. size=1073741824 {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG nova.network.neutron [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Successfully created port: 110e6601-1ffe-43c0-a038-4d449463bfbc {{(pid=73010) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG nova.virt.disk.api [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Cannot resize image /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk to a smaller size. {{(pid=73010) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 01:19:21 user nova-compute[73010]: DEBUG nova.objects.instance [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lazy-loading 'migration_context' on Instance uuid 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:19:22 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Created local disks {{(pid=73010) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 01:19:22 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Ensure instance console log exists: /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/console.log {{(pid=73010) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 01:19:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:19:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:19:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:19:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:22 user nova-compute[73010]: DEBUG nova.network.neutron [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Successfully updated port: 110e6601-1ffe-43c0-a038-4d449463bfbc {{(pid=73010) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 01:19:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:19:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquired lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:19:22 user nova-compute[73010]: DEBUG nova.network.neutron [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Building network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 01:19:22 user nova-compute[73010]: DEBUG nova.compute.manager [req-f9becb9e-2f4f-4ce1-84b5-6f367f58fc4e req-81258f5d-2e00-401c-be48-1dbfb160560a service nova] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Received event network-changed-110e6601-1ffe-43c0-a038-4d449463bfbc {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:19:22 user nova-compute[73010]: DEBUG nova.compute.manager [req-f9becb9e-2f4f-4ce1-84b5-6f367f58fc4e req-81258f5d-2e00-401c-be48-1dbfb160560a service nova] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Refreshing instance network info cache due to event network-changed-110e6601-1ffe-43c0-a038-4d449463bfbc. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 01:19:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f9becb9e-2f4f-4ce1-84b5-6f367f58fc4e req-81258f5d-2e00-401c-be48-1dbfb160560a service nova] Acquiring lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:19:22 user nova-compute[73010]: DEBUG nova.network.neutron [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Instance cache missing network info. {{(pid=73010) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.network.neutron [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updating instance_info_cache with network_info: [{"id": "110e6601-1ffe-43c0-a038-4d449463bfbc", "address": "fa:16:3e:6e:a9:4b", "network": {"id": "3f98d742-20df-4f77-8708-a81390aafa62", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-198697084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e57d44db7923408f93b1a8eabe918d2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e6601-1f", "ovs_interfaceid": "110e6601-1ffe-43c0-a038-4d449463bfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Releasing lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.compute.manager [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Instance network_info: |[{"id": "110e6601-1ffe-43c0-a038-4d449463bfbc", "address": "fa:16:3e:6e:a9:4b", "network": {"id": "3f98d742-20df-4f77-8708-a81390aafa62", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-198697084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e57d44db7923408f93b1a8eabe918d2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e6601-1f", "ovs_interfaceid": "110e6601-1ffe-43c0-a038-4d449463bfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73010) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f9becb9e-2f4f-4ce1-84b5-6f367f58fc4e req-81258f5d-2e00-401c-be48-1dbfb160560a service nova] Acquired lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.network.neutron [req-f9becb9e-2f4f-4ce1-84b5-6f367f58fc4e req-81258f5d-2e00-401c-be48-1dbfb160560a service nova] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Refreshing network info cache for port 110e6601-1ffe-43c0-a038-4d449463bfbc {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Start _get_guest_xml network_info=[{"id": "110e6601-1ffe-43c0-a038-4d449463bfbc", "address": "fa:16:3e:6e:a9:4b", "network": {"id": "3f98d742-20df-4f77-8708-a81390aafa62", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-198697084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e57d44db7923408f93b1a8eabe918d2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e6601-1f", "ovs_interfaceid": "110e6601-1ffe-43c0-a038-4d449463bfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '6c3513d3-9ca6-46bf-ad11-90f2f27f3126'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 01:19:23 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:19:23 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] CPU controller missing on host. {{(pid=73010) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.host [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] CPU controller found on host. {{(pid=73010) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73010) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T00:27:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T00:28:10Z,direct_url=<?>,disk_format='qcow2',id=6c3513d3-9ca6-46bf-ad11-90f2f27f3126,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f986236872347e7ae70dcf280523096',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T00:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Flavor limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Image limits 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Flavor pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Image pref 0:0:0 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Got 1 possible topologies {{(pid=73010) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.virt.hardware [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73010) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:19:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1751841988',display_name='tempest-SnapshotDataIntegrityTests-server-1751841988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1751841988',id=53,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0Fk+iIqnej6Mkr9pZixumVQY0S2rnKELygVxuFC1wtpPX+DWwdPoxUKsZcsGX80qx5Nz7wn8r+F9gK9CUlX+DpFipSJj10Vt2MouG5v4cijw7T57cO8M4do74isNEH/Q==',key_name='tempest-keypair-1957050315',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e57d44db7923408f93b1a8eabe918d2f',ramdisk_id='',reservation_id='r-f8qvv4cu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-232727290',owner_user_name='tempest-SnapshotDataIntegrityTests-232727290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T01:19:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='162929b0b52e46799090ba3ae2b8f152',uuid=09e99993-5dbb-49d7-8a27-8bed8beca6ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "110e6601-1ffe-43c0-a038-4d449463bfbc", "address": "fa:16:3e:6e:a9:4b", "network": {"id": "3f98d742-20df-4f77-8708-a81390aafa62", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-198697084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e57d44db7923408f93b1a8eabe918d2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e6601-1f", "ovs_interfaceid": "110e6601-1ffe-43c0-a038-4d449463bfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73010) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Converting VIF {"id": "110e6601-1ffe-43c0-a038-4d449463bfbc", "address": "fa:16:3e:6e:a9:4b", "network": {"id": "3f98d742-20df-4f77-8708-a81390aafa62", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-198697084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e57d44db7923408f93b1a8eabe918d2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e6601-1f", "ovs_interfaceid": "110e6601-1ffe-43c0-a038-4d449463bfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a9:4b,bridge_name='br-int',has_traffic_filtering=True,id=110e6601-1ffe-43c0-a038-4d449463bfbc,network=Network(3f98d742-20df-4f77-8708-a81390aafa62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110e6601-1f') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.objects.instance [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lazy-loading 'pci_devices' on Instance uuid 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] End _get_guest_xml xml=<domain type="kvm">
Aug 15 01:19:23 user nova-compute[73010]:   <uuid>09e99993-5dbb-49d7-8a27-8bed8beca6ff</uuid>
Aug 15 01:19:23 user nova-compute[73010]:   <name>instance-00000035</name>
Aug 15 01:19:23 user nova-compute[73010]:   <memory>524288</memory>
Aug 15 01:19:23 user nova-compute[73010]:   <vcpu>1</vcpu>
Aug 15 01:19:23 user nova-compute[73010]:   <metadata>
Aug 15 01:19:23 user nova-compute[73010]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 01:19:23 user nova-compute[73010]:       <nova:package version="0.0.0"/>
Aug 15 01:19:23 user nova-compute[73010]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1751841988</nova:name>
Aug 15 01:19:23 user nova-compute[73010]:       <nova:creationTime>2023-08-15 01:19:23</nova:creationTime>
Aug 15 01:19:23 user nova-compute[73010]:       <nova:flavor name="m1.tiny">
Aug 15 01:19:23 user nova-compute[73010]:         <nova:memory>512</nova:memory>
Aug 15 01:19:23 user nova-compute[73010]:         <nova:disk>1</nova:disk>
Aug 15 01:19:23 user nova-compute[73010]:         <nova:swap>0</nova:swap>
Aug 15 01:19:23 user nova-compute[73010]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 01:19:23 user nova-compute[73010]:         <nova:vcpus>1</nova:vcpus>
Aug 15 01:19:23 user nova-compute[73010]:       </nova:flavor>
Aug 15 01:19:23 user nova-compute[73010]:       <nova:owner>
Aug 15 01:19:23 user nova-compute[73010]:         <nova:user uuid="162929b0b52e46799090ba3ae2b8f152">tempest-SnapshotDataIntegrityTests-232727290-project-member</nova:user>
Aug 15 01:19:23 user nova-compute[73010]:         <nova:project uuid="e57d44db7923408f93b1a8eabe918d2f">tempest-SnapshotDataIntegrityTests-232727290</nova:project>
Aug 15 01:19:23 user nova-compute[73010]:       </nova:owner>
Aug 15 01:19:23 user nova-compute[73010]:       <nova:root type="image" uuid="6c3513d3-9ca6-46bf-ad11-90f2f27f3126"/>
Aug 15 01:19:23 user nova-compute[73010]:       <nova:ports>
Aug 15 01:19:23 user nova-compute[73010]:         <nova:port uuid="110e6601-1ffe-43c0-a038-4d449463bfbc">
Aug 15 01:19:23 user nova-compute[73010]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 01:19:23 user nova-compute[73010]:         </nova:port>
Aug 15 01:19:23 user nova-compute[73010]:       </nova:ports>
Aug 15 01:19:23 user nova-compute[73010]:     </nova:instance>
Aug 15 01:19:23 user nova-compute[73010]:   </metadata>
Aug 15 01:19:23 user nova-compute[73010]:   <sysinfo type="smbios">
Aug 15 01:19:23 user nova-compute[73010]:     <system>
Aug 15 01:19:23 user nova-compute[73010]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 01:19:23 user nova-compute[73010]:       <entry name="product">OpenStack Nova</entry>
Aug 15 01:19:23 user nova-compute[73010]:       <entry name="version">0.0.0</entry>
Aug 15 01:19:23 user nova-compute[73010]:       <entry name="serial">09e99993-5dbb-49d7-8a27-8bed8beca6ff</entry>
Aug 15 01:19:23 user nova-compute[73010]:       <entry name="uuid">09e99993-5dbb-49d7-8a27-8bed8beca6ff</entry>
Aug 15 01:19:23 user nova-compute[73010]:       <entry name="family">Virtual Machine</entry>
Aug 15 01:19:23 user nova-compute[73010]:     </system>
Aug 15 01:19:23 user nova-compute[73010]:   </sysinfo>
Aug 15 01:19:23 user nova-compute[73010]:   <os>
Aug 15 01:19:23 user nova-compute[73010]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 01:19:23 user nova-compute[73010]:     <boot dev="hd"/>
Aug 15 01:19:23 user nova-compute[73010]:     <smbios mode="sysinfo"/>
Aug 15 01:19:23 user nova-compute[73010]:   </os>
Aug 15 01:19:23 user nova-compute[73010]:   <features>
Aug 15 01:19:23 user nova-compute[73010]:     <acpi/>
Aug 15 01:19:23 user nova-compute[73010]:     <apic/>
Aug 15 01:19:23 user nova-compute[73010]:     <vmcoreinfo/>
Aug 15 01:19:23 user nova-compute[73010]:   </features>
Aug 15 01:19:23 user nova-compute[73010]:   <clock offset="utc">
Aug 15 01:19:23 user nova-compute[73010]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 01:19:23 user nova-compute[73010]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 01:19:23 user nova-compute[73010]:     <timer name="hpet" present="no"/>
Aug 15 01:19:23 user nova-compute[73010]:   </clock>
Aug 15 01:19:23 user nova-compute[73010]:   <cpu mode="custom" match="exact">
Aug 15 01:19:23 user nova-compute[73010]:     <model>Nehalem</model>
Aug 15 01:19:23 user nova-compute[73010]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 01:19:23 user nova-compute[73010]:   </cpu>
Aug 15 01:19:23 user nova-compute[73010]:   <devices>
Aug 15 01:19:23 user nova-compute[73010]:     <disk type="file" device="disk">
Aug 15 01:19:23 user nova-compute[73010]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 01:19:23 user nova-compute[73010]:       <source file="/opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk"/>
Aug 15 01:19:23 user nova-compute[73010]:       <target dev="vda" bus="virtio"/>
Aug 15 01:19:23 user nova-compute[73010]:     </disk>
Aug 15 01:19:23 user nova-compute[73010]:     <interface type="ethernet">
Aug 15 01:19:23 user nova-compute[73010]:       <mac address="fa:16:3e:6e:a9:4b"/>
Aug 15 01:19:23 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:19:23 user nova-compute[73010]:       <mtu size="1442"/>
Aug 15 01:19:23 user nova-compute[73010]:       <target dev="tap110e6601-1f"/>
Aug 15 01:19:23 user nova-compute[73010]:     </interface>
Aug 15 01:19:23 user nova-compute[73010]:     <serial type="pty">
Aug 15 01:19:23 user nova-compute[73010]:       <log file="/opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/console.log" append="off"/>
Aug 15 01:19:23 user nova-compute[73010]:     </serial>
Aug 15 01:19:23 user nova-compute[73010]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 01:19:23 user nova-compute[73010]:     <video>
Aug 15 01:19:23 user nova-compute[73010]:       <model type="virtio"/>
Aug 15 01:19:23 user nova-compute[73010]:     </video>
Aug 15 01:19:23 user nova-compute[73010]:     <rng model="virtio">
Aug 15 01:19:23 user nova-compute[73010]:       <backend model="random">/dev/urandom</backend>
Aug 15 01:19:23 user nova-compute[73010]:     </rng>
Aug 15 01:19:23 user nova-compute[73010]:     <controller type="usb" index="0" model="none"/>
Aug 15 01:19:23 user nova-compute[73010]:     <memballoon model="virtio">
Aug 15 01:19:23 user nova-compute[73010]:       <stats period="10"/>
Aug 15 01:19:23 user nova-compute[73010]:     </memballoon>
Aug 15 01:19:23 user nova-compute[73010]:   </devices>
Aug 15 01:19:23 user nova-compute[73010]: </domain>
Aug 15 01:19:23 user nova-compute[73010]:  {{(pid=73010) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:19:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1751841988',display_name='tempest-SnapshotDataIntegrityTests-server-1751841988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1751841988',id=53,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0Fk+iIqnej6Mkr9pZixumVQY0S2rnKELygVxuFC1wtpPX+DWwdPoxUKsZcsGX80qx5Nz7wn8r+F9gK9CUlX+DpFipSJj10Vt2MouG5v4cijw7T57cO8M4do74isNEH/Q==',key_name='tempest-keypair-1957050315',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e57d44db7923408f93b1a8eabe918d2f',ramdisk_id='',reservation_id='r-f8qvv4cu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-232727290',owner_user_name='tempest-SnapshotDataIntegrityTests-232727290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T01:19:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='162929b0b52e46799090ba3ae2b8f152',uuid=09e99993-5dbb-49d7-8a27-8bed8beca6ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "110e6601-1ffe-43c0-a038-4d449463bfbc", "address": "fa:16:3e:6e:a9:4b", "network": {"id": "3f98d742-20df-4f77-8708-a81390aafa62", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-198697084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e57d44db7923408f93b1a8eabe918d2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e6601-1f", "ovs_interfaceid": "110e6601-1ffe-43c0-a038-4d449463bfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Converting VIF {"id": "110e6601-1ffe-43c0-a038-4d449463bfbc", "address": "fa:16:3e:6e:a9:4b", "network": {"id": "3f98d742-20df-4f77-8708-a81390aafa62", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-198697084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e57d44db7923408f93b1a8eabe918d2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e6601-1f", "ovs_interfaceid": "110e6601-1ffe-43c0-a038-4d449463bfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a9:4b,bridge_name='br-int',has_traffic_filtering=True,id=110e6601-1ffe-43c0-a038-4d449463bfbc,network=Network(3f98d742-20df-4f77-8708-a81390aafa62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110e6601-1f') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG os_vif [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a9:4b,bridge_name='br-int',has_traffic_filtering=True,id=110e6601-1ffe-43c0-a038-4d449463bfbc,network=Network(3f98d742-20df-4f77-8708-a81390aafa62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110e6601-1f') {{(pid=73010) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap110e6601-1f, may_exist=True, interface_attrs={}) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap110e6601-1f, col_values=(('external_ids', {'iface-id': '110e6601-1ffe-43c0-a038-4d449463bfbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:a9:4b', 'vm-uuid': '09e99993-5dbb-49d7-8a27-8bed8beca6ff'}),), if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:23 user nova-compute[73010]: INFO os_vif [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a9:4b,bridge_name='br-int',has_traffic_filtering=True,id=110e6601-1ffe-43c0-a038-4d449463bfbc,network=Network(3f98d742-20df-4f77-8708-a81390aafa62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110e6601-1f')
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] No VIF found with MAC fa:16:3e:6e:a9:4b, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.network.neutron [req-f9becb9e-2f4f-4ce1-84b5-6f367f58fc4e req-81258f5d-2e00-401c-be48-1dbfb160560a service nova] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updated VIF entry in instance network info cache for port 110e6601-1ffe-43c0-a038-4d449463bfbc. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG nova.network.neutron [req-f9becb9e-2f4f-4ce1-84b5-6f367f58fc4e req-81258f5d-2e00-401c-be48-1dbfb160560a service nova] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updating instance_info_cache with network_info: [{"id": "110e6601-1ffe-43c0-a038-4d449463bfbc", "address": "fa:16:3e:6e:a9:4b", "network": {"id": "3f98d742-20df-4f77-8708-a81390aafa62", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-198697084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e57d44db7923408f93b1a8eabe918d2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e6601-1f", "ovs_interfaceid": "110e6601-1ffe-43c0-a038-4d449463bfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:19:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f9becb9e-2f4f-4ce1-84b5-6f367f58fc4e req-81258f5d-2e00-401c-be48-1dbfb160560a service nova] Releasing lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:19:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:24 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-96cb44ae-e290-413b-83d9-edba5106daa6 req-a50184e9-0e8f-434d-857f-16f4978467fa service nova] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Received event network-vif-plugged-110e6601-1ffe-43c0-a038-4d449463bfbc {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:19:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-96cb44ae-e290-413b-83d9-edba5106daa6 req-a50184e9-0e8f-434d-857f-16f4978467fa service nova] Acquiring lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:19:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-96cb44ae-e290-413b-83d9-edba5106daa6 req-a50184e9-0e8f-434d-857f-16f4978467fa service nova] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:19:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-96cb44ae-e290-413b-83d9-edba5106daa6 req-a50184e9-0e8f-434d-857f-16f4978467fa service nova] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:19:25 user nova-compute[73010]: DEBUG nova.compute.manager [req-96cb44ae-e290-413b-83d9-edba5106daa6 req-a50184e9-0e8f-434d-857f-16f4978467fa service nova] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] No waiting events found dispatching network-vif-plugged-110e6601-1ffe-43c0-a038-4d449463bfbc {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:19:25 user nova-compute[73010]: WARNING nova.compute.manager [req-96cb44ae-e290-413b-83d9-edba5106daa6 req-a50184e9-0e8f-434d-857f-16f4978467fa service nova] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Received unexpected event network-vif-plugged-110e6601-1ffe-43c0-a038-4d449463bfbc for instance with vm_state building and task_state spawning.
Aug 15 01:19:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:25 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:27 user nova-compute[73010]: DEBUG nova.compute.manager [req-d52888f7-17dd-4979-b53b-6264549b6df6 req-855e155e-af58-4863-bcdb-5961e28440af service nova] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Received event network-vif-plugged-110e6601-1ffe-43c0-a038-4d449463bfbc {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:19:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d52888f7-17dd-4979-b53b-6264549b6df6 req-855e155e-af58-4863-bcdb-5961e28440af service nova] Acquiring lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:19:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d52888f7-17dd-4979-b53b-6264549b6df6 req-855e155e-af58-4863-bcdb-5961e28440af service nova] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:19:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-d52888f7-17dd-4979-b53b-6264549b6df6 req-855e155e-af58-4863-bcdb-5961e28440af service nova] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:19:27 user nova-compute[73010]: DEBUG nova.compute.manager [req-d52888f7-17dd-4979-b53b-6264549b6df6 req-855e155e-af58-4863-bcdb-5961e28440af service nova] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] No waiting events found dispatching network-vif-plugged-110e6601-1ffe-43c0-a038-4d449463bfbc {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:19:27 user nova-compute[73010]: WARNING nova.compute.manager [req-d52888f7-17dd-4979-b53b-6264549b6df6 req-855e155e-af58-4863-bcdb-5961e28440af service nova] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Received unexpected event network-vif-plugged-110e6601-1ffe-43c0-a038-4d449463bfbc for instance with vm_state building and task_state spawning.
Aug 15 01:19:27 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692062367.4166148, 09e99993-5dbb-49d7-8a27-8bed8beca6ff => Resumed> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:19:27 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] VM Resumed (Lifecycle Event)
Aug 15 01:19:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Instance event wait completed in 0 seconds for  {{(pid=73010) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 01:19:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Guest created on hypervisor {{(pid=73010) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 01:19:27 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Instance spawned successfully.
Aug 15 01:19:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 01:19:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:19:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:19:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Found default for hw_cdrom_bus of ide {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:19:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Found default for hw_disk_bus of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:19:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Found default for hw_input_bus of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:19:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Found default for hw_pointer_model of None {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:19:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Found default for hw_video_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:19:27 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Found default for hw_vif_model of virtio {{(pid=73010) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 01:19:27 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 01:19:27 user nova-compute[73010]: DEBUG nova.virt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Emitting event <LifecycleEvent: 1692062367.4250562, 09e99993-5dbb-49d7-8a27-8bed8beca6ff => Started> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:19:27 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] VM Started (Lifecycle Event)
Aug 15 01:19:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:19:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73010) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 01:19:27 user nova-compute[73010]: INFO nova.compute.manager [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 01:19:27 user nova-compute[73010]: INFO nova.compute.manager [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Took 6.56 seconds to spawn the instance on the hypervisor.
Aug 15 01:19:27 user nova-compute[73010]: DEBUG nova.compute.manager [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:19:27 user nova-compute[73010]: INFO nova.compute.manager [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Took 7.76 seconds to build instance.
Aug 15 01:19:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-969f86e0-7837-4567-a175-751c33f3b7dc tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.919s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:19:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:30 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:19:30 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:19:30 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:19:30 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:19:30 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 01:19:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:19:30 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:19:30 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 01:19:30 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lazy-loading 'info_cache' on Instance uuid 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:19:31 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updating instance_info_cache with network_info: [{"id": "110e6601-1ffe-43c0-a038-4d449463bfbc", "address": "fa:16:3e:6e:a9:4b", "network": {"id": "3f98d742-20df-4f77-8708-a81390aafa62", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-198697084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e57d44db7923408f93b1a8eabe918d2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e6601-1f", "ovs_interfaceid": "110e6601-1ffe-43c0-a038-4d449463bfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:19:31 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:19:31 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 01:19:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:19:33 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:19:34 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:19:37 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:19:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:38 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:19:39 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:19:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:19:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:19:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:20:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:20:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:20:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:20:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:20:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:20:21 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:20:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:20:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:20:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:20:21 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:20:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:20:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:20:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:20:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:20:22 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:20:22 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:20:22 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8716MB free_disk=25.322887420654297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:20:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:20:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:20:22 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:20:22 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:20:22 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:20:22 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:20:22 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:20:22 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:20:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:20:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:20:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:20:32 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:20:32 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:20:32 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:20:32 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 01:20:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:20:32 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:20:32 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 01:20:32 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lazy-loading 'info_cache' on Instance uuid 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:20:33 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updating instance_info_cache with network_info: [{"id": "110e6601-1ffe-43c0-a038-4d449463bfbc", "address": "fa:16:3e:6e:a9:4b", "network": {"id": "3f98d742-20df-4f77-8708-a81390aafa62", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-198697084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e57d44db7923408f93b1a8eabe918d2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e6601-1f", "ovs_interfaceid": "110e6601-1ffe-43c0-a038-4d449463bfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:20:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:20:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 01:20:33 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:20:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:20:34 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:20:36 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:20:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:20:38 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:20:38 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:20:39 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:20:39 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:20:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:20:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:20:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:20:54 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:20:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:21:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:21:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:21:10 user nova-compute[73010]: DEBUG nova.compute.manager [req-28b38e4c-feeb-4eba-b7db-7541e6fae41a req-96021d60-447b-48b8-b67d-2381bd2c57ed service nova] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Received event network-changed-110e6601-1ffe-43c0-a038-4d449463bfbc {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:21:10 user nova-compute[73010]: DEBUG nova.compute.manager [req-28b38e4c-feeb-4eba-b7db-7541e6fae41a req-96021d60-447b-48b8-b67d-2381bd2c57ed service nova] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Refreshing instance network info cache due to event network-changed-110e6601-1ffe-43c0-a038-4d449463bfbc. {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 01:21:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-28b38e4c-feeb-4eba-b7db-7541e6fae41a req-96021d60-447b-48b8-b67d-2381bd2c57ed service nova] Acquiring lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:21:10 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-28b38e4c-feeb-4eba-b7db-7541e6fae41a req-96021d60-447b-48b8-b67d-2381bd2c57ed service nova] Acquired lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:21:10 user nova-compute[73010]: DEBUG nova.network.neutron [req-28b38e4c-feeb-4eba-b7db-7541e6fae41a req-96021d60-447b-48b8-b67d-2381bd2c57ed service nova] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Refreshing network info cache for port 110e6601-1ffe-43c0-a038-4d449463bfbc {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 01:21:11 user nova-compute[73010]: DEBUG nova.network.neutron [req-28b38e4c-feeb-4eba-b7db-7541e6fae41a req-96021d60-447b-48b8-b67d-2381bd2c57ed service nova] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updated VIF entry in instance network info cache for port 110e6601-1ffe-43c0-a038-4d449463bfbc. {{(pid=73010) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 01:21:11 user nova-compute[73010]: DEBUG nova.network.neutron [req-28b38e4c-feeb-4eba-b7db-7541e6fae41a req-96021d60-447b-48b8-b67d-2381bd2c57ed service nova] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updating instance_info_cache with network_info: [{"id": "110e6601-1ffe-43c0-a038-4d449463bfbc", "address": "fa:16:3e:6e:a9:4b", "network": {"id": "3f98d742-20df-4f77-8708-a81390aafa62", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-198697084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e57d44db7923408f93b1a8eabe918d2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e6601-1f", "ovs_interfaceid": "110e6601-1ffe-43c0-a038-4d449463bfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:21:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-28b38e4c-feeb-4eba-b7db-7541e6fae41a req-96021d60-447b-48b8-b67d-2381bd2c57ed service nova] Releasing lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:21:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:21:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG nova.objects.instance [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lazy-loading 'flavor' on Instance uuid 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:21:15 user nova-compute[73010]: INFO nova.compute.manager [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Attaching volume b27ec986-e6b7-4946-accb-0871419b8cb4 to /dev/vdb
Aug 15 01:21:15 user nova-compute[73010]: DEBUG os_brick.utils [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd64e5e-4fe1-4021-9b7d-d1d8e8623976]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8636654-f02b-4e5f-a098-9ccde38eee5d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7417dcd-fed1-4917-b7fb-8c2fc4998f9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4952e122-f81c-4db2-bd68-99ef1a23d138]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 01:21:15 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 01:21:15 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2629b7-6b10-452f-b143-4165c7b5ee41]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG os_brick.utils [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:21:15 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updating existing volume attachment record: 4cf58795-1ea3-4ddf-94ef-cd62104b093d {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 01:21:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:21:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:21:21 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:21:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:21:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:21:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:21:21 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:21:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:22 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:21:22 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:21:22 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8817MB free_disk=25.32141876220703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:21:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:21:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:21:22 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:21:22 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:21:22 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:21:22 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:21:22 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:21:22 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:21:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCzhNwPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:21:23 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:21:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:21:23 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:21:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:21:23 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 01:21:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[067c0e37-2c7e-4917-b16e-2ea5c43a11bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 01:21:23 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d15d84-d05b-4878-9a76-b1a9ae5b635f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4] added
Aug 15 01:21:23 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e539ddcd-6713-4e5a-a6c4-6580babb574c]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b0a970-c170-47cb-8278-95952b6c84db]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HCzhNwPu {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HCzhNwPu" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[392baa7e-e9ef-4c77-9176-2eec643fa20b]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HCzhNwPu'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[78396086-f9fd-4b75-8802-8acb946286ac]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:23 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[99aced49-87ce-4dfb-ad4b-f8d8219894c5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 01:21:24 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 01:21:24 user nova-compute[73010]:  {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:21:24 user nova-compute[73010]: WARNING os_brick.initiator.connectors.iscsi [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 01:21:24 user nova-compute[73010]: 
Aug 15 01:21:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa4e160-edcb-4c6c-b537-ee2b54dd0a9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4, portal: 172.16.0.220,3260]
Aug 15 01:21:24 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4, portal: 172.16.0.220,3260] successful.
Aug 15 01:21:24 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33f5e3c-6834-49a1-9fa8-3522d368a1d3]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[196d6ad6-4108-450d-bf5a-441095079357]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 (non-flash)
Aug 15 01:21:24 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 (non-flash)
Aug 15 01:21:24 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.234s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5ddf83-b272-4587-801c-d8e59c50f454]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 01:21:24 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCzhNwPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 01:21:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.264s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:21:25 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] <== connect_volume: return (1266ms) {'type': 'block', 'scsi_wwn': '23361636566343938', 'path': '/dev/sdb'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:21:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361636566343938', 'path': '/dev/sdb'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 01:21:25 user nova-compute[73010]: DEBUG nova.objects.instance [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lazy-loading 'flavor' on Instance uuid 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:21:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 01:21:25 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:21:25 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 01:21:25 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 01:21:25 user nova-compute[73010]:   <serial>b27ec986-e6b7-4946-accb-0871419b8cb4</serial>
Aug 15 01:21:25 user nova-compute[73010]: </disk>
Aug 15 01:21:25 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 01:21:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:21:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:21:25 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] No VIF found with MAC fa:16:3e:6e:a9:4b, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 01:21:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-3c19d034-4b87-499d-bfa8-3c9968fae70e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.167s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:21:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:21:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:21:32 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:21:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:21:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:21:33 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:21:33 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:21:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:21:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 01:21:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:21:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:21:33 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 01:21:33 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lazy-loading 'info_cache' on Instance uuid 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:21:34 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updating instance_info_cache with network_info: [{"id": "110e6601-1ffe-43c0-a038-4d449463bfbc", "address": "fa:16:3e:6e:a9:4b", "network": {"id": "3f98d742-20df-4f77-8708-a81390aafa62", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-198697084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e57d44db7923408f93b1a8eabe918d2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e6601-1f", "ovs_interfaceid": "110e6601-1ffe-43c0-a038-4d449463bfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:21:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:21:34 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 01:21:35 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:21:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:21:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:21:38 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:21:38 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:21:40 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:21:41 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:21:41 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:21:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:21:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:21:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:21:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:21:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:21:51 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:21:51 user nova-compute[73010]: INFO nova.compute.manager [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Detaching volume b27ec986-e6b7-4946-accb-0871419b8cb4
Aug 15 01:21:51 user nova-compute[73010]: INFO nova.virt.block_device [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Attempting to driver detach volume b27ec986-e6b7-4946-accb-0871419b8cb4 from mountpoint /dev/vdb
Aug 15 01:21:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Attempting to detach device vdb from instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 01:21:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 01:21:51 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:21:51 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 01:21:51 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 01:21:51 user nova-compute[73010]:   <serial>b27ec986-e6b7-4946-accb-0871419b8cb4</serial>
Aug 15 01:21:51 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 01:21:51 user nova-compute[73010]: </disk>
Aug 15 01:21:51 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 01:21:51 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Successfully detached device vdb from instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff from the persistent domain config.
Aug 15 01:21:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 01:21:51 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 01:21:51 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:21:51 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 01:21:51 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 01:21:51 user nova-compute[73010]:   <serial>b27ec986-e6b7-4946-accb-0871419b8cb4</serial>
Aug 15 01:21:51 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 01:21:51 user nova-compute[73010]: </disk>
Aug 15 01:21:51 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692062512.390456, 09e99993-5dbb-49d7-8a27-8bed8beca6ff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 01:21:52 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Successfully detached device vdb from instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff from the live domain config.
Aug 15 01:21:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCzhNwPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:21:52 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:21:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa8e642-7969-4baa-ab44-30c80a5b424d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ff2e77-2318-417e-94b9-0e24516cbe75]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 (non-flash)
Aug 15 01:21:52 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 (non-flash)
Aug 15 01:21:52 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec304afe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4'): ({'sdb'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Removing single pathed devices sdb {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a21a93-a304-4d42-ba3e-20f9b32a0dcd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db4e712-1dc5-4225-b49d-6e78e150031e]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Flushing IO for device /dev/sdb {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e734f87-f102-4d14-bc69-79789635ec84]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c25e982-a5e8-43c8-9bd1-7b30b48fc355]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6aa8326-fce4-43e1-bc01-4e1fcee7458b]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ce9ef1-b24e-4f76-a9c9-4b453eb8232f]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4, portal: 172.16.0.220,3260]
Aug 15 01:21:52 user nova-compute[73010]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4, portal: 172.16.0.220,3260] successful.
Aug 15 01:21:52 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b27ec986-e6b7-4946-accb-0871419b8cb4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[681e215c-4da5-48f2-a863-2ae8a0be60a3]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] <== disconnect_volume: return (258ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:21:52 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 01:21:53 user nova-compute[73010]: DEBUG nova.objects.instance [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lazy-loading 'flavor' on Instance uuid 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:21:53 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-8722d35c-0150-4ff3-a629-f1666aaec798 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.564s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:21:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:21:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:21:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:21:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:21:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:21:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:21:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:22:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:22:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:22:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:22:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:22:21 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:22:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:22:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:22:21 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:22:21 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:22:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:21 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:22 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:22:22 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:22:22 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8831MB free_disk=25.31441879272461GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:22:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:22:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:22:22 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:22:22 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:22:22 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:22:22 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:22:22 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:22:22 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:22:22 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:22:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:22:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:22:32 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:22:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:22:33 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:22:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:22:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 01:22:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:22:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:22:33 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 01:22:33 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lazy-loading 'info_cache' on Instance uuid 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:22:34 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updating instance_info_cache with network_info: [{"id": "110e6601-1ffe-43c0-a038-4d449463bfbc", "address": "fa:16:3e:6e:a9:4b", "network": {"id": "3f98d742-20df-4f77-8708-a81390aafa62", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-198697084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e57d44db7923408f93b1a8eabe918d2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e6601-1f", "ovs_interfaceid": "110e6601-1ffe-43c0-a038-4d449463bfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:22:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:22:34 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 01:22:35 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:22:36 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:22:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:22:39 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:22:39 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:22:41 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:22:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:22:42 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:22:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:22:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:22:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:22:45 user nova-compute[73010]: DEBUG nova.objects.instance [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lazy-loading 'flavor' on Instance uuid 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:22:45 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:22:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:22:46 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:22:46 user nova-compute[73010]: INFO nova.compute.manager [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Attaching volume 5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 to /dev/vdb
Aug 15 01:22:46 user nova-compute[73010]: DEBUG os_brick.utils [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:22:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4ba4c3-96af-4db1-9f0f-0514995e7ce1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7924a76c-874f-4d6f-ab66-abd996e0022c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[02efe59e-7808-4750-891e-e5e61a78c108]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c88298e-e11b-4a96-bd12-7dc85b78e38a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 01:22:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 01:22:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:46 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 01:22:46 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 01:22:46 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab510bd1-6553-416e-a7df-48ab93218acc]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 01:22:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 01:22:46 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 01:22:46 user nova-compute[73010]: DEBUG os_brick.utils [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:22:46 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updating existing volume attachment record: 98a2f154-9068-43bb-9ff2-76bf3f8cd5ac {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 01:22:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:22:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:22:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGZEaPQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:22:54 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:22:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:22:54 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:22:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:22:54 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b812540-b962-42aa-b9fb-422377694445]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 01:22:54 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[07509759-099e-4bca-bc3b-0ed29e18056a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48] added
Aug 15 01:22:54 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[76120767-82af-4e74-bd97-a3a747e1bf92]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f18bf71-2a6d-4f9e-aef1-d5ae963d6c3e]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sGZEaPQO {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sGZEaPQO" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[075c19d2-9e35-463a-b621-2db6ba028677]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sGZEaPQO'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9f3beb-1e5b-4806-8d10-c0e0cf82ef68]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e486098d-59fd-4025-8cc5-bf3348f0eb88]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 01:22:54 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 01:22:54 user nova-compute[73010]:  {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:22:54 user nova-compute[73010]: WARNING os_brick.initiator.connectors.iscsi [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 01:22:54 user nova-compute[73010]: 
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6877ca-d81b-474b-baec-2a75d0624f6c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48, portal: 172.16.0.220,3260]
Aug 15 01:22:54 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48, portal: 172.16.0.220,3260] successful.
Aug 15 01:22:54 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abbe367-33ac-4968-8344-d565e89c7e69]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c51019-fb5e-43f4-81de-9c7bfa2d0db9]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 (non-flash)
Aug 15 01:22:54 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 (non-flash)
Aug 15 01:22:54 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e78ebd-ebce-43e4-b86f-d2b35d5e906e]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 01:22:54 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGZEaPQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 01:22:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:22:55 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26338373733656466', 'path': '/dev/sdb'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:22:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338373733656466', 'path': '/dev/sdb'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 01:22:55 user nova-compute[73010]: DEBUG nova.objects.instance [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lazy-loading 'flavor' on Instance uuid 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:22:55 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 01:22:55 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:22:55 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 01:22:55 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 01:22:55 user nova-compute[73010]:   <serial>5f8a0402-b8da-4992-a54e-d1aa0dfd6e48</serial>
Aug 15 01:22:55 user nova-compute[73010]: </disk>
Aug 15 01:22:55 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 01:22:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:22:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:22:56 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] No VIF found with MAC fa:16:3e:6e:a9:4b, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 01:22:56 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-ec059d67-f297-414b-85df-51b8d5cdcde8 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.260s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:22:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:22:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:22:58 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:22:58 user nova-compute[73010]: INFO nova.compute.manager [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Detaching volume 5f8a0402-b8da-4992-a54e-d1aa0dfd6e48
Aug 15 01:22:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:22:58 user nova-compute[73010]: INFO nova.virt.block_device [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Attempting to driver detach volume 5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 from mountpoint /dev/vdb
Aug 15 01:22:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Attempting to detach device vdb from instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 01:22:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 01:22:58 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:22:58 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 01:22:58 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 01:22:58 user nova-compute[73010]:   <serial>5f8a0402-b8da-4992-a54e-d1aa0dfd6e48</serial>
Aug 15 01:22:58 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 01:22:58 user nova-compute[73010]: </disk>
Aug 15 01:22:58 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 01:22:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Successfully detached device vdb from instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff from the persistent domain config.
Aug 15 01:22:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 01:22:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 01:22:58 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:22:58 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 01:22:58 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 01:22:58 user nova-compute[73010]:   <serial>5f8a0402-b8da-4992-a54e-d1aa0dfd6e48</serial>
Aug 15 01:22:58 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 01:22:58 user nova-compute[73010]: </disk>
Aug 15 01:22:58 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 01:22:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692062578.979384, 09e99993-5dbb-49d7-8a27-8bed8beca6ff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 01:22:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 01:22:58 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Successfully detached device vdb from instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff from the live domain config.
Aug 15 01:22:58 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 01:22:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGZEaPQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:22:58 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:22:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:22:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:22:58 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 01:22:58 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f77a586-f1cf-4f74-93a3-c0769916ed70]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db650f9-7501-4c5d-b89e-dbe8cf7ce624]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 (non-flash)
Aug 15 01:22:59 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 (non-flash)
Aug 15 01:22:59 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec305aacb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48'): ({'sdb'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Removing single pathed devices sdb {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab06f9ac-00b6-4fa2-accf-d4de0470622f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a263d1-18ad-4ace-a55e-24939607ae52]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Flushing IO for device /dev/sdb {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[82acb80e-f5db-424b-bbdc-c826859c462a]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f07c258-db1a-488d-b00a-073cb7c4b5e7]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1f22fd-cfd6-4492-828a-9a78b1fa6f12]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afd8f93-4c7e-47bb-a979-52b5682d0161]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48, portal: 172.16.0.220,3260]
Aug 15 01:22:59 user nova-compute[73010]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48, portal: 172.16.0.220,3260] successful.
Aug 15 01:22:59 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8a0402-b8da-4992-a54e-d1aa0dfd6e48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ec29dc-07de-42e1-bfc8-84551ed57b47]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.252s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] <== disconnect_volume: return (253ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 01:22:59 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:23:00 user nova-compute[73010]: DEBUG nova.objects.instance [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lazy-loading 'flavor' on Instance uuid 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:23:00 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-b475107a-7a36-4dba-95d9-c37b9a9be73c tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.613s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:23:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:23:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:23:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:23:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:23:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:23:23 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:23:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:23:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:23:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:23:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:23:23 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:23:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:23:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:23:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:23:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:23:24 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:23:24 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:23:24 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8816MB free_disk=25.312496185302734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:23:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:23:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:23:24 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:23:24 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:23:24 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:23:24 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:23:24 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:23:24 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:23:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:23:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:23:33 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:23:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:23:33 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 01:23:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:23:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:23:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:23:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:23:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:23:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:23:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:23:33 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:23:33 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 01:23:33 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lazy-loading 'info_cache' on Instance uuid 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:23:34 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updating instance_info_cache with network_info: [{"id": "110e6601-1ffe-43c0-a038-4d449463bfbc", "address": "fa:16:3e:6e:a9:4b", "network": {"id": "3f98d742-20df-4f77-8708-a81390aafa62", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-198697084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e57d44db7923408f93b1a8eabe918d2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e6601-1f", "ovs_interfaceid": "110e6601-1ffe-43c0-a038-4d449463bfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:23:34 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:23:34 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 01:23:34 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:23:35 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:23:37 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:23:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:23:41 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:23:41 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:23:43 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:23:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:23:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:23:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:23:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:23:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:23:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:23:44 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:23:44 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:23:48 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:23:48 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Cleaning up deleted instances {{(pid=73010) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 01:23:48 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] There are 0 instances to clean {{(pid=73010) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 01:23:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG nova.objects.instance [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lazy-loading 'flavor' on Instance uuid 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:23:52 user nova-compute[73010]: INFO nova.compute.manager [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Attaching volume d0e16380-06a6-40e1-8ce6-e87c24461ffe to /dev/vdb
Aug 15 01:23:52 user nova-compute[73010]: DEBUG os_brick.utils [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2866da22-dae8-4a81-b88d-5e990bf493b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[eade597a-36ea-4588-83b7-fd1ed075acf8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[550a0565-fe19-445a-a2dc-80f8bfbe02b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[520a0a20-2034-455a-a8a1-f16296f33f72]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 01:23:52 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 01:23:52 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3f3c5a-4327-48f5-a601-b6abc90910ff]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG os_brick.utils [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:23:52 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updating existing volume attachment record: 29a23ece-1ce4-4b89-bbec-8883a23af408 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 01:23:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:23:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:23:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:24:00 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 01:24:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LbHnrXEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:24:00 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:24:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:24:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:24:00 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:24:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:24:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:24:00 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 01:24:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fd358f-0795-4e32-8069-2ca41d5f7ec9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 01:24:00 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:24:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cef54c-b18d-449b-97fb-0c1f81c2244e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe] added
Aug 15 01:24:00 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:24:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[88151d7d-e543-47e7-81cd-6b235956462e]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:24:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[972f4d4f-c863-40b7-abf8-244830de06d7]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:24:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LbHnrXEh {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LbHnrXEh" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:00 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[abab9479-311a-45ad-8a22-aba8790a4ad6]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:00 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LbHnrXEh'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:24:00 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b16560f-2a5e-47f0-b246-f3c42105e06c]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abd652d-a55e-4acc-b7e7-ce5ee5449ec7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 01:24:01 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 01:24:01 user nova-compute[73010]:  {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:24:01 user nova-compute[73010]: WARNING os_brick.initiator.connectors.iscsi [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 01:24:01 user nova-compute[73010]: 
Aug 15 01:24:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc495ed-5a5e-434c-9ab2-116c54b4076e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe, portal: 172.16.0.220,3260]
Aug 15 01:24:01 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe, portal: 172.16.0.220,3260] successful.
Aug 15 01:24:01 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fb9e9e-aa96-4150-a783-79e0c3bdacbf]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e29f770-acd5-4948-a892-592d30a8faa6]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe (non-flash)
Aug 15 01:24:01 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe (non-flash)
Aug 15 01:24:01 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6311930-4397-47c1-a95a-0cd193ce572e]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 01:24:01 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LbHnrXEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 01:24:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:24:02 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26461343330376231', 'path': '/dev/sdb'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:24:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461343330376231', 'path': '/dev/sdb'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 01:24:02 user nova-compute[73010]: DEBUG nova.objects.instance [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lazy-loading 'flavor' on Instance uuid 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:24:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 01:24:02 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:24:02 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 01:24:02 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 01:24:02 user nova-compute[73010]:   <serial>d0e16380-06a6-40e1-8ce6-e87c24461ffe</serial>
Aug 15 01:24:02 user nova-compute[73010]: </disk>
Aug 15 01:24:02 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 01:24:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:24:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:24:02 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] No VIF found with MAC fa:16:3e:6e:a9:4b, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 01:24:02 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-96373aa7-b599-4d84-b149-c7e746177b76 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.064s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:24:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:24:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:24:04 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:24:04 user nova-compute[73010]: INFO nova.compute.manager [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Detaching volume d0e16380-06a6-40e1-8ce6-e87c24461ffe
Aug 15 01:24:05 user nova-compute[73010]: INFO nova.virt.block_device [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Attempting to driver detach volume d0e16380-06a6-40e1-8ce6-e87c24461ffe from mountpoint /dev/vdb
Aug 15 01:24:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Attempting to detach device vdb from instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 01:24:05 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:24:05 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 01:24:05 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 01:24:05 user nova-compute[73010]:   <serial>d0e16380-06a6-40e1-8ce6-e87c24461ffe</serial>
Aug 15 01:24:05 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 01:24:05 user nova-compute[73010]: </disk>
Aug 15 01:24:05 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 01:24:05 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Successfully detached device vdb from instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff from the persistent domain config.
Aug 15 01:24:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 01:24:05 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:24:05 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 01:24:05 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 01:24:05 user nova-compute[73010]:   <serial>d0e16380-06a6-40e1-8ce6-e87c24461ffe</serial>
Aug 15 01:24:05 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 01:24:05 user nova-compute[73010]: </disk>
Aug 15 01:24:05 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692062645.5340166, 09e99993-5dbb-49d7-8a27-8bed8beca6ff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 01:24:05 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Successfully detached device vdb from instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff from the live domain config.
Aug 15 01:24:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LbHnrXEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:24:05 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:24:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc15ab6-1d72-458e-93dc-9bee9d90709e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ce7d85-88fa-4e00-b5c3-baac58ce60a1]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe (non-flash)
Aug 15 01:24:05 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe (non-flash)
Aug 15 01:24:05 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec506a5bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe'): ({'sdb'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Removing single pathed devices sdb {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94026bb-f68d-4bcb-bc09-2ba94def2d74]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5025f39-01bb-4653-b24f-d433c9777efb]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Flushing IO for device /dev/sdb {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e217efa-a1e9-4d2a-9ff5-b781233cedf4]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcde2817-db01-480f-a48f-62ae9b1d2601]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62536d0-b685-4f72-852d-61e938f461f3]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41f66b8-6789-4df5-a09f-a3496a9eaaee]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe, portal: 172.16.0.220,3260]
Aug 15 01:24:05 user nova-compute[73010]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe, portal: 172.16.0.220,3260] successful.
Aug 15 01:24:05 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e16380-06a6-40e1-8ce6-e87c24461ffe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec4778c-f2ed-4d44-ac64-2d24b93d10ec]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.248s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] <== disconnect_volume: return (250ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:24:05 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 01:24:06 user nova-compute[73010]: DEBUG nova.objects.instance [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lazy-loading 'flavor' on Instance uuid 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:24:06 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-d49b44f0-4a92-4674-82c7-d6dc0ca61e8e tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.662s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:24:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:24:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:24:09 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:24:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:24:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:24:19 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:24:19 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73010) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 01:24:23 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:24:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:24:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:24:23 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:24:23 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:24:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:24:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:23 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:24 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:24:24 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:24:24 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8815MB free_disk=25.311481475830078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:24:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:24:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:24:24 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:24:24 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:24:24 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:24:24 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Refreshing inventories for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 01:24:24 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Updating ProviderTree inventory for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 01:24:24 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Updating inventory in ProviderTree for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 01:24:24 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Refreshing aggregate associations for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e, aggregates: None {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 01:24:24 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Refreshing trait associations for resource provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73010) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 01:24:24 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:24:24 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:24:24 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:24:24 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.520s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:24:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:24:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:24:35 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:24:35 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:24:35 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:24:35 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 01:24:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:24:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:24:36 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 01:24:36 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lazy-loading 'info_cache' on Instance uuid 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:24:36 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updating instance_info_cache with network_info: [{"id": "110e6601-1ffe-43c0-a038-4d449463bfbc", "address": "fa:16:3e:6e:a9:4b", "network": {"id": "3f98d742-20df-4f77-8708-a81390aafa62", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-198697084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e57d44db7923408f93b1a8eabe918d2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e6601-1f", "ovs_interfaceid": "110e6601-1ffe-43c0-a038-4d449463bfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:24:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:24:36 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 01:24:36 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:24:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:24:39 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:24:41 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:24:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:24:43 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:24:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:24:44 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:24:44 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:24:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:24:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:24:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG nova.objects.instance [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lazy-loading 'flavor' on Instance uuid 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:24:59 user nova-compute[73010]: INFO nova.compute.manager [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Attaching volume d3aaf002-0240-4acb-9444-9f29c9a284e4 to /dev/vdb
Aug 15 01:24:59 user nova-compute[73010]: DEBUG os_brick.utils [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2f2ae3-9aad-45c0-b608-57eb164fe0e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b98ce981d8ee\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced3891b-c67e-4728-aadb-1fa4b0c208c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc0c806-6781-4ac6-ad3f-5c7e8e738fa1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[58096f68-f0c5-4623-8488-02b6bfda3c66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Running cmd (subprocess): nvme version {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] 'nvme version' failed. Not Retrying. {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] nvme not present on system {{(pid=73010) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 01:24:59 user nova-compute[73010]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 01:24:59 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f54f3ed-1b27-4086-96d1-93fe82043a1b]: (4, '') {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73010) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.lightos [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] LIGHTOS: no hostnqn found. {{(pid=73010) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG os_brick.utils [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b98ce981d8ee', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:24:59 user nova-compute[73010]: DEBUG nova.virt.block_device [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updating existing volume attachment record: 9fc1da34-ab73-4ebb-9fc3-450aa311f331 {{(pid=73010) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 01:25:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:25:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Calling os-brick to attach iSCSI Volume {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GndkpBOV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:25:07 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:25:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:25:07 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:25:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:25:07 user nova-compute[73010]: INFO os_brick.initiator.connectors.iscsi [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 01:25:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 -p 172.16.0.220:3260 {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[83eed4c6-cd28-45cf-932b-1f6d63978056]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 01:25:07 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ed09fc-a2d1-4af6-8076-7918f2670936]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4] added\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4] added
Aug 15 01:25:07 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[086335aa-cf38-415e-aa73-3c4244f31729]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0cd8f6-636d-4285-827d-2be8a00d2a05]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GndkpBOV {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GndkpBOV" returned: 0 in 0.021s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[6971a147-9b3b-4de4-b0b8-79fc75edeb36]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GndkpBOV'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[052767de-8819-453a-9ad9-1a666f65303b]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b0e958-edd0-420d-ac45-1856d01d9986]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 01:25:07 user nova-compute[73010]:  {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:25:07 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 01:25:07 user nova-compute[73010]:  {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:25:07 user nova-compute[73010]: WARNING os_brick.initiator.connectors.iscsi [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 01:25:07 user nova-compute[73010]: 
Aug 15 01:25:07 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 -p 172.16.0.220:3260 --login {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:25:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:25:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32ff4d1-588a-448e-aec5-9d3a19c5b357]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:25:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4, portal: 172.16.0.220,3260]
Aug 15 01:25:08 user nova-compute[73010]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4, portal: 172.16.0.220,3260] successful.
Aug 15 01:25:08 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:25:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:25:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:25:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a709e32-d139-47f5-92a0-188cec110596]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:25:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:25:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:25:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:25:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[002af822-ba57-42e3-bc30-9cc01c1b9989]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:25:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 (non-flash)
Aug 15 01:25:08 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:25:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 (non-flash)
Aug 15 01:25:08 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:25:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:25:08 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Connected to 172.16.0.220:3260 {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 01:25:08 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=73010) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 01:25:08 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73010) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 01:25:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:25:08 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:25:08 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbf0923-abba-4599-842d-544cc366e2b4]: (4, ('- - 0', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:25:08 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 01:25:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:25:09 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73010) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 01:25:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GndkpBOV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73010) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 01:25:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:25:09 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23363306533646461', 'path': '/dev/sdb'} {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:25:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363306533646461', 'path': '/dev/sdb'} {{(pid=73010) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 01:25:09 user nova-compute[73010]: DEBUG nova.objects.instance [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lazy-loading 'flavor' on Instance uuid 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:25:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 01:25:09 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:25:09 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 01:25:09 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 01:25:09 user nova-compute[73010]:   <serial>d3aaf002-0240-4acb-9444-9f29c9a284e4</serial>
Aug 15 01:25:09 user nova-compute[73010]: </disk>
Aug 15 01:25:09 user nova-compute[73010]:  {{(pid=73010) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 01:25:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] No BDM found with device name vda, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:25:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73010) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 01:25:09 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] No VIF found with MAC fa:16:3e:6e:a9:4b, not building metadata {{(pid=73010) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 01:25:09 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-df06c7b3-dea8-48ac-9e50-0f1e63c443a3 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.304s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:25:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:25:11 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:25:11 user nova-compute[73010]: INFO nova.compute.manager [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Detaching volume d3aaf002-0240-4acb-9444-9f29c9a284e4
Aug 15 01:25:11 user nova-compute[73010]: INFO nova.virt.block_device [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Attempting to driver detach volume d3aaf002-0240-4acb-9444-9f29c9a284e4 from mountpoint /dev/vdb
Aug 15 01:25:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Attempting to detach device vdb from instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff from the persistent domain config. {{(pid=73010) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 01:25:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 01:25:11 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:25:11 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 01:25:11 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 01:25:11 user nova-compute[73010]:   <serial>d3aaf002-0240-4acb-9444-9f29c9a284e4</serial>
Aug 15 01:25:11 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 01:25:11 user nova-compute[73010]: </disk>
Aug 15 01:25:11 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 01:25:11 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Successfully detached device vdb from instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff from the persistent domain config.
Aug 15 01:25:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff from the live domain config. {{(pid=73010) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 01:25:11 user nova-compute[73010]: DEBUG nova.virt.libvirt.guest [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 01:25:11 user nova-compute[73010]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 01:25:11 user nova-compute[73010]:   <source dev="/dev/sdb"/>
Aug 15 01:25:11 user nova-compute[73010]:   <target dev="vdb" bus="virtio"/>
Aug 15 01:25:11 user nova-compute[73010]:   <serial>d3aaf002-0240-4acb-9444-9f29c9a284e4</serial>
Aug 15 01:25:11 user nova-compute[73010]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 01:25:11 user nova-compute[73010]: </disk>
Aug 15 01:25:11 user nova-compute[73010]:  {{(pid=73010) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-86f8377c-9f1b-47f4-8f08-3ff58c6bd25b None None] Received event <DeviceRemovedEvent: 1692062712.2735064, 09e99993-5dbb-49d7-8a27-8bed8beca6ff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73010) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.driver [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 01:25:12 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Successfully detached device vdb from instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff from the live domain config.
Aug 15 01:25:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] calling os-brick to detach iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec503dab00>, {'target_iqns': ['iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GndkpBOV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 01:25:12 user nova-compute[73010]: WARNING os_brick.initiator.connectors.base [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 01:25:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4', 0)] {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7b87f1-a282-4b45-b7fe-7929b2490f2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[0898cf45-6376-4106-a26c-ff2469cb53f7]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 (non-flash)\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 (non-flash)
Aug 15 01:25:12 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 (non-flash)
Aug 15 01:25:12 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec30256320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4'): ({'sdb'}, set())}) {{(pid=73010) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Removing single pathed devices sdb {{(pid=73010) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea520335-d8d2-4e62-9f4c-a5303d98160c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[2522e9c1-e0ed-4e8d-bdd5-6202b427b7ba]: (4, ('ok\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Flushing IO for device /dev/sdb {{(pid=73010) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[153d9afb-e7b1-4240-9f13-b92f74789fd1]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73010) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd59a36-9b3a-47b0-b2d8-b617e4848160]: (4, ('1', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG os_brick.initiator.linuxscsi [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] SCSI volumes sdb have been removed. {{(pid=73010) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4')] {{(pid=73010) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d2d109-1b21-4cf6-bf13-b21cc65d3242]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 -p 172.16.0.220:3260 --logout {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bd7436-ff84-41ff-9185-d588e4e1a279]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4, portal: 172.16.0.220,3260]
Aug 15 01:25:12 user nova-compute[73010]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4, portal: 172.16.0.220,3260] successful.
Aug 15 01:25:12 user nova-compute[73010]:  stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 -p 172.16.0.220:3260 --op delete {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3aaf002-0240-4acb-9444-9f29c9a284e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG oslo.privsep.daemon [-] privsep: reply[e085341c-194e-407f-9f92-36f0ab8c5642]: (4, ('', '')) {{(pid=84080) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73010) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.base [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] <== disconnect_volume: return (297ms) None {{(pid=73010) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Disconnected iSCSI Volume {{(pid=73010) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 01:25:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:25:13 user nova-compute[73010]: DEBUG nova.objects.instance [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lazy-loading 'flavor' on Instance uuid 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:25:13 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-c4a16cad-9830-488d-a27a-90888d59ab90 tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.608s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:25:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:25:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:25:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:25:25 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:25:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:25:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:25:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:25:25 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:25:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:25:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:25:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:25:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:25:26 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:25:26 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:25:26 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8808MB free_disk=25.310447692871094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:25:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:25:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:25:26 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:25:26 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:25:26 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:25:26 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:25:26 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:25:26 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:25:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:25:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:25:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:25:36 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:25:36 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:25:36 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:25:36 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 01:25:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:25:36 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:25:36 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 01:25:36 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lazy-loading 'info_cache' on Instance uuid 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:25:37 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updating instance_info_cache with network_info: [{"id": "110e6601-1ffe-43c0-a038-4d449463bfbc", "address": "fa:16:3e:6e:a9:4b", "network": {"id": "3f98d742-20df-4f77-8708-a81390aafa62", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-198697084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e57d44db7923408f93b1a8eabe918d2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e6601-1f", "ovs_interfaceid": "110e6601-1ffe-43c0-a038-4d449463bfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:25:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:25:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 01:25:37 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:25:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:25:40 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:25:41 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:25:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:25:43 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:25:43 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:25:45 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:25:45 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:25:48 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:25:53 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:25:58 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:26:03 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:26:08 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:26:13 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:26:18 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:26:23 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:26:25 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:26:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:26:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:26:25 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:26:25 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:26:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:26:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:26:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:26:25 user nova-compute[73010]: DEBUG oslo_concurrency.processutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:26:26 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:26:26 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:26:26 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8805MB free_disk=25.309654235839844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:26:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:26:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:26:26 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73010) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 01:26:26 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:26:26 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:26:26 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:26:26 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:26:26 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:26:26 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:26:28 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:26:33 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:26:37 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:26:37 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:26:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:26:37 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 01:26:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:26:37 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquired lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:26:37 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Forcefully refreshing network info cache for instance {{(pid=73010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 01:26:37 user nova-compute[73010]: DEBUG nova.objects.instance [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lazy-loading 'info_cache' on Instance uuid 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:26:38 user nova-compute[73010]: DEBUG nova.network.neutron [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updating instance_info_cache with network_info: [{"id": "110e6601-1ffe-43c0-a038-4d449463bfbc", "address": "fa:16:3e:6e:a9:4b", "network": {"id": "3f98d742-20df-4f77-8708-a81390aafa62", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-198697084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e57d44db7923408f93b1a8eabe918d2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e6601-1f", "ovs_interfaceid": "110e6601-1ffe-43c0-a038-4d449463bfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:26:38 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Releasing lock "refresh_cache-09e99993-5dbb-49d7-8a27-8bed8beca6ff" {{(pid=73010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:26:38 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updated the network info_cache for instance {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 01:26:38 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:26:38 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:26:40 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:26:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-eb14194e-4c4b-4e91-a016-96c02a73587b tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:26:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-eb14194e-4c4b-4e91-a016-96c02a73587b tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:26:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-eb14194e-4c4b-4e91-a016-96c02a73587b tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:26:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-eb14194e-4c4b-4e91-a016-96c02a73587b tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:26:41 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-eb14194e-4c4b-4e91-a016-96c02a73587b tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:26:41 user nova-compute[73010]: INFO nova.compute.manager [None req-eb14194e-4c4b-4e91-a016-96c02a73587b tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Terminating instance
Aug 15 01:26:41 user nova-compute[73010]: DEBUG nova.compute.manager [None req-eb14194e-4c4b-4e91-a016-96c02a73587b tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Start destroying the instance on the hypervisor. {{(pid=73010) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 01:26:41 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:26:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:26:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:26:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:26:42 user nova-compute[73010]: DEBUG nova.compute.manager [req-eb46943c-6dac-497a-8123-b0f4568bf1c2 req-119b2458-2c1b-441b-8771-c6cc5622d116 service nova] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Received event network-vif-unplugged-110e6601-1ffe-43c0-a038-4d449463bfbc {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:26:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-eb46943c-6dac-497a-8123-b0f4568bf1c2 req-119b2458-2c1b-441b-8771-c6cc5622d116 service nova] Acquiring lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:26:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-eb46943c-6dac-497a-8123-b0f4568bf1c2 req-119b2458-2c1b-441b-8771-c6cc5622d116 service nova] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:26:42 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-eb46943c-6dac-497a-8123-b0f4568bf1c2 req-119b2458-2c1b-441b-8771-c6cc5622d116 service nova] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:26:42 user nova-compute[73010]: DEBUG nova.compute.manager [req-eb46943c-6dac-497a-8123-b0f4568bf1c2 req-119b2458-2c1b-441b-8771-c6cc5622d116 service nova] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] No waiting events found dispatching network-vif-unplugged-110e6601-1ffe-43c0-a038-4d449463bfbc {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:26:42 user nova-compute[73010]: DEBUG nova.compute.manager [req-eb46943c-6dac-497a-8123-b0f4568bf1c2 req-119b2458-2c1b-441b-8771-c6cc5622d116 service nova] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Received event network-vif-unplugged-110e6601-1ffe-43c0-a038-4d449463bfbc for instance with task_state deleting. {{(pid=73010) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 01:26:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:26:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:26:42 user nova-compute[73010]: INFO nova.virt.libvirt.driver [-] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Instance destroyed successfully.
Aug 15 01:26:42 user nova-compute[73010]: DEBUG nova.objects.instance [None req-eb14194e-4c4b-4e91-a016-96c02a73587b tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lazy-loading 'resources' on Instance uuid 09e99993-5dbb-49d7-8a27-8bed8beca6ff {{(pid=73010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 01:26:42 user nova-compute[73010]: DEBUG nova.virt.libvirt.vif [None req-eb14194e-4c4b-4e91-a016-96c02a73587b tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T01:19:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1751841988',display_name='tempest-SnapshotDataIntegrityTests-server-1751841988',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1751841988',id=53,image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0Fk+iIqnej6Mkr9pZixumVQY0S2rnKELygVxuFC1wtpPX+DWwdPoxUKsZcsGX80qx5Nz7wn8r+F9gK9CUlX+DpFipSJj10Vt2MouG5v4cijw7T57cO8M4do74isNEH/Q==',key_name='tempest-keypair-1957050315',keypairs=<?>,launch_index=0,launched_at=2023-08-15T01:19:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e57d44db7923408f93b1a8eabe918d2f',ramdisk_id='',reservation_id='r-f8qvv4cu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6c3513d3-9ca6-46bf-ad11-90f2f27f3126',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-232727290',owner_user_name='tempest-SnapshotDataIntegrityTests-232727290-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T01:19:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='162929b0b52e46799090ba3ae2b8f152',uuid=09e99993-5dbb-49d7-8a27-8bed8beca6ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "110e6601-1ffe-43c0-a038-4d449463bfbc", "address": "fa:16:3e:6e:a9:4b", "network": {"id": "3f98d742-20df-4f77-8708-a81390aafa62", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-198697084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e57d44db7923408f93b1a8eabe918d2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e6601-1f", "ovs_interfaceid": "110e6601-1ffe-43c0-a038-4d449463bfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 01:26:42 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-eb14194e-4c4b-4e91-a016-96c02a73587b tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Converting VIF {"id": "110e6601-1ffe-43c0-a038-4d449463bfbc", "address": "fa:16:3e:6e:a9:4b", "network": {"id": "3f98d742-20df-4f77-8708-a81390aafa62", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-198697084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e57d44db7923408f93b1a8eabe918d2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e6601-1f", "ovs_interfaceid": "110e6601-1ffe-43c0-a038-4d449463bfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 01:26:42 user nova-compute[73010]: DEBUG nova.network.os_vif_util [None req-eb14194e-4c4b-4e91-a016-96c02a73587b tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:a9:4b,bridge_name='br-int',has_traffic_filtering=True,id=110e6601-1ffe-43c0-a038-4d449463bfbc,network=Network(3f98d742-20df-4f77-8708-a81390aafa62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110e6601-1f') {{(pid=73010) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 01:26:42 user nova-compute[73010]: DEBUG os_vif [None req-eb14194e-4c4b-4e91-a016-96c02a73587b tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:a9:4b,bridge_name='br-int',has_traffic_filtering=True,id=110e6601-1ffe-43c0-a038-4d449463bfbc,network=Network(3f98d742-20df-4f77-8708-a81390aafa62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110e6601-1f') {{(pid=73010) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 01:26:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:26:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap110e6601-1f, bridge=br-int, if_exists=True) {{(pid=73010) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 01:26:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:26:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:26:42 user nova-compute[73010]: INFO os_vif [None req-eb14194e-4c4b-4e91-a016-96c02a73587b tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:a9:4b,bridge_name='br-int',has_traffic_filtering=True,id=110e6601-1ffe-43c0-a038-4d449463bfbc,network=Network(3f98d742-20df-4f77-8708-a81390aafa62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110e6601-1f')
Aug 15 01:26:42 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-eb14194e-4c4b-4e91-a016-96c02a73587b tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Deleting instance files /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff_del
Aug 15 01:26:42 user nova-compute[73010]: INFO nova.virt.libvirt.driver [None req-eb14194e-4c4b-4e91-a016-96c02a73587b tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Deletion of /opt/stack/data/nova/instances/09e99993-5dbb-49d7-8a27-8bed8beca6ff_del complete
Aug 15 01:26:42 user nova-compute[73010]: INFO nova.compute.manager [None req-eb14194e-4c4b-4e91-a016-96c02a73587b tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 15 01:26:42 user nova-compute[73010]: DEBUG oslo.service.loopingcall [None req-eb14194e-4c4b-4e91-a016-96c02a73587b tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73010) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 01:26:42 user nova-compute[73010]: DEBUG nova.compute.manager [-] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Deallocating network for instance {{(pid=73010) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 01:26:42 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] deallocate_for_instance() {{(pid=73010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 01:26:43 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:26:43 user nova-compute[73010]: DEBUG nova.network.neutron [-] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Updating instance_info_cache with network_info: [] {{(pid=73010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 01:26:43 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Took 0.90 seconds to deallocate network for instance.
Aug 15 01:26:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-eb14194e-4c4b-4e91-a016-96c02a73587b tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:26:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-eb14194e-4c4b-4e91-a016-96c02a73587b tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:26:43 user nova-compute[73010]: DEBUG nova.compute.manager [req-10f27837-4c1d-4023-acba-2365c2f163db req-7aa08e26-7009-427f-9752-eaedfeb1281f service nova] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Received event network-vif-deleted-110e6601-1ffe-43c0-a038-4d449463bfbc {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:26:43 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-eb14194e-4c4b-4e91-a016-96c02a73587b tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:26:43 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-eb14194e-4c4b-4e91-a016-96c02a73587b tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:26:43 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-eb14194e-4c4b-4e91-a016-96c02a73587b tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:26:44 user nova-compute[73010]: INFO nova.scheduler.client.report [None req-eb14194e-4c4b-4e91-a016-96c02a73587b tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Deleted allocations for instance 09e99993-5dbb-49d7-8a27-8bed8beca6ff
Aug 15 01:26:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-eb14194e-4c4b-4e91-a016-96c02a73587b tempest-SnapshotDataIntegrityTests-232727290 tempest-SnapshotDataIntegrityTests-232727290-project-member] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.164s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:26:44 user nova-compute[73010]: DEBUG nova.compute.manager [req-f5854cb6-e48c-4094-8563-40ec8178ecc1 req-ba8e6890-60ca-44cf-a5a3-c9e21428cd38 service nova] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Received event network-vif-plugged-110e6601-1ffe-43c0-a038-4d449463bfbc {{(pid=73010) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 01:26:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f5854cb6-e48c-4094-8563-40ec8178ecc1 req-ba8e6890-60ca-44cf-a5a3-c9e21428cd38 service nova] Acquiring lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:26:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f5854cb6-e48c-4094-8563-40ec8178ecc1 req-ba8e6890-60ca-44cf-a5a3-c9e21428cd38 service nova] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:26:44 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [req-f5854cb6-e48c-4094-8563-40ec8178ecc1 req-ba8e6890-60ca-44cf-a5a3-c9e21428cd38 service nova] Lock "09e99993-5dbb-49d7-8a27-8bed8beca6ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:26:44 user nova-compute[73010]: DEBUG nova.compute.manager [req-f5854cb6-e48c-4094-8563-40ec8178ecc1 req-ba8e6890-60ca-44cf-a5a3-c9e21428cd38 service nova] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] No waiting events found dispatching network-vif-plugged-110e6601-1ffe-43c0-a038-4d449463bfbc {{(pid=73010) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 01:26:44 user nova-compute[73010]: WARNING nova.compute.manager [req-f5854cb6-e48c-4094-8563-40ec8178ecc1 req-ba8e6890-60ca-44cf-a5a3-c9e21428cd38 service nova] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Received unexpected event network-vif-plugged-110e6601-1ffe-43c0-a038-4d449463bfbc for instance with vm_state deleted and task_state None.
Aug 15 01:26:45 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:26:47 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:26:47 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:26:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:26:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:26:57 user nova-compute[73010]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692062802.7152772, 09e99993-5dbb-49d7-8a27-8bed8beca6ff => Stopped> {{(pid=73010) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 01:26:57 user nova-compute[73010]: INFO nova.compute.manager [-] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] VM Stopped (Lifecycle Event)
Aug 15 01:26:57 user nova-compute[73010]: DEBUG nova.compute.manager [None req-39e23e8c-fbc0-4a0f-9490-20937c845912 None None] [instance: 09e99993-5dbb-49d7-8a27-8bed8beca6ff] Checking state {{(pid=73010) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 01:26:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:26:59 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:27:02 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:27:07 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:27:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:27:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:27:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73010) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 01:27:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:27:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73010) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 01:27:12 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:27:17 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:27:22 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:27:27 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:27:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:27:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:27:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:27:27 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Auditing locally available compute resources for user (node: user) {{(pid=73010) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:27:27 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:27:27 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:27:27 user nova-compute[73010]: WARNING nova.virt.libvirt.driver [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:27:27 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Hypervisor/Node resource view: name=user free_ram=8958MB free_disk=25.33692169189453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73010) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:27:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:27:27 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:27:27 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:27:27 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73010) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:27:27 user nova-compute[73010]: DEBUG nova.compute.provider_tree [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed in ProviderTree for provider: 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e {{(pid=73010) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:27:28 user nova-compute[73010]: DEBUG nova.scheduler.client.report [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Inventory has not changed for provider 76a450bc-e3b1-48a7-9fac-9bdbe0890d8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73010) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:27:28 user nova-compute[73010]: DEBUG nova.compute.resource_tracker [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Compute_service record updated for user:user {{(pid=73010) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:27:28 user nova-compute[73010]: DEBUG oslo_concurrency.lockutils [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=73010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:27:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:27:32 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:27:36 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:27:37 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:27:38 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:27:38 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:27:38 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Starting heal instance info cache {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:27:38 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Rebuilding the list of instances to heal {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 01:27:38 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Didn't find any instances for network info cache update. {{(pid=73010) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 01:27:38 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:27:39 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:27:41 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:27:42 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:27:42 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:27:43 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:27:44 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:27:45 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:27:47 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 01:27:49 user nova-compute[73010]: DEBUG oslo_service.periodic_task [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73010) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:27:49 user nova-compute[73010]: DEBUG nova.compute.manager [None req-f42529cc-d5e5-47ae-8bc5-5b1fb6d8432f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73010) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:27:52 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 01:27:57 user nova-compute[73010]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73010) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}